Bug#763080: Fails to assemble a reshapning raid after disk hickup
Goswin von Brederlow
goswin-v-b at web.de
Sat Sep 27 17:57:26 UTC 2014
Package: mdadm
Version: 3.3-2
Severity: normal
Hi,
during a raid reshape, growing a raid5 from 5 to 6 disks, the onboard
SATA controler must have crashed taking 2 disks offline. After reboot
the raid did not come back (obviously) and I tried to assemble it
manually:
root at nas1:/root# mdadm -A /dev/md0 /dev/sdb /dev/sdc /dev/sdd /dev/sde /dev/sdf /dev/sda
mdadm: too-old timestamp on backup-metadata on device-5
mdadm: If you think it is should be safe, try 'export MDADM_GROW_ALLOW_OLD=1'
mdadm: /dev/md0 assembled from 4 drives - not enough to start the array.
root at nas1:/root# MDADM_GROW_ALLOW_OLD=1 mdadm -A /dev/md0 /dev/sdb /dev/sdc /dev/sdd /dev/sde /dev/sdf /dev/sda
mdadm: accepting backup with timestamp 1411799455 for array with timestamp 1411833334
mdadm: /dev/md0 assembled from 4 drives - not enough to start the array.
root at nas1:/root# MDADM_GROW_ALLOW_OLD=1 mdadm -A --force /dev/md0 /dev/sdb /dev/sdc /dev/sdd /dev/sde /dev/sdf /dev/sda
mdadm: accepting backup with timestamp 1411799455 for array with timestamp 1411833334
mdadm: /dev/md0 assembled from 4 drives - not enough to start the array.
mdadm simply doesn't accept the 2 drives that went offline despite
being told to ignore the timestamp difference.
The raid wasn't being written to during reshape so it should be
perfectly safe to resume. How do I get that raid started again so it
can finish its reshape?
MfG
Goswin
### mdadm -E /dev/sdb ###
/dev/sdb:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x5
Array UUID : 3486be91:bc31bbb5:c10e4570:2530f4e7
Name : nas1:0 (local to host nas1)
Creation Time : Tue Sep 9 04:01:34 2014
Raid Level : raid5
Raid Devices : 6
Avail Dev Size : 11721043120 (5589.03 GiB 6001.17 GB)
Array Size : 29302607360 (27945.14 GiB 30005.87 GB)
Used Dev Size : 11721042944 (5589.03 GiB 6001.17 GB)
Data Offset : 2048 sectors
Super Offset : 8 sectors
Unused Space : before=1960 sectors, after=176 sectors
State : clean
Device UUID : cb8c6368:69fabeb3:30e368a0:bb3056f4
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 5280002560 (5035.40 GiB 5406.72 GB)
Delta Devices : 1 (5->6)
Update Time : Sat Sep 27 17:55:34 2014
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : bddf8cdc - correct
Events : 3922
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 0
Array State : AAA..A ('A' == active, '.' == missing, 'R' == replacing)
### mdadm -E /dev/sdc ###
/dev/sdc:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x5
Array UUID : 3486be91:bc31bbb5:c10e4570:2530f4e7
Name : nas1:0 (local to host nas1)
Creation Time : Tue Sep 9 04:01:34 2014
Raid Level : raid5
Raid Devices : 6
Avail Dev Size : 11721043120 (5589.03 GiB 6001.17 GB)
Array Size : 29302607360 (27945.14 GiB 30005.87 GB)
Used Dev Size : 11721042944 (5589.03 GiB 6001.17 GB)
Data Offset : 2048 sectors
Super Offset : 8 sectors
Unused Space : before=1960 sectors, after=176 sectors
State : clean
Device UUID : 8d794606:81e23fe3:d75bf196:a32e9b79
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 5280002560 (5035.40 GiB 5406.72 GB)
Delta Devices : 1 (5->6)
Update Time : Sat Sep 27 17:55:34 2014
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 710d846 - correct
Events : 3922
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 1
Array State : AAA..A ('A' == active, '.' == missing, 'R' == replacing)
### mdadm -E /dev/sdd ###
/dev/sdd:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x5
Array UUID : 3486be91:bc31bbb5:c10e4570:2530f4e7
Name : nas1:0 (local to host nas1)
Creation Time : Tue Sep 9 04:01:34 2014
Raid Level : raid5
Raid Devices : 6
Avail Dev Size : 11721043120 (5589.03 GiB 6001.17 GB)
Array Size : 29302607360 (27945.14 GiB 30005.87 GB)
Used Dev Size : 11721042944 (5589.03 GiB 6001.17 GB)
Data Offset : 2048 sectors
Super Offset : 8 sectors
Unused Space : before=1960 sectors, after=176 sectors
State : clean
Device UUID : 2391b641:fc3ded21:d038ce0d:24b56a5c
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 5280002560 (5035.40 GiB 5406.72 GB)
Delta Devices : 1 (5->6)
Update Time : Sat Sep 27 17:55:34 2014
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : dadaaed0 - correct
Events : 3922
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 2
Array State : AAA..A ('A' == active, '.' == missing, 'R' == replacing)
### mdadm -E /dev/sde ###
/dev/sde:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x5
Array UUID : 3486be91:bc31bbb5:c10e4570:2530f4e7
Name : nas1:0 (local to host nas1)
Creation Time : Tue Sep 9 04:01:34 2014
Raid Level : raid5
Raid Devices : 6
Avail Dev Size : 11721043120 (5589.03 GiB 6001.17 GB)
Array Size : 29302607360 (27945.14 GiB 30005.87 GB)
Used Dev Size : 11721042944 (5589.03 GiB 6001.17 GB)
Data Offset : 2048 sectors
Super Offset : 8 sectors
Unused Space : before=1960 sectors, after=176 sectors
State : clean
Device UUID : 9d54522d:b1881b31:9cfa1e74:4c41f61e
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 5280002560 (5035.40 GiB 5406.72 GB)
Delta Devices : 1 (5->6)
Update Time : Sat Sep 27 17:54:01 2014
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : fe8c0a93 - correct
Events : 3920
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 3
Array State : AAAAAA ('A' == active, '.' == missing, 'R' == replacing)
### mdadm -E /dev/sdf ###
/dev/sdf:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x5
Array UUID : 3486be91:bc31bbb5:c10e4570:2530f4e7
Name : nas1:0 (local to host nas1)
Creation Time : Tue Sep 9 04:01:34 2014
Raid Level : raid5
Raid Devices : 6
Avail Dev Size : 11721043120 (5589.03 GiB 6001.17 GB)
Array Size : 29302607360 (27945.14 GiB 30005.87 GB)
Used Dev Size : 11721042944 (5589.03 GiB 6001.17 GB)
Data Offset : 2048 sectors
Super Offset : 8 sectors
Unused Space : before=1960 sectors, after=176 sectors
State : clean
Device UUID : 2dc00648:38ee9d56:eaaee1ed:ba9e0134
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 5280002560 (5035.40 GiB 5406.72 GB)
Delta Devices : 1 (5->6)
Update Time : Sat Sep 27 17:54:01 2014
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : cd90ed69 - correct
Events : 3920
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 4
Array State : AAAAAA ('A' == active, '.' == missing, 'R' == replacing)
### mdadm -E /dev/sda ###
/dev/sda:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x5
Array UUID : 3486be91:bc31bbb5:c10e4570:2530f4e7
Name : nas1:0 (local to host nas1)
Creation Time : Tue Sep 9 04:01:34 2014
Raid Level : raid5
Raid Devices : 6
Avail Dev Size : 11721043120 (5589.03 GiB 6001.17 GB)
Array Size : 29302607360 (27945.14 GiB 30005.87 GB)
Used Dev Size : 11721042944 (5589.03 GiB 6001.17 GB)
Data Offset : 2048 sectors
Super Offset : 8 sectors
Unused Space : before=1960 sectors, after=176 sectors
State : clean
Device UUID : 08ecb2a1:cd975fb3:8ef0d37a:132b3866
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 5280002560 (5035.40 GiB 5406.72 GB)
Delta Devices : 1 (5->6)
Update Time : Sat Sep 27 17:55:34 2014
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 431c9139 - correct
Events : 3922
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 5
Array State : AAA..A ('A' == active, '.' == missing, 'R' == replacing)
-- Package-specific info:
IMPORTANT:
please do not forget to include all relevant system information with this
bug report. You could run
/usr/share/bug/mdadm/script 3>&1
as root and attach or include the output.
-- System Information:
Debian Release: jessie/sid
APT prefers unstable
APT policy: (500, 'unstable'), (1, 'experimental')
Architecture: amd64 (x86_64)
Foreign Architectures: i386
Kernel: Linux 3.14-1-amd64 (SMP w/4 CPU cores)
Locale: LANG=C, LC_CTYPE=de_DE (charmap=ISO-8859-1)
Shell: /bin/sh linked to /bin/dash
Versions of packages mdadm depends on:
ii debconf 1.5.53
ii initscripts 2.88dsf-53
ii libc6 2.19-1
ii lsb-base 4.1+Debian12
ii makedev 2.3.1-93
ii udev 204-10
Versions of packages mdadm recommends:
ii exim4-daemon-heavy [mail-transport-agent] 4.82-8
ii module-init-tools 16-2
mdadm suggests no packages.
-- debconf information excluded
More information about the pkg-mdadm-devel
mailing list