Bug#763080: Fails to assemble a reshapning raid after disk hickup

Goswin von Brederlow goswin-v-b at web.de
Sat Sep 27 17:57:26 UTC 2014


Package: mdadm
Version: 3.3-2
Severity: normal

Hi,

during a raid reshape, growing a raid5 from 5 to 6 disks, the onboard
SATA controler must have crashed taking 2 disks offline. After reboot
the raid did not come back (obviously) and I tried to assemble it
manually:

root at nas1:/root# mdadm -A /dev/md0 /dev/sdb /dev/sdc /dev/sdd /dev/sde /dev/sdf /dev/sda 
mdadm: too-old timestamp on backup-metadata on device-5
mdadm: If you think it is should be safe, try 'export MDADM_GROW_ALLOW_OLD=1'
mdadm: /dev/md0 assembled from 4 drives - not enough to start the array.

root at nas1:/root# MDADM_GROW_ALLOW_OLD=1 mdadm -A /dev/md0 /dev/sdb /dev/sdc /dev/sdd /dev/sde /dev/sdf /dev/sda
mdadm: accepting backup with timestamp 1411799455 for array with timestamp 1411833334
mdadm: /dev/md0 assembled from 4 drives - not enough to start the array.

root at nas1:/root# MDADM_GROW_ALLOW_OLD=1 mdadm -A --force /dev/md0 /dev/sdb /dev/sdc /dev/sdd /dev/sde /dev/sdf /dev/sda
mdadm: accepting backup with timestamp 1411799455 for array with timestamp 1411833334
mdadm: /dev/md0 assembled from 4 drives - not enough to start the array.

mdadm simply doesn't accept the 2 drives that went offline despite
being told to ignore the timestamp difference.

The raid wasn't being written to during reshape so it should be
perfectly safe to resume. How do I get that raid started again so it
can finish its reshape? 


MfG
	Goswin

### mdadm -E /dev/sdb ###
/dev/sdb:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x5
     Array UUID : 3486be91:bc31bbb5:c10e4570:2530f4e7
           Name : nas1:0  (local to host nas1)
  Creation Time : Tue Sep  9 04:01:34 2014
     Raid Level : raid5
   Raid Devices : 6

 Avail Dev Size : 11721043120 (5589.03 GiB 6001.17 GB)
     Array Size : 29302607360 (27945.14 GiB 30005.87 GB)
  Used Dev Size : 11721042944 (5589.03 GiB 6001.17 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
   Unused Space : before=1960 sectors, after=176 sectors
          State : clean
    Device UUID : cb8c6368:69fabeb3:30e368a0:bb3056f4

Internal Bitmap : 8 sectors from superblock
  Reshape pos'n : 5280002560 (5035.40 GiB 5406.72 GB)
  Delta Devices : 1 (5->6)

    Update Time : Sat Sep 27 17:55:34 2014
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : bddf8cdc - correct
         Events : 3922

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 0
   Array State : AAA..A ('A' == active, '.' == missing, 'R' == replacing)

### mdadm -E /dev/sdc ###
/dev/sdc:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x5
     Array UUID : 3486be91:bc31bbb5:c10e4570:2530f4e7
           Name : nas1:0  (local to host nas1)
  Creation Time : Tue Sep  9 04:01:34 2014
     Raid Level : raid5
   Raid Devices : 6

 Avail Dev Size : 11721043120 (5589.03 GiB 6001.17 GB)
     Array Size : 29302607360 (27945.14 GiB 30005.87 GB)
  Used Dev Size : 11721042944 (5589.03 GiB 6001.17 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
   Unused Space : before=1960 sectors, after=176 sectors
          State : clean
    Device UUID : 8d794606:81e23fe3:d75bf196:a32e9b79

Internal Bitmap : 8 sectors from superblock
  Reshape pos'n : 5280002560 (5035.40 GiB 5406.72 GB)
  Delta Devices : 1 (5->6)

    Update Time : Sat Sep 27 17:55:34 2014
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : 710d846 - correct
         Events : 3922

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 1
   Array State : AAA..A ('A' == active, '.' == missing, 'R' == replacing)

### mdadm -E /dev/sdd ###
/dev/sdd:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x5
     Array UUID : 3486be91:bc31bbb5:c10e4570:2530f4e7
           Name : nas1:0  (local to host nas1)
  Creation Time : Tue Sep  9 04:01:34 2014
     Raid Level : raid5
   Raid Devices : 6

 Avail Dev Size : 11721043120 (5589.03 GiB 6001.17 GB)
     Array Size : 29302607360 (27945.14 GiB 30005.87 GB)
  Used Dev Size : 11721042944 (5589.03 GiB 6001.17 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
   Unused Space : before=1960 sectors, after=176 sectors
          State : clean
    Device UUID : 2391b641:fc3ded21:d038ce0d:24b56a5c

Internal Bitmap : 8 sectors from superblock
  Reshape pos'n : 5280002560 (5035.40 GiB 5406.72 GB)
  Delta Devices : 1 (5->6)

    Update Time : Sat Sep 27 17:55:34 2014
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : dadaaed0 - correct
         Events : 3922

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 2
   Array State : AAA..A ('A' == active, '.' == missing, 'R' == replacing)

### mdadm -E /dev/sde ###
/dev/sde:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x5
     Array UUID : 3486be91:bc31bbb5:c10e4570:2530f4e7
           Name : nas1:0  (local to host nas1)
  Creation Time : Tue Sep  9 04:01:34 2014
     Raid Level : raid5
   Raid Devices : 6

 Avail Dev Size : 11721043120 (5589.03 GiB 6001.17 GB)
     Array Size : 29302607360 (27945.14 GiB 30005.87 GB)
  Used Dev Size : 11721042944 (5589.03 GiB 6001.17 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
   Unused Space : before=1960 sectors, after=176 sectors
          State : clean
    Device UUID : 9d54522d:b1881b31:9cfa1e74:4c41f61e

Internal Bitmap : 8 sectors from superblock
  Reshape pos'n : 5280002560 (5035.40 GiB 5406.72 GB)
  Delta Devices : 1 (5->6)

    Update Time : Sat Sep 27 17:54:01 2014
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : fe8c0a93 - correct
         Events : 3920

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 3
   Array State : AAAAAA ('A' == active, '.' == missing, 'R' == replacing)

### mdadm -E /dev/sdf ###
/dev/sdf:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x5
     Array UUID : 3486be91:bc31bbb5:c10e4570:2530f4e7
           Name : nas1:0  (local to host nas1)
  Creation Time : Tue Sep  9 04:01:34 2014
     Raid Level : raid5
   Raid Devices : 6

 Avail Dev Size : 11721043120 (5589.03 GiB 6001.17 GB)
     Array Size : 29302607360 (27945.14 GiB 30005.87 GB)
  Used Dev Size : 11721042944 (5589.03 GiB 6001.17 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
   Unused Space : before=1960 sectors, after=176 sectors
          State : clean
    Device UUID : 2dc00648:38ee9d56:eaaee1ed:ba9e0134

Internal Bitmap : 8 sectors from superblock
  Reshape pos'n : 5280002560 (5035.40 GiB 5406.72 GB)
  Delta Devices : 1 (5->6)

    Update Time : Sat Sep 27 17:54:01 2014
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : cd90ed69 - correct
         Events : 3920

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 4
   Array State : AAAAAA ('A' == active, '.' == missing, 'R' == replacing)

### mdadm -E /dev/sda ###
/dev/sda:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x5
     Array UUID : 3486be91:bc31bbb5:c10e4570:2530f4e7
           Name : nas1:0  (local to host nas1)
  Creation Time : Tue Sep  9 04:01:34 2014
     Raid Level : raid5
   Raid Devices : 6

 Avail Dev Size : 11721043120 (5589.03 GiB 6001.17 GB)
     Array Size : 29302607360 (27945.14 GiB 30005.87 GB)
  Used Dev Size : 11721042944 (5589.03 GiB 6001.17 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
   Unused Space : before=1960 sectors, after=176 sectors
          State : clean
    Device UUID : 08ecb2a1:cd975fb3:8ef0d37a:132b3866

Internal Bitmap : 8 sectors from superblock
  Reshape pos'n : 5280002560 (5035.40 GiB 5406.72 GB)
  Delta Devices : 1 (5->6)

    Update Time : Sat Sep 27 17:55:34 2014
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : 431c9139 - correct
         Events : 3922

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 5
   Array State : AAA..A ('A' == active, '.' == missing, 'R' == replacing)


-- Package-specific info:

IMPORTANT:
  please do not forget to include all relevant system information with this
  bug report. You could run
    /usr/share/bug/mdadm/script 3>&1
  as root and attach or include the output.


-- System Information:
Debian Release: jessie/sid
  APT prefers unstable
  APT policy: (500, 'unstable'), (1, 'experimental')
Architecture: amd64 (x86_64)
Foreign Architectures: i386

Kernel: Linux 3.14-1-amd64 (SMP w/4 CPU cores)
Locale: LANG=C, LC_CTYPE=de_DE (charmap=ISO-8859-1)
Shell: /bin/sh linked to /bin/dash

Versions of packages mdadm depends on:
ii  debconf      1.5.53
ii  initscripts  2.88dsf-53
ii  libc6        2.19-1
ii  lsb-base     4.1+Debian12
ii  makedev      2.3.1-93
ii  udev         204-10

Versions of packages mdadm recommends:
ii  exim4-daemon-heavy [mail-transport-agent]  4.82-8
ii  module-init-tools                          16-2

mdadm suggests no packages.

-- debconf information excluded



More information about the pkg-mdadm-devel mailing list