mdadm: Failed to assemble all arrays

David Andel andel at ifi.uzh.ch
Wed Mar 3 22:03:58 UTC 2010


Subject: mdadm: Failed to assemble all arrays
Package: mdadm
Version: 3.1.1-1+incremental+4
Severity: important

I was unable to boot starting November 27th 2009 due to bugs in grub2.
These are resolved in the meantime. However, I still cannot boot because of
mdadm.
Boot stops right after searching for root. It then sais: "failed to
assemble all arrays".
When booting with rootdelay=1 (or any other number >0) it drops in a shell
afterwards. Unfortunately, I did not manage to assemble the arrays.

Assembling all arrays after boot with Knoppix however works fine.

-- Package-specific info:
--- mdadm.conf
DEVICE partitions
CREATE owner=root group=disk mode=0660 auto=yes
HOMEHOST <system>
MAILADDR root
ARRAY /dev/md0 UUID=a5bd3732:80cf194c:132783e8:19cdff95
ARRAY /dev/md6 UUID=70cf4aab:e700f6b4:132783e8:19cdff95
ARRAY /dev/md1 UUID=7755f3a1:c7b29964:132783e8:19cdff95
ARRAY /dev/md2 UUID=59e1f135:b26cc467:132783e8:19cdff95
ARRAY /dev/md3 UUID=44ab6e82:86199c37:132783e8:19cdff95
ARRAY /dev/md4 UUID=324b7a55:29681243:132783e8:19cdff95
ARRAY /dev/md5 UUID=d0fdf302:73bfd78d:132783e8:19cdff95

--- /etc/default/mdadm
INCREMENTAL='false'
INITRDSTART='all'
AUTOSTART=true
AUTOCHECK=true
START_DAEMON=true
DAEMON_OPTIONS="--syslog"
VERBOSE=false

--- /proc/mdstat:
Personalities : [raid1] 
md5 : active raid1 sda9[0] sdb9[1]
      954710720 blocks [2/2] [UU]
      
md4 : active raid1 sda8[0] sdb8[1]
      979840 blocks [2/2] [UU]
      
md3 : active raid1 sda7[0] sdb7[1]
      8787456 blocks [2/2] [UU]
      
md2 : active raid1 sda6[0] sdb6[1]
      10739328 blocks [2/2] [UU]
      
md1 : active raid1 sda5[0] sdb5[1]
      497856 blocks [2/2] [UU]
      
md6 : active raid1 sda2[0] sdb2[1]
      979840 blocks [2/2] [UU]
      
md0 : active raid1 sda1[0] sdb1[1]
      64128 blocks [2/2] [UU]
      
unused devices: <none>

--- /proc/partitions:
major minor  #blocks  name

   8        0  976762584 sda
   8        1      64228 sda1
   8        2     979965 sda2
   8        3          1 sda3
   8        5     497983 sda5
   8        6   10739421 sda6
   8        7    8787523 sda7
   8        8     979933 sda8
   8        9  954710788 sda9
   8       16  976762584 sdb
   8       17      64228 sdb1
   8       18     979965 sdb2
   8       19          1 sdb3
   8       21     497983 sdb5
   8       22   10739421 sdb6
   8       23    8787523 sdb7
   8       24     979933 sdb8
   8       25  954710788 sdb9
 240        0    6732032 cloop0
   9        0      64128 md0
   9        6     979840 md6
   9        1     497856 md1
   9        2   10739328 md2
   9        3    8787456 md3
   9        4     979840 md4
   9        5  954710720 md5

--- LVM physical volumes:
LVM does not seem to be used.
--- mount output
/dev/md1 on / type xfs (rw,noatime)
tmpfs on /lib/init/rw type tmpfs (rw,nosuid,mode=0755)
proc on /proc type proc (rw,noexec,nosuid,nodev)
sysfs on /sys type sysfs (rw,noexec,nosuid,nodev)
udev on /dev type tmpfs (rw,mode=0755)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,noexec,nosuid,gid=5,mode=620)
binfmt_misc on /proc/sys/fs/binfmt_misc type binfmt_misc
(rw,noexec,nosuid,nodev)

--- initrd.img-2.6.28.5:
no initrd.img-2.6.28.5 found.

--- /proc/modules:
raid1 15232 7 - Live 0xf83da000
md_mod 55580 7 raid1, Live 0xf8462000

--- /var/log/syslog:

--- volume detail:
/dev/hda is not recognised by mdadm.
/dev/hdb is not recognised by mdadm.
/dev/sda is not recognised by mdadm.
/dev/sda1:
          Magic : a92b4efc
        Version : 0.90.00
           UUID : 8f8b1d6e:597f1d23:132783e8:19cdff95 (local to host
Microknoppix)
  Creation Time : Sun Feb 28 20:11:11 2010
     Raid Level : raid1
  Used Dev Size : 64128 (62.64 MiB 65.67 MB)
     Array Size : 64128 (62.64 MiB 65.67 MB)
   Raid Devices : 2
  Total Devices : 2
Preferred Minor : 0

    Update Time : Wed Mar  3 19:58:27 2010
          State : clean
 Active Devices : 2
Working Devices : 2
 Failed Devices : 0
  Spare Devices : 0
       Checksum : 56457959 - correct
         Events : 4


      Number   Major   Minor   RaidDevice State
this     0       8        1        0      active sync   /dev/sda1

   0     0       8        1        0      active sync   /dev/sda1
   1     1       8       17        1      active sync   /dev/sdb1
--
/dev/sda2:
          Magic : a92b4efc
        Version : 0.90.00
           UUID : 70cf4aab:e700f6b4:132783e8:19cdff95 (local to host
Microknoppix)
  Creation Time : Fri Jan 29 23:39:59 2010
     Raid Level : raid1
  Used Dev Size : 979840 (957.04 MiB 1003.36 MB)
     Array Size : 979840 (957.04 MiB 1003.36 MB)
   Raid Devices : 2
  Total Devices : 2
Preferred Minor : 6

    Update Time : Sat Feb 20 20:43:24 2010
          State : clean
 Active Devices : 2
Working Devices : 2
 Failed Devices : 0
  Spare Devices : 0
       Checksum : c4e3a729 - correct
         Events : 4


      Number   Major   Minor   RaidDevice State
this     0       8        2        0      active sync   /dev/sda2

   0     0       8        2        0      active sync   /dev/sda2
   1     1       8       18        1      active sync   /dev/sdb2
--
/dev/sda3 is not recognised by mdadm.
/dev/sda5:
          Magic : a92b4efc
        Version : 0.90.00
           UUID : 36787930:9e042583:132783e8:19cdff95 (local to host
Microknoppix)
  Creation Time : Sun Feb 28 20:05:56 2010
     Raid Level : raid1
  Used Dev Size : 497856 (486.27 MiB 509.80 MB)
     Array Size : 497856 (486.27 MiB 509.80 MB)
   Raid Devices : 2
  Total Devices : 2
Preferred Minor : 1

    Update Time : Wed Mar  3 22:35:41 2010
          State : clean
 Active Devices : 2
Working Devices : 2
 Failed Devices : 0
  Spare Devices : 0
       Checksum : 41be9f67 - correct
         Events : 4


      Number   Major   Minor   RaidDevice State
this     0       8        5        0      active sync   /dev/sda5

   0     0       8        5        0      active sync   /dev/sda5
   1     1       8       21        1      active sync   /dev/sdb5
--
/dev/sda6:
          Magic : a92b4efc
        Version : 0.90.00
           UUID : ca568aef:2cfb7a3e:132783e8:19cdff95 (local to host
Microknoppix)
  Creation Time : Sun Feb 28 20:13:10 2010
     Raid Level : raid1
  Used Dev Size : 10739328 (10.24 GiB 11.00 GB)
     Array Size : 10739328 (10.24 GiB 11.00 GB)
   Raid Devices : 2
  Total Devices : 2
Preferred Minor : 2

    Update Time : Wed Mar  3 19:58:39 2010
          State : clean
 Active Devices : 2
Working Devices : 2
 Failed Devices : 0
  Spare Devices : 0
       Checksum : 6530288d - correct
         Events : 6


      Number   Major   Minor   RaidDevice State
this     0       8        6        0      active sync   /dev/sda6

   0     0       8        6        0      active sync   /dev/sda6
   1     1       8       22        1      active sync   /dev/sdb6
--
/dev/sda7:
          Magic : a92b4efc
        Version : 0.90.00
           UUID : ee19872e:e82b0730:132783e8:19cdff95 (local to host
Microknoppix)
  Creation Time : Sun Feb 28 20:13:29 2010
     Raid Level : raid1
  Used Dev Size : 8787456 (8.38 GiB 9.00 GB)
     Array Size : 8787456 (8.38 GiB 9.00 GB)
   Raid Devices : 2
  Total Devices : 2
Preferred Minor : 3

    Update Time : Wed Mar  3 22:47:46 2010
          State : clean
 Active Devices : 2
Working Devices : 2
 Failed Devices : 0
  Spare Devices : 0
       Checksum : 440510f9 - correct
         Events : 6


      Number   Major   Minor   RaidDevice State
this     0       8        7        0      active sync   /dev/sda7

   0     0       8        7        0      active sync   /dev/sda7
   1     1       8       23        1      active sync   /dev/sdb7
--
/dev/sda8:
          Magic : a92b4efc
        Version : 0.90.00
           UUID : 247f334a:3ef0d8f3:132783e8:19cdff95 (local to host
Microknoppix)
  Creation Time : Sun Feb 28 20:13:49 2010
     Raid Level : raid1
  Used Dev Size : 979840 (957.04 MiB 1003.36 MB)
     Array Size : 979840 (957.04 MiB 1003.36 MB)
   Raid Devices : 2
  Total Devices : 2
Preferred Minor : 4

    Update Time : Wed Mar  3 22:47:21 2010
          State : clean
 Active Devices : 2
Working Devices : 2
 Failed Devices : 0
  Spare Devices : 0
       Checksum : d0b96c59 - correct
         Events : 8


      Number   Major   Minor   RaidDevice State
this     0       8        8        0      active sync   /dev/sda8

   0     0       8        8        0      active sync   /dev/sda8
   1     1       8       24        1      active sync   /dev/sdb8
--
/dev/sda9:
          Magic : a92b4efc
        Version : 0.90.00
           UUID : 23b65c03:34396f82:132783e8:19cdff95 (local to host
Microknoppix)
  Creation Time : Sun Feb 28 20:14:14 2010
     Raid Level : raid1
  Used Dev Size : 954710720 (910.48 GiB 977.62 GB)
     Array Size : 954710720 (910.48 GiB 977.62 GB)
   Raid Devices : 2
  Total Devices : 2
Preferred Minor : 5

    Update Time : Wed Mar  3 22:47:57 2010
          State : clean
 Active Devices : 2
Working Devices : 2
 Failed Devices : 0
  Spare Devices : 0
       Checksum : fe11f32e - correct
         Events : 14


      Number   Major   Minor   RaidDevice State
this     0       8        9        0      active sync   /dev/sda9

   0     0       8        9        0      active sync   /dev/sda9
   1     1       8       25        1      active sync   /dev/sdb9
--
/dev/sdb is not recognised by mdadm.
/dev/sdb1:
          Magic : a92b4efc
        Version : 0.90.00
           UUID : 8f8b1d6e:597f1d23:132783e8:19cdff95 (local to host
Microknoppix)
  Creation Time : Sun Feb 28 20:11:11 2010
     Raid Level : raid1
  Used Dev Size : 64128 (62.64 MiB 65.67 MB)
     Array Size : 64128 (62.64 MiB 65.67 MB)
   Raid Devices : 2
  Total Devices : 2
Preferred Minor : 0

    Update Time : Wed Mar  3 19:58:27 2010
          State : clean
 Active Devices : 2
Working Devices : 2
 Failed Devices : 0
  Spare Devices : 0
       Checksum : 5645796b - correct
         Events : 4


      Number   Major   Minor   RaidDevice State
this     1       8       17        1      active sync   /dev/sdb1

   0     0       8        1        0      active sync   /dev/sda1
   1     1       8       17        1      active sync   /dev/sdb1
--
/dev/sdb2:
          Magic : a92b4efc
        Version : 0.90.00
           UUID : 70cf4aab:e700f6b4:132783e8:19cdff95 (local to host
Microknoppix)
  Creation Time : Fri Jan 29 23:39:59 2010
     Raid Level : raid1
  Used Dev Size : 979840 (957.04 MiB 1003.36 MB)
     Array Size : 979840 (957.04 MiB 1003.36 MB)
   Raid Devices : 2
  Total Devices : 2
Preferred Minor : 6

    Update Time : Sat Feb 20 20:43:24 2010
          State : clean
 Active Devices : 2
Working Devices : 2
 Failed Devices : 0
  Spare Devices : 0
       Checksum : c4e3a73b - correct
         Events : 4


      Number   Major   Minor   RaidDevice State
this     1       8       18        1      active sync   /dev/sdb2

   0     0       8        2        0      active sync   /dev/sda2
   1     1       8       18        1      active sync   /dev/sdb2
--
/dev/sdb3 is not recognised by mdadm.
/dev/sdb5:
          Magic : a92b4efc
        Version : 0.90.00
           UUID : 36787930:9e042583:132783e8:19cdff95 (local to host
Microknoppix)
  Creation Time : Sun Feb 28 20:05:56 2010
     Raid Level : raid1
  Used Dev Size : 497856 (486.27 MiB 509.80 MB)
     Array Size : 497856 (486.27 MiB 509.80 MB)
   Raid Devices : 2
  Total Devices : 2
Preferred Minor : 1

    Update Time : Wed Mar  3 22:35:41 2010
          State : clean
 Active Devices : 2
Working Devices : 2
 Failed Devices : 0
  Spare Devices : 0
       Checksum : 41be9f79 - correct
         Events : 4


      Number   Major   Minor   RaidDevice State
this     1       8       21        1      active sync   /dev/sdb5

   0     0       8        5        0      active sync   /dev/sda5
   1     1       8       21        1      active sync   /dev/sdb5
--
/dev/sdb6:
          Magic : a92b4efc
        Version : 0.90.00
           UUID : ca568aef:2cfb7a3e:132783e8:19cdff95 (local to host
Microknoppix)
  Creation Time : Sun Feb 28 20:13:10 2010
     Raid Level : raid1
  Used Dev Size : 10739328 (10.24 GiB 11.00 GB)
     Array Size : 10739328 (10.24 GiB 11.00 GB)
   Raid Devices : 2
  Total Devices : 2
Preferred Minor : 2

    Update Time : Wed Mar  3 19:58:39 2010
          State : clean
 Active Devices : 2
Working Devices : 2
 Failed Devices : 0
  Spare Devices : 0
       Checksum : 6530289f - correct
         Events : 6


      Number   Major   Minor   RaidDevice State
this     1       8       22        1      active sync   /dev/sdb6

   0     0       8        6        0      active sync   /dev/sda6
   1     1       8       22        1      active sync   /dev/sdb6
--
/dev/sdb7:
          Magic : a92b4efc
        Version : 0.90.00
           UUID : ee19872e:e82b0730:132783e8:19cdff95 (local to host
Microknoppix)
  Creation Time : Sun Feb 28 20:13:29 2010
     Raid Level : raid1
  Used Dev Size : 8787456 (8.38 GiB 9.00 GB)
     Array Size : 8787456 (8.38 GiB 9.00 GB)
   Raid Devices : 2
  Total Devices : 2
Preferred Minor : 3

    Update Time : Wed Mar  3 22:47:46 2010
          State : clean
 Active Devices : 2
Working Devices : 2
 Failed Devices : 0
  Spare Devices : 0
       Checksum : 4405110b - correct
         Events : 6


      Number   Major   Minor   RaidDevice State
this     1       8       23        1      active sync   /dev/sdb7

   0     0       8        7        0      active sync   /dev/sda7
   1     1       8       23        1      active sync   /dev/sdb7
--
/dev/sdb8:
          Magic : a92b4efc
        Version : 0.90.00
           UUID : 247f334a:3ef0d8f3:132783e8:19cdff95 (local to host
Microknoppix)
  Creation Time : Sun Feb 28 20:13:49 2010
     Raid Level : raid1
  Used Dev Size : 979840 (957.04 MiB 1003.36 MB)
     Array Size : 979840 (957.04 MiB 1003.36 MB)
   Raid Devices : 2
  Total Devices : 2
Preferred Minor : 4

    Update Time : Wed Mar  3 22:47:21 2010
          State : clean
 Active Devices : 2
Working Devices : 2
 Failed Devices : 0
  Spare Devices : 0
       Checksum : d0b96c6b - correct
         Events : 8


      Number   Major   Minor   RaidDevice State
this     1       8       24        1      active sync   /dev/sdb8

   0     0       8        8        0      active sync   /dev/sda8
   1     1       8       24        1      active sync   /dev/sdb8
--
/dev/sdb9:
          Magic : a92b4efc
        Version : 0.90.00
           UUID : 23b65c03:34396f82:132783e8:19cdff95 (local to host
Microknoppix)
  Creation Time : Sun Feb 28 20:14:14 2010
     Raid Level : raid1
  Used Dev Size : 954710720 (910.48 GiB 977.62 GB)
     Array Size : 954710720 (910.48 GiB 977.62 GB)
   Raid Devices : 2
  Total Devices : 2
Preferred Minor : 5

    Update Time : Wed Mar  3 22:47:57 2010
          State : clean
 Active Devices : 2
Working Devices : 2
 Failed Devices : 0
  Spare Devices : 0
       Checksum : fe11f340 - correct
         Events : 14


      Number   Major   Minor   RaidDevice State
this     1       8       25        1      active sync   /dev/sdb9

   0     0       8        9        0      active sync   /dev/sda9
   1     1       8       25        1      active sync   /dev/sdb9
--
/dev/sdc is not recognised by mdadm.
/dev/sdd is not recognised by mdadm.
/dev/sde is not recognised by mdadm.
/dev/sdf is not recognised by mdadm.

--- /proc/cmdline
ramdisk_size=100000 lang=en vt.default_utf8=0 apm=power-off vga=791
initrd=minirt.gz nomce quiet loglevel=0 nolapic_timer lang=de
BOOT_IMAGE=linux lang=us

--- grub2:
insmod raid
set root=(md2)
insmod raid
set root=(md0)
	insmod raid
	set root=(md0)
	linux	/vmlinuz-2.6.31-1-686
root=UUID=56384e4f-acf8-4d4e-b22f-c68f8fd9981d ro  
	insmod raid
	set root=(md0)
	linux	/vmlinuz-2.6.31-1-686
root=UUID=56384e4f-acf8-4d4e-b22f-c68f8fd9981d ro single 
	insmod raid
	set root=(md0)
	linux	/vmlinuz-2.6.30-2-686
root=UUID=56384e4f-acf8-4d4e-b22f-c68f8fd9981d ro  
	insmod raid
	set root=(md0)
	linux	/vmlinuz-2.6.30-2-686
root=UUID=56384e4f-acf8-4d4e-b22f-c68f8fd9981d ro single 

--- grub legacy:
kernel		/vmlinuz-2.6.31-1-686 root=/dev/md1 ro 
kernel		/vmlinuz-2.6.31-1-686 root=/dev/md1 ro single
kernel		/vmlinuz-2.6.30-2-686 root=/dev/md1 ro 
kernel		/vmlinuz-2.6.30-2-686 root=/dev/md1 ro single

--- lilo:
root=/dev/md1

--- udev:
ii  udev           147-5          /dev/ and hotplug management daemon
3b573f091d7607465899a0dbe5ea74a1  /lib/udev/rules.d/64-md-raid.rules

--- /dev:
brw-rw---- 1 root disk 9, 0 Mar  3 19:57 /dev/md0
brw-rw---- 1 root disk 9, 1 Mar  3 19:57 /dev/md1
brw-rw---- 1 root disk 9, 2 Mar  3 19:57 /dev/md2
brw-rw---- 1 root disk 9, 3 Mar  3 19:57 /dev/md3
brw-rw---- 1 root disk 9, 4 Mar  3 19:57 /dev/md4
brw-rw---- 1 root disk 9, 5 Mar  3 19:57 /dev/md5
brw-rw---- 1 root disk 9, 6 Mar  3 19:57 /dev/md6

/dev/disk/by-id:
total 0
lrwxrwxrwx 1 root root 9 Mar  3 19:57
md-uuid-23b65c03:34396f82:132783e8:19cdff95 -> ../../md5
lrwxrwxrwx 1 root root 9 Mar  3 19:57
md-uuid-247f334a:3ef0d8f3:132783e8:19cdff95 -> ../../md4
lrwxrwxrwx 1 root root 9 Mar  3 19:57
md-uuid-36787930:9e042583:132783e8:19cdff95 -> ../../md1
lrwxrwxrwx 1 root root 9 Mar  3 19:57
md-uuid-70cf4aab:e700f6b4:132783e8:19cdff95 -> ../../md6
lrwxrwxrwx 1 root root 9 Mar  3 19:57
md-uuid-8f8b1d6e:597f1d23:132783e8:19cdff95 -> ../../md0
lrwxrwxrwx 1 root root 9 Mar  3 19:57
md-uuid-ca568aef:2cfb7a3e:132783e8:19cdff95 -> ../../md2
lrwxrwxrwx 1 root root 9 Mar  3 19:57
md-uuid-ee19872e:e82b0730:132783e8:19cdff95 -> ../../md3

/dev/disk/by-label:
total 0
lrwxrwxrwx 1 root root 9 Mar  3 19:57 boot -> ../../md0

/dev/disk/by-uuid:
total 0
lrwxrwxrwx 1 root root 9 Mar  3 19:57 0f779e98-8a19-4bed-a623-6a39452494c1
-> ../../md4
lrwxrwxrwx 1 root root 9 Mar  3 19:57 1ed4d236-add3-42b5-b6a0-f5e16ddd6aba
-> ../../md0
lrwxrwxrwx 1 root root 9 Mar  3 19:57 1fbe25a8-1d54-4c6f-b311-cf0a5012dc32
-> ../../md5
lrwxrwxrwx 1 root root 9 Mar  3 19:57 56384e4f-acf8-4d4e-b22f-c68f8fd9981d
-> ../../md1
lrwxrwxrwx 1 root root 9 Mar  3 19:57 dd40c93a-7fda-442f-abcd-0b76302a2046
-> ../../md3
lrwxrwxrwx 1 root root 9 Mar  3 19:57 e1053984-7ce3-4377-ae6f-761aed47e324
-> ../../md2

/dev/md:
total 0

Auto-generated on Wed, 03 Mar 2010 22:48:06 +0100
by mdadm bugscript 3.1.1-1+incremental+4

-- System Information:
Debian Release: squeeze/sid
  APT prefers unstable
  APT policy: (500, 'unstable'), (1, 'experimental')
Architecture: i386 (i686)

Kernel: Linux 2.6.28.5 (SMP w/2 CPU cores; PREEMPT)
Locale: LANG=en_GB.UTF-8, LC_CTYPE=en_GB.UTF-8 (charmap=ANSI_X3.4-1968)
(ignored: LC_ALL set to C)
Shell: /bin/sh linked to /bin/bash

Versions of packages mdadm depends on:
ii  debconf                       1.5.28     Debian configuration
management sy
ii  libc6                         2.10.2-2   GNU C Library: Shared
libraries
ii  lsb-base                      3.2-23     Linux Standard Base 3.2 init
scrip
ii  makedev                       2.3.1-89   creates device files in /dev
ii  udev                          147-5      /dev/ and hotplug management
daemo

Versions of packages mdadm recommends:
ii  exim4-daemon-light [mail-tran 4.69-11+b1 lightweight Exim MTA (v4)
daemon
ii  module-init-tools             3.11-1     tools for managing Linux
kernel mo

mdadm suggests no packages.

-- debconf information:
  mdadm/autostart: true
* mdadm/initrdstart: all
  mdadm/incremental: false
  mdadm/initrdstart_notinconf: false
  mdadm/initrdstart_msg_errexist:
  mdadm/initrdstart_msg_intro:
  mdadm/initrdstart_msg_errblock:
* mdadm/start_daemon: true
* mdadm/mail_to: root
  mdadm/initrdstart_msg_errmd:
  mdadm/initrdstart_msg_errconf:
* mdadm/autocheck: true



More information about the pkg-mdadm-devel mailing list