Bug#568922: mdadm: data-check of RAID array md0 results in soft lockup of CPU's
Jelle de Jong
jelledejong at powercraft.nl
Mon Feb 8 20:48:50 UTC 2010
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Package: mdadm
Version: 2.6.7.2-3
Severity: important
*** Please type your report below this line ***
Every time mdadm is executing its automatic data-check my system will
receive multiple soft locks, creating a temporary dos on my server.
Please see the attached file with the dump of the relevant syslog/kernlog.
I don't think I did anything special on my system or used out of
ordinary set-up. The soft lock happen on a production server that need
to stay secure and running. Any idea's why this problem is occurring?
Thanks in advance,
- -- Package-specific info:
- --- mount output
/dev/mapper/lvm0--vol-root on / type ext3 (rw)
tmpfs on /lib/init/rw type tmpfs (rw,nosuid,mode=0755)
proc on /proc type proc (rw,noexec,nosuid,nodev)
sysfs on /sys type sysfs (rw,noexec,nosuid,nodev)
procbususb on /proc/bus/usb type usbfs (rw)
udev on /dev type tmpfs (rw,mode=0755)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,noexec,nosuid,gid=5,mode=620)
/dev/mapper/lvm0--vol-home on /home type ext3 (rw)
- --- mdadm.conf
# mdadm.conf
#
# Please refer to mdadm.conf(5) for information about this file.
#
# by default, scan all partitions (/proc/partitions) for MD superblocks.
# alternatively, specify devices to scan, using wildcards if desired.
DEVICE partitions
# auto-create devices with Debian standard permissions
CREATE owner=root group=disk mode=0660 auto=yes
# automatically tag new arrays as belonging to the local system
HOMEHOST <system>
# instruct the monitoring daemon where to send mail alerts
MAILADDR root
# definitions of existing MD arrays
ARRAY /dev/md0 level=raid1 num-devices=3
UUID=3947d6c9:0d213ff7:50d4015c:b695ae2a
# This file was auto-generated on Sun, 06 Dec 2009 22:57:42 +0000
# by mkconf $Id$
- --- /proc/mdstat:
Personalities : [raid1]
md0 : active raid1 sdb1[0] sdc1[2] sda1[1]
312560576 blocks [3/3] [UUU]
unused devices: <none>
- --- /proc/partitions:
major minor #blocks name
8 0 312571224 sda
8 1 312560640 sda1
8 16 312571224 sdb
8 17 312560640 sdb1
8 32 312571224 sdc
8 33 312560640 sdc1
9 0 312560576 md0
253 0 16777216 dm-0
253 1 293601280 dm-1
253 2 524288 dm-2
- --- initrd.img-2.6.30-2-amd64:
41993 blocks
374d80ee1e41d3577c14d9dd8ac0182b
./lib/modules/2.6.30-2-amd64/kernel/drivers/md/raid10.ko
f52bb54b1d0e312d66e7d2dcaacf6610
./lib/modules/2.6.30-2-amd64/kernel/drivers/md/raid1.ko
b5ee43c2da900315a5f468a7fc7b8deb
./lib/modules/2.6.30-2-amd64/kernel/drivers/md/dm-mirror.ko
fe93816b5f15caa8969367202ad1b5f3
./lib/modules/2.6.30-2-amd64/kernel/drivers/md/md-mod.ko
fc494462ecbb43bb600841f37ea3bd48
./lib/modules/2.6.30-2-amd64/kernel/drivers/md/raid6_pq.ko
9c0d90db91e81d95bf9eb477c68d2f25
./lib/modules/2.6.30-2-amd64/kernel/drivers/md/multipath.ko
8b77a349602de35d073b3d3583c45fb4
./lib/modules/2.6.30-2-amd64/kernel/drivers/md/raid0.ko
c9b3dff6582f388dce219b2c067b33b7
./lib/modules/2.6.30-2-amd64/kernel/drivers/md/dm-mod.ko
9bf7021d452633c531c7baa7cb0a1241
./lib/modules/2.6.30-2-amd64/kernel/drivers/md/linear.ko
0f8e9ed3bf5348bebff4433a517340e4
./lib/modules/2.6.30-2-amd64/kernel/drivers/md/dm-region-hash.ko
f838331e20c49fb3bf695a0cf35d6a91
./lib/modules/2.6.30-2-amd64/kernel/drivers/md/dm-snapshot.ko
1727cc7c84dd125b126314d5b980e992
./lib/modules/2.6.30-2-amd64/kernel/drivers/md/raid456.ko
50929b5f9e9d604bcd006c675de78cf6
./lib/modules/2.6.30-2-amd64/kernel/drivers/md/dm-log.ko
e1e2d0e985196fecaf41fb42e9968af2 ./scripts/local-top/mdadm
ea9abd44166c288560f8c9789cb3949d ./sbin/mdadm
3ff085b6b9ff6c8c3d7a1d6c806820ce ./etc/mdadm/mdadm.conf
- --- /proc/modules:
dm_mirror 14616 0 - Live 0xffffffffa0194000
dm_region_hash 12704 1 dm_mirror, Live 0xffffffffa018e000
dm_log 9924 2 dm_mirror,dm_region_hash, Live 0xffffffffa0186000
dm_snapshot 22860 0 - Live 0xffffffffa017b000
dm_mod 59224 12 dm_mirror,dm_log,dm_snapshot, Live 0xffffffffa0167000
raid1 21104 1 - Live 0xffffffffa015c000
md_mod 86628 2 raid1, Live 0xffffffffa0141000
- --- /var/log/syslog:
- --- volume detail:
/dev/sda is not recognised by mdadm.
/dev/sda1:
Magic : a92b4efc
Version : 00.90.00
UUID : 73bedc93:4672b810:9eb0d0b7:fd848b7d
Creation Time : Mon Dec 7 13:32:04 2009
Raid Level : raid1
Used Dev Size : 312560576 (298.08 GiB 320.06 GB)
Array Size : 312560576 (298.08 GiB 320.06 GB)
Raid Devices : 3
Total Devices : 3
Preferred Minor : 0
Update Time : Mon Feb 8 21:35:53 2010
State : clean
Active Devices : 3
Working Devices : 3
Failed Devices : 0
Spare Devices : 0
Checksum : a8c14ebb - correct
Events : 11118
Number Major Minor RaidDevice State
this 1 8 1 1 active sync /dev/sda1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 1 1 active sync /dev/sda1
2 2 8 33 2 active sync /dev/sdc1
- --
/dev/sdb is not recognised by mdadm.
/dev/sdb1:
Magic : a92b4efc
Version : 00.90.00
UUID : 73bedc93:4672b810:9eb0d0b7:fd848b7d
Creation Time : Mon Dec 7 13:32:04 2009
Raid Level : raid1
Used Dev Size : 312560576 (298.08 GiB 320.06 GB)
Array Size : 312560576 (298.08 GiB 320.06 GB)
Raid Devices : 3
Total Devices : 3
Preferred Minor : 0
Update Time : Mon Feb 8 21:35:53 2010
State : clean
Active Devices : 3
Working Devices : 3
Failed Devices : 0
Spare Devices : 0
Checksum : a8c14ec9 - correct
Events : 11118
Number Major Minor RaidDevice State
this 0 8 17 0 active sync /dev/sdb1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 1 1 active sync /dev/sda1
2 2 8 33 2 active sync /dev/sdc1
- --
/dev/sdc is not recognised by mdadm.
/dev/sdc1:
Magic : a92b4efc
Version : 00.90.00
UUID : 73bedc93:4672b810:9eb0d0b7:fd848b7d
Creation Time : Mon Dec 7 13:32:04 2009
Raid Level : raid1
Used Dev Size : 312560576 (298.08 GiB 320.06 GB)
Array Size : 312560576 (298.08 GiB 320.06 GB)
Raid Devices : 3
Total Devices : 3
Preferred Minor : 0
Update Time : Mon Feb 8 21:35:53 2010
State : clean
Active Devices : 3
Working Devices : 3
Failed Devices : 0
Spare Devices : 0
Checksum : a8c14edd - correct
Events : 11118
Number Major Minor RaidDevice State
this 2 8 33 2 active sync /dev/sdc1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 1 1 active sync /dev/sda1
2 2 8 33 2 active sync /dev/sdc1
- --
- --- /proc/cmdline
BOOT_IMAGE=/boot/vmlinuz-2.6.30-2-amd64
root=/dev/mapper/lvm0--vol-root ro console=ttyS0,115200 quiet
- --- grub2:
insmod raid
set root=(lvm0-vol-root)
linux /boot/vmlinuz-2.6.30-2-amd64 root=/dev/mapper/lvm0--vol-root ro
console=ttyS0,115200 quiet
insmod raid
set root=(lvm0-vol-root)
linux /boot/vmlinuz-2.6.30-2-amd64 root=/dev/mapper/lvm0--vol-root ro
single console=ttyS0,115200
insmod raid
set root=(lvm0-vol-root)
linux /boot/vmlinuz-2.6.26-2-amd64 root=/dev/mapper/lvm0--vol-root ro
console=ttyS0,115200 quiet
insmod raid
set root=(lvm0-vol-root)
linux /boot/vmlinuz-2.6.26-2-amd64 root=/dev/mapper/lvm0--vol-root ro
single console=ttyS0,115200
- --- udev:
ii udev 0.125-7+lenny3 /dev/ and hotplug management daemon
cd6f5683974ea65603f04ec699b3cff2 /etc/udev/rules.d/65_mdadm.vol_id.rules
- --- /dev:
brw-rw---- 1 root disk 9, 0 2010-01-13 20:57 /dev/md0
/dev/disk/by-id:
total 0
lrwxrwxrwx 1 root root 9 2010-01-13 20:56
ata-WDC_WD3202ABYS-02B7A0_WD-WCAT1E296502 -> ../../sdc
lrwxrwxrwx 1 root root 10 2010-01-13 20:56
ata-WDC_WD3202ABYS-02B7A0_WD-WCAT1E296502-part1 -> ../../sdc1
lrwxrwxrwx 1 root root 9 2010-01-13 20:56
ata-WDC_WD3202ABYS-02B7A0_WD-WCAT1E298345 -> ../../sdb
lrwxrwxrwx 1 root root 10 2010-01-13 20:56
ata-WDC_WD3202ABYS-02B7A0_WD-WCAT1E298345-part1 -> ../../sdb1
lrwxrwxrwx 1 root root 9 2010-01-13 20:56
ata-WDC_WD3202ABYS-02B7A0_WD-WCAT1E314175 -> ../../sda
lrwxrwxrwx 1 root root 10 2010-01-13 20:56
ata-WDC_WD3202ABYS-02B7A0_WD-WCAT1E314175-part1 -> ../../sda1
lrwxrwxrwx 1 root root 9 2010-01-13 20:57
md-uuid-73bedc93:4672b810:9eb0d0b7:fd848b7d -> ../../md0
lrwxrwxrwx 1 root root 9 2010-01-13 20:56
scsi-SATA_WDC_WD3202ABYS-_WD-WCAT1E296502 -> ../../sdc
lrwxrwxrwx 1 root root 10 2010-01-13 20:56
scsi-SATA_WDC_WD3202ABYS-_WD-WCAT1E296502-part1 -> ../../sdc1
lrwxrwxrwx 1 root root 9 2010-01-13 20:56
scsi-SATA_WDC_WD3202ABYS-_WD-WCAT1E298345 -> ../../sdb
lrwxrwxrwx 1 root root 10 2010-01-13 20:56
scsi-SATA_WDC_WD3202ABYS-_WD-WCAT1E298345-part1 -> ../../sdb1
lrwxrwxrwx 1 root root 9 2010-01-13 20:56
scsi-SATA_WDC_WD3202ABYS-_WD-WCAT1E314175 -> ../../sda
lrwxrwxrwx 1 root root 10 2010-01-13 20:56
scsi-SATA_WDC_WD3202ABYS-_WD-WCAT1E314175-part1 -> ../../sda1
/dev/disk/by-path:
total 0
lrwxrwxrwx 1 root root 9 2010-01-13 20:56
pci-0000:00:11.0-scsi-0:0:0:0 -> ../../sda
lrwxrwxrwx 1 root root 10 2010-01-13 20:56
pci-0000:00:11.0-scsi-0:0:0:0-part1 -> ../../sda1
lrwxrwxrwx 1 root root 9 2010-01-13 20:56
pci-0000:00:11.0-scsi-1:0:0:0 -> ../../sdb
lrwxrwxrwx 1 root root 10 2010-01-13 20:56
pci-0000:00:11.0-scsi-1:0:0:0-part1 -> ../../sdb1
lrwxrwxrwx 1 root root 9 2010-01-13 20:56
pci-0000:00:11.0-scsi-2:0:0:0 -> ../../sdc
lrwxrwxrwx 1 root root 10 2010-01-13 20:56
pci-0000:00:11.0-scsi-2:0:0:0-part1 -> ../../sdc1
/dev/md:
total 0
brw-rw---- 1 root disk 9, 0 2010-01-13 20:57 0
- -- System Information:
Debian Release: 5.0.4
APT prefers stable
APT policy: (990, 'stable'), (500, 'unstable'), (500, 'testing')
Architecture: i386 (x86_64)
Kernel: Linux 2.6.30-2-amd64 (SMP w/3 CPU cores)
Locale: LANG=en_GB.UTF-8, LC_CTYPE=en_GB.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/bash
Versions of packages mdadm depends on:
ii debconf 1.5.24 Debian configuration
management sy
ii libc6 2.7-18lenny2 GNU C Library: Shared
libraries
ii lsb-base 3.2-20 Linux Standard Base 3.2
init scrip
ii makedev 2.3.1-88 creates device files in /dev
ii udev 0.125-7+lenny3 /dev/ and hotplug
management daemo
Versions of packages mdadm recommends:
ii module-init-tools 3.4-1 tools for managing Linux
kernel mo
ii postfix [mail-transport-agent 2.5.5-1.1 High-performance mail
transport ag
mdadm suggests no packages.
- -- debconf information:
mdadm/autostart: true
* mdadm/mail_to: root
mdadm/initrdstart_msg_errmd:
* mdadm/initrdstart: all
mdadm/initrdstart_msg_errconf:
mdadm/initrdstart_notinconf: false
mdadm/initrdstart_msg_errexist:
mdadm/initrdstart_msg_intro:
* mdadm/autocheck: true
mdadm/initrdstart_msg_errblock:
* mdadm/start_daemon: true
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iJwEAQECAAYFAktweKsACgkQ1WclBW9j5Hl/tQP+MvMMEJj45pTOitNHHxhHlNRb
JhZZ7dDGUCR8vAu1NU8CRx11lzH6NRjBfWIXHdeTppETsoPT3CJWNE1Qq8BHgjsm
dziQCigbYeKROD08GF1md/33JEqChKNIC/AbiUyaLQ9UU+tAKZD3uKonJu0L+JZ1
6mY60/JuWUZhfvo47bw=
=i+MV
-----END PGP SIGNATURE-----
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: md0-bug.txt
URL: <http://lists.alioth.debian.org/pipermail/pkg-mdadm-devel/attachments/20100208/56bc053f/attachment-0001.txt>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: md0-bug.txt.sig
Type: application/octet-stream
Size: 158 bytes
Desc: not available
URL: <http://lists.alioth.debian.org/pipermail/pkg-mdadm-devel/attachments/20100208/56bc053f/attachment-0001.obj>
More information about the pkg-mdadm-devel
mailing list