Bug#489608: mdadm: similar kernel call traces

Cristian Ionescu-Idbohrn cristian.ionescu-idbohrn at axis.com
Sun Nov 9 15:20:50 UTC 2008


Followup-For: Bug #489608
Package: mdadm
Version: 2.6.7.1-1

I'm seeing similar stuff on md1, md2, md3, md4, md7, md8, md9.
The following occurs on all above named devices, with (probably)
insignificant variations.  I can provide a complete log, should
that be useful.

[119336.747173] INFO: task md9_resync:28395 blocked for more than 120 seconds.
[119336.747177] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[119336.747181] md9_resync    D fac78a13     0 28395      2
[119336.747188]        f771d6e0 00000046 3732352e fac78a13 0000596e f771d86c c2821fa0 00000001
[119336.747204]        00000000 00000003 00000001 00000000 f6dcd60c f6c58200 c2c49f8c f6c587e8
[119336.747218]        f6dcd60c f6c58200 c2c49f8c f6c587e8 f938b6ad f9390e84 f9390e5f f6dcd60c
[119336.747232] Call Trace:
[119336.747288]  [<f938b6ad>] md_do_sync+0x238/0xa84 [md_mod]
[119336.747347]  [<c011eab7>] load_balance_fair+0xb0/0x182
[119336.747366]  [<c0133d8e>] enqueue_hrtimer+0xc9/0xd4
[119336.747390]  [<c0134356>] hrtimer_start+0xf7/0x110
[119336.747415]  [<c011d3d2>] hrtick_set+0x8f/0xd8
[119336.747443]  [<c01318dc>] autoremove_wake_function+0x0/0x2d
[119336.747468]  [<f938dd7c>] md_thread+0x0/0xcd [md_mod]
[119336.747491]  [<f938de33>] md_thread+0xb7/0xcd [md_mod]
[119336.747525]  [<f938dd7c>] md_thread+0x0/0xcd [md_mod]
[119336.747542]  [<c013181b>] kthread+0x38/0x5d
[119336.747549]  [<c01317e3>] kthread+0x0/0x5d
[119336.747558]  [<c01044f3>] kernel_thread_helper+0x7/0x10

[119987.429072] INFO: task md8_resync:28394 blocked for more than 120 seconds.
[119987.429081] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[119987.429088] md8_resync    D 4d5e4f76     0 28394      2
[119987.429098]        f6e54880 00000046 3433322e 4d5e4f76 00005a1f f6e54a0c c2821fa0 00000001
[119987.429117]        c010eef4 c01042d4 00000001 00000000 f6ee2e0c f6c58600 c2cb1f8c f6c58be8
[119987.429138]        f6ee2e0c f6c58600 c2cb1f8c f6c58be8 f938b6ad f9390e84 f9390e5f f6ee2e0c
[119987.429153] Call Trace:
[119987.429191]  [<c010eef4>] smp_reschedule_interrupt+0xc/0x1e
[119987.429204]  [<c01042d4>] reschedule_interrupt+0x28/0x30
[119987.429239]  [<f938b6ad>] md_do_sync+0x238/0xa84 [md_mod]
[119987.429285]  [<c0118eea>] can_migrate_task+0x3b/0x59
[119987.429311]  [<c011eab7>] load_balance_fair+0xb0/0x182
[119987.429348]  [<c011837b>] move_tasks+0x45/0x64
[119987.429375]  [<c010296e>] __switch_to+0xa5/0x125
[119987.429387]  [<c011d3bd>] hrtick_set+0x7a/0xd8
[119987.429409]  [<c01318dc>] autoremove_wake_function+0x0/0x2d
[119987.429430]  [<f938dd7c>] md_thread+0x0/0xcd [md_mod]
[119987.429454]  [<f938de33>] md_thread+0xb7/0xcd [md_mod]
[119987.429489]  [<f938dd7c>] md_thread+0x0/0xcd [md_mod]
[119987.429506]  [<c013181b>] kthread+0x38/0x5d
[119987.433014]  [<c01317e3>] kthread+0x0/0x5d
[119987.433014]  [<c01044f3>] kernel_thread_helper+0x7/0x10

-- Package-specific info:
--- mount output
/dev/md0 on / type reiserfs (rw,notail)
tmpfs on /lib/init/rw type tmpfs (rw,nosuid,mode=0755)
proc on /proc type proc (rw,noexec,nosuid,nodev)
sysfs on /sys type sysfs (rw,noexec,nosuid,nodev)
procbususb on /proc/bus/usb type usbfs (rw)
udev on /dev type tmpfs (rw,mode=0755)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev,size=33554432)
devpts on /dev/pts type devpts (rw,noexec,nosuid,gid=5,mode=620)
fusectl on /sys/fs/fuse/connections type fusectl (rw)
/dev/md2 on /tmp type reiserfs (rw)
/dev/md3 on /var type reiserfs (rw)
/dev/md4 on /usr type reiserfs (rw)
/dev/md5 on /usr/src type reiserfs (rw)
/dev/md6 on /usr/local type reiserfs (rw)
/dev/md7 on /opt type reiserfs (rw)
/dev/md8 on /home type reiserfs (rw)
/dev/md9 on /data type reiserfs (rw)

--- mdadm.conf
# mdadm.conf
#
# Please refer to mdadm.conf(5) for information about this file.
#

# by default, scan all partitions (/proc/partitions) for MD superblocks.
# alternatively, specify devices to scan, using wildcards if desired.
DEVICE partitions

# auto-create devices with Debian standard permissions
CREATE owner=root group=disk mode=0660 auto=yes

# automatically tag new arrays as belonging to the local system
HOMEHOST <system>

# instruct the monitoring daemon where to send mail alerts
MAILADDR root

# definitions of existing MD arrays
ARRAY /dev/md0 level=raid1 num-devices=2 UUID=a22e8b23:e33010ae:1b789cb8:f0e59097
ARRAY /dev/md1 level=raid1 num-devices=2 UUID=e28345e7:cf40379b:3407727f:ebf0f0b0
ARRAY /dev/md2 level=raid1 num-devices=2 UUID=6f701daa:b57eb876:ff3b7856:d4d90ad9
ARRAY /dev/md3 level=raid1 num-devices=2 UUID=e5ffa444:faefb7e9:50c99164:e968e706
ARRAY /dev/md4 level=raid1 num-devices=2 UUID=e096f650:60604e58:166a937a:fad38aca
ARRAY /dev/md5 level=raid1 num-devices=2 UUID=6b146f31:bafbff26:d7214dde:aeee3db7
ARRAY /dev/md6 level=raid1 num-devices=2 UUID=9daa9f59:86c02785:19553a1e:921899f7
ARRAY /dev/md7 level=raid1 num-devices=2 UUID=009e26e4:0211bffd:5cfa0948:9d57b2b1
ARRAY /dev/md8 level=raid1 num-devices=2 UUID=38e785e5:81fccc87:94a5ab19:f874eae1
ARRAY /dev/md9 level=raid1 num-devices=2 UUID=b83c5142:53b42a66:dcd42906:16b92873


--- /proc/mdstat:
Personalities : [raid1]
md9 : active raid1 sda12[0] sdb12[1]
      78132032 blocks [2/2] [UU]

md8 : active raid1 sda11[0] sdb11[1]
      39061952 blocks [2/2] [UU]

md7 : active raid1 sda10[0] sdb10[1]
      5855552 blocks [2/2] [UU]

md6 : active raid1 sda9[0] sdb9[1]
      5855552 blocks [2/2] [UU]

md5 : active raid1 sda8[0] sdb8[1]
      5855552 blocks [2/2] [UU]

md4 : active raid1 sda7[0] sdb7[1]
      5855552 blocks [2/2] [UU]

md3 : active raid1 sda6[0] sdb6[1]
      3903680 blocks [2/2] [UU]

md2 : active raid1 sda5[0] sdb5[1]
      1951744 blocks [2/2] [UU]

md1 : active raid1 sda2[0] sdb2[1]
      1951808 blocks [2/2] [UU]

md0 : active raid1 sda1[0] sdb1[1]
      979840 blocks [2/2] [UU]

unused devices: <none>

--- /proc/partitions:
major minor  #blocks  name

   8     0  293036184 sda
   8     1     979933 sda1
   8     2    1951897 sda2
   8     3          1 sda3
   8     5    1951866 sda5
   8     6    3903763 sda6
   8     7    5855661 sda7
   8     8    5855661 sda8
   8     9    5855661 sda9
   8    10    5855661 sda10
   8    11   39062016 sda11
   8    12   78132096 sda12
   8    16  293036184 sdb
   8    17     979933 sdb1
   8    18    1951897 sdb2
   8    19          1 sdb3
   8    21    1951866 sdb5
   8    22    3903763 sdb6
   8    23    5855661 sdb7
   8    24    5855661 sdb8
   8    25    5855661 sdb9
   8    26    5855661 sdb10
   8    27   39062016 sdb11
   8    28   78132096 sdb12
   9     0     979840 md0
   9     1    1951808 md1
   9     2    1951744 md2
   9     3    3903680 md3
   9     4    5855552 md4
   9     5    5855552 md5
   9     6    5855552 md6
   9     7    5855552 md7
   9     8   39061952 md8
   9     9   78132032 md9

--- initrd.img-2.6.26-1-686:

--- /proc/modules:
dm_crypt 11172 0 - Live 0xf95ec000
crypto_blkcipher 15236 1 dm_crypt, Live 0xf94ec000
dm_mirror 15104 0 - Live 0xf9373000
dm_log 8452 1 dm_mirror, Live 0xf8856000
dm_snapshot 14340 0 - Live 0xf936e000
dm_mod 46184 4 dm_crypt,dm_mirror,dm_log,dm_snapshot, Live 0xf9398000
raid1 18016 10 - Live 0xf92fa000
md_mod 67036 11 raid1, Live 0xf9386000

--- volume detail:

--- /proc/cmdline
root=/dev/md0 ro vga=795

--- grub:
kernel		/boot/vmlinuz-2.6.26-1-686 root=/dev/md0 ro vga=795
kernel		/boot/vmlinuz-2.6.26-1-686 root=/dev/md0 ro vga=795 single


-- System Information:
Debian Release: lenny/sid
  APT prefers unstable
  APT policy: (500, 'unstable'), (500, 'testing')
Architecture: i386 (i686)

Kernel: Linux 2.6.26-1-686 (SMP w/2 CPU cores)
Locale: LANG=C, LC_CTYPE= (charmap=ANSI_X3.4-1968)
Shell: /bin/sh linked to /bin/bash

Versions of packages mdadm depends on:
ii  debconf                       1.5.24     Debian configuration management sy
ii  libc6                         2.7-16     GNU C Library: Shared libraries
ii  lsb-base                      3.2-20     Linux Standard Base 3.2 init scrip
ii  makedev                       2.3.1-88   creates device files in /dev
ii  udev                          0.125-7    /dev/ and hotplug management daemo

Versions of packages mdadm recommends:
ii  module-init-tools             3.4-1      tools for managing Linux kernel mo
ii  postfix [mail-transport-agent 2.5.5-1.1  High-performance mail transport ag

mdadm suggests no packages.

-- debconf information:
* mdadm/autostart: true
* mdadm/initrdstart: /dev/md0
  mdadm/initrdstart_notinconf: false
  mdadm/initrdstart_msg_errexist:
  mdadm/initrdstart_msg_intro:
  mdadm/initrdstart_msg_errblock:
  mdadm/warning:
* mdadm/start_daemon: true
* mdadm/mail_to: root
  mdadm/initrdstart_msg_errmd:
  mdadm/initrdstart_msg_errconf:
* mdadm/autocheck: true


Cheers,

-- 
Cristian





More information about the pkg-mdadm-devel mailing list