[Pkg-ganeti-devel] Bug#801924: ganeti: livelock with shared-file-storage on nfs
Richard Kojedzinszky
krichy at tvnetwork.hu
Fri Oct 16 07:24:42 UTC 2015
Package: ganeti
Version: 2.12.4-1~deb8u1
Severity: important
-- Package-specific info:
Version symlinks:
/etc/ganeti/share -> /usr/share/ganeti/2.12
/etc/ganeti/lib -> /usr/lib/ganeti/2.12
Cluster config version: 2.12.4
Address family: IPv4
Enabled hypervisors: xen-pvm xen-hvm
xen-pvm hypervisor parameters:
blockdev_prefix=sd
bootloader_path=/usr/lib/xen-4.4/bin/pygrub
cpu_cap=0
cpu_mask=all
cpu_weight=256
kernel_args=ro
kernel_path=/boot/vmlinuz-3.16.0-4-amd64
migration_mode=live
migration_port=8002
reboot_behavior=reboot
use_bootloader=True
xen_cmd=xl
xen-hvm hypervisor parameters:
acpi=True
blockdev_prefix=hd
boot_order=cd
cpu_cap=0
cpu_mask=all
cpu_weight=256
device_model=/usr/bin/qemu-system-x86_64
disk_type=paravirtual
kernel_path=/usr/lib/xen-4.4/boot/hvmloader
migration_mode=non-live
migration_port=8002
nic_type=rtl8139
pae=True
reboot_behavior=reboot
use_localtime=False
vif_type=ioemu
viridian=False
vnc_bind_address=0.0.0.0
vnc_password_file=/etc/ganeti/vnc-cluster-password
xen_cmd=xl
-- System Information:
Debian Release: 8.2
APT prefers stable-updates
APT policy: (500, 'stable-updates'), (500, 'stable')
Architecture: amd64 (x86_64)
Kernel: Linux 3.16.0-4-amd64 (SMP w/8 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)
Versions of packages ganeti depends on:
ii adduser 3.113+nmu3
ii ganeti-2.12 2.12.4-1~deb8u1
ii ganeti-haskell-2.12 2.12.4-1~deb8u1
ii ganeti-htools-2.12 2.12.4-1~deb8u1
ii python 2.7.9-1
Versions of packages ganeti recommends:
ii drbd-utils 8.9.2~rc1-2
ii ganeti-instance-debootstrap 0.14-2
ii ndisc6 1.0.1-1+b1
ii xen-linux-system-amd64 3.16+63
Versions of packages ganeti suggests:
pn blktap-dkms <none>
pn ganeti-doc <none>
pn molly-guard <none>
-- no debconf information
Dear users,
We have a ganeti/xen cluster set up with shared file storage, the nfs
server is a freenas server.
It has happend the second time that vm's hosted on the shared file storage
got blocked:
Sep 29 05:50:49 node-5 kernel: [564977.898152] INFO: task
qemu-system-i38:8138 blocked for more than 120 seconds.
Sep 29 05:50:49 node-5 kernel: [564977.898178] Not tainted
3.16.0-4-amd64 #1
Sep 29 05:50:49 node-5 kernel: [564977.898192] "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 29 05:50:49 node-5 kernel: [564977.898212] qemu-system-i38 D
ffff88002339cfb8 0 8138 1 0x00000000
Sep 29 05:50:49 node-5 kernel: [564977.898216] ffff88002339cb60
0000000000000286 0000000000012f00 ffff88001adabfd8
Sep 29 05:50:49 node-5 kernel: [564977.898220] 0000000000012f00
ffff88002339cb60 ffff88002ae61c08 ffff88001adabdf0
Sep 29 05:50:49 node-5 kernel: [564977.898223] ffff88002ae61c0c
ffff88002339cb60 00000000ffffffff ffff88002ae61c10
Sep 29 05:50:49 node-5 kernel: [564977.898226] Call Trace:
Sep 29 05:50:49 node-5 kernel: [564977.898238] [<ffffffff8150e225>] ?
schedule_preempt_disabled+0x25/0x70
Sep 29 05:50:49 node-5 kernel: [564977.898241] [<ffffffff8150fcd3>] ?
__mutex_lock_slowpath+0xd3/0x1c0
Sep 29 05:50:49 node-5 kernel: [564977.898243] [<ffffffff8150fddb>] ?
mutex_lock+0x1b/0x2a
Sep 29 05:50:49 node-5 kernel: [564977.898247] [<ffffffff8113ef0e>] ?
generic_file_write_iter+0x2e/0xa0
Sep 29 05:50:49 node-5 kernel: [564977.898256] [<ffffffffa054e9d3>] ?
nfs_file_write+0x83/0x1a0 [nfs]
Sep 29 05:50:49 node-5 kernel: [564977.898260] [<ffffffff811a7ad4>] ?
new_sync_write+0x74/0xa0
Sep 29 05:50:49 node-5 kernel: [564977.898263] [<ffffffff811a8212>] ?
vfs_write+0xb2/0x1f0
Sep 29 05:50:49 node-5 kernel: [564977.898267] [<ffffffff810d469e>] ?
SyS_futex+0x6e/0x150
Sep 29 05:50:49 node-5 kernel: [564977.898269] [<ffffffff811a8eb3>] ?
SyS_pwrite64+0x63/0xa0
Sep 29 05:50:49 node-5 kernel: [564977.898272] [<ffffffff8151164d>] ?
system_call_fast_compare_end+0x10/0x15
Sep 29 05:50:49 node-5 kernel: [564977.898274] INFO: task
qemu-system-i38:8142 blocked for more than 120 seconds.
Sep 29 05:50:49 node-5 kernel: [564977.898290] Not tainted
3.16.0-4-amd64 #1
Sep 29 05:50:49 node-5 kernel: [564977.898302] "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 29 05:50:49 node-5 kernel: [564977.898319] qemu-system-i38 D
ffff880018f69808 0 8142 1 0x00000000
Sep 29 05:50:49 node-5 kernel: [564977.898321] ffff880018f693b0
0000000000000286 0000000000012f00 ffff880006ce7fd8
Sep 29 05:50:49 node-5 kernel: [564977.898323] 0000000000012f00
ffff880018f693b0 ffff88002ae61c08 ffff880006ce7df0
Sep 29 05:50:49 node-5 kernel: [564977.898325] ffff88002ae61c0c
ffff880018f693b0 00000000ffffffff ffff88002ae61c10
Sep 29 05:50:49 node-5 kernel: [564977.898327] Call Trace:
Sep 29 05:50:49 node-5 kernel: [564977.898329] [<ffffffff8150e225>] ?
schedule_preempt_disabled+0x25/0x70
Sep 29 05:50:49 node-5 kernel: [564977.898331] [<ffffffff8150fcd3>] ?
__mutex_lock_slowpath+0xd3/0x1c0
Sep 29 05:50:49 node-5 kernel: [564977.898333] [<ffffffff8150fddb>] ?
mutex_lock+0x1b/0x2a
Sep 29 05:50:49 node-5 kernel: [564977.898335] [<ffffffff8113ef0e>] ?
generic_file_write_iter+0x2e/0xa0
Sep 29 05:50:49 node-5 kernel: [564977.898340] [<ffffffffa054e9d3>] ?
nfs_file_write+0x83/0x1a0 [nfs]
Sep 29 05:50:49 node-5 kernel: [564977.898342] [<ffffffff811a7ad4>] ?
new_sync_write+0x74/0xa0
Sep 29 05:50:49 node-5 kernel: [564977.898345] [<ffffffff811a8212>] ?
vfs_write+0xb2/0x1f0
Sep 29 05:50:49 node-5 kernel: [564977.898346] [<ffffffff811a8eb3>] ?
SyS_pwrite64+0x63/0xa0
Sep 29 05:50:49 node-5 kernel: [564977.898349] [<ffffffff8151164d>] ?
system_call_fast_compare_end+0x10/0x15
Sep 29 05:50:49 node-5 kernel: [564977.898350] INFO: task
qemu-system-i38:8143 blocked for more than 120 seconds.
Sep 29 05:50:49 node-5 kernel: [564977.898367] Not tainted
3.16.0-4-amd64 #1
Sep 29 05:50:49 node-5 kernel: [564977.898378] "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
Sep 29 05:50:49 node-5 kernel: [564977.898395] qemu-system-i38 D
ffff880024e31908 0 8143 1 0x00000000
Sep 29 05:50:49 node-5 kernel: [564977.898397] ffff880024e314b0
0000000000000286 0000000000012f00 ffff880006c47fd8
Sep 29 05:50:49 node-5 kernel: [564977.898399] 0000000000012f00
ffff880024e314b0 ffff88002ae61c08 ffff880006c47d40
Sep 29 05:50:49 node-5 kernel: [564977.898401] ffff88002ae61c0c
ffff880024e314b0 00000000ffffffff ffff88002ae61c10
Sep 29 05:50:49 node-5 kernel: [564977.898403] Call Trace:
Sep 29 05:50:49 node-5 kernel: [564977.898405] [<ffffffff8150e225>] ?
schedule_preempt_disabled+0x25/0x70
Sep 29 05:50:49 node-5 kernel: [564977.898407] [<ffffffff8150fcd3>] ?
__mutex_lock_slowpath+0xd3/0x1c0
Sep 29 05:50:49 node-5 kernel: [564977.898409] [<ffffffff8150fddb>] ?
mutex_lock+0x1b/0x2a
Sep 29 05:50:49 node-5 kernel: [564977.898411] [<ffffffff8113ef0e>] ?
generic_file_write_iter+0x2e/0xa0
Sep 29 05:50:49 node-5 kernel: [564977.898415] [<ffffffffa054e9d3>] ?
nfs_file_write+0x83/0x1a0 [nfs]
Sep 29 05:50:49 node-5 kernel: [564977.898418] [<ffffffff811a7a60>] ?
new_sync_read+0xa0/0xa0
Sep 29 05:50:49 node-5 kernel: [564977.898420] [<ffffffff811a7b5f>] ?
do_iter_readv_writev+0x5f/0x90
....
The nfs server was alive, as 6 other nodes in the cluster was working
well. Also I could access the mounted share on the local machine, I could
list directories, and also was able to copy files from the share. The
strange was that copying a file from the share to /tmp was really _slow_,
at around 128k/sec. But neither the local disks neither the nfs server was
under load. Packet captures on the ethernet interface showed no nfs
traffic, while the destination file in /tmp/ was just growing very slowly.
This means to me that the nfs read command was fast, was finished in time,
but somewhere in the kernel processing that reply was blocked or slowed
somehow.
Writing to the nfs share failed, an
# echo asd > /srv/ganeti/shared-file-storage/qwe
got blocked. The file has been actually created, I suspect that the close (sync) operation got blocked.
As the vm's were blocked, I decided to move (failover) the running
instances to another node, and keep this node running for later debugging.
I killed one instance with 'xl destroy' and then did a 'ganeti-instance
failover' on it, and after all I've noticed that all vm's have recovered,
the block on io has disappeared.
Now I dont know if I chose another vm to kill/move, would I get the
same results, would the deadlock/livelock disappear also.
Actually I cannot reproduce the problem, I am just waiting to happen it
again and collect more information.
The node is a very minimal debian/jessie, with ganeti and xen installed.
Has someone else experienced such issues?
-------------- next part --------------
[1960741.273054] [<ffffffff811a90bb>] ? do_readv_writev+0xbb/0x240
[1960741.273058] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.273063] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.273065] [<ffffffff81094215>] ? check_preempt_curr+0x75/0xa0
[1960741.273067] [<ffffffff81096c6a>] ? wake_up_new_task+0xda/0x160
[1960741.273068] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.273071] [<ffffffff810669c2>] ? do_fork+0x152/0x390
[1960741.273074] [<ffffffff81009f2c>] ? xen_clocksource_get_cycles+0x1c/0x20
[1960741.273076] [<ffffffff810c7754>] ? __getnstimeofday+0x34/0xc0
[1960741.273078] [<ffffffff811a95d9>] ? SyS_pwritev+0x99/0xc0
[1960741.273081] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.273082] qemu-system-i38 D
[1960741.273084] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.273084] ffff880032527708
[1960741.273085] 0 6937 1 0x00000000
[1960741.273087] ffff8800325272b0 0000000000000286 0000000000012f00 ffff88001e81bfd8
[1960741.273091] 0000000000012f00 ffff8800325272b0 ffff88002b291c48 ffff88001e81bd40
[1960741.273093] ffff88002b291c4c ffff8800325272b0 00000000ffffffff ffff88002b291c50
[1960741.273095] Call Trace:
[1960741.273098] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.273100] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.273102] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.273104] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.273105] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.273110] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.273113] [<ffffffff811a7a60>] ? new_sync_read+0xa0/0xa0
[1960741.273115] [<ffffffff811a7b5f>] ? do_iter_readv_writev+0x5f/0x90
[1960741.273117] [<ffffffff811a90bb>] ? do_readv_writev+0xbb/0x240
[1960741.273122] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.273123] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.273128] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.273131] [<ffffffff81009f2c>] ? xen_clocksource_get_cycles+0x1c/0x20
[1960741.273133] [<ffffffff810c7754>] ? __getnstimeofday+0x34/0xc0
[1960741.273135] [<ffffffff811a95d9>] ? SyS_pwritev+0x99/0xc0
[1960741.273136] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.273139] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.273141] qemu-system-i38 D ffff88004694e468 0 6938 1 0x00000000
[1960741.273143] ffff88004694e010 0000000000000286 0000000000012f00 ffff880017a63fd8
[1960741.273145] 0000000000012f00 ffff88004694e010 ffff88002b291c48
[1960741.273151] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.273154] ffff880017a63d40
[1960741.273156] ffff88002b291c4c ffff88004694e010 00000000ffffffff ffff88002b291c50
[1960741.273172] Call Trace:
[1960741.273181] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.273190] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.273199] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.273208] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.273219] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.273229] [<ffffffff811a7a60>] ? new_sync_read+0xa0/0xa0
[1960741.273240] [<ffffffff811a7b5f>] ? do_iter_readv_writev+0x5f/0x90
[1960741.273248] [<ffffffff811a90bb>] ? do_readv_writev+0xbb/0x240
[1960741.273259] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.273265] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.273267] [<ffffffff810669c2>] ? do_fork+0x152/0x390
[1960741.273269] [<ffffffff81009f2c>] ? xen_clocksource_get_cycles+0x1c/0x20
[1960741.273272] [<ffffffff810c7754>] ? __getnstimeofday+0x34/0xc0
[1960741.273274] [<ffffffff811a95d9>] ? SyS_pwritev+0x99/0xc0
[1960741.273276] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.273278] qemu-system-i38 D ffff8800300b6668 0 6939 1 0x00000000
[1960741.273280] ffff8800300b6210 0000000000000286 0000000000012f00 ffff8800054e3fd8
[1960741.273282] 0000000000012f00 ffff8800300b6210 ffff88002b291c48 ffff8800054e3df0
[1960741.273283] ffff88002b291c4c ffff8800300b6210 00000000ffffffff ffff88002b291c50
[1960741.273285] Call Trace:
[1960741.273287] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.273289] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.273291] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.273294] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.273298] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.273300] [<ffffffff811a7ad4>] ? new_sync_write+0x74/0xa0
[1960741.273303] [<ffffffff811a8212>] ? vfs_write+0xb2/0x1f0
[1960741.273305] [<ffffffff811a8eb3>] ? SyS_pwrite64+0x63/0xa0
[1960741.273307] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.273309] qemu-system-i38 D ffff8800000719c8 0 6940 1 0x00000000
[1960741.273311] ffff880000071570 0000000000000286 0000000000012f00 ffff880042667fd8
[1960741.273313] 0000000000012f00 ffff880000071570 ffff88002b291c48 ffff880042667d40
[1960741.273314] ffff88002b291c4c ffff880000071570 00000000ffffffff ffff88002b291c50
[1960741.273316] Call Trace:
[1960741.273318] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.273320] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.273322] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.273325] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.273329] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.273332] [<ffffffff811a7a60>] ? new_sync_read+0xa0/0xa0
[1960741.273334] [<ffffffff811a7b5f>] ? do_iter_readv_writev+0x5f/0x90
[1960741.273336] [<ffffffff811a90bb>] ? do_readv_writev+0xbb/0x240
[1960741.273340] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.273344] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.273346] [<ffffffff81094215>] ? check_preempt_curr+0x75/0xa0
[1960741.273348] [<ffffffff81096c6a>] ? wake_up_new_task+0xda/0x160
[1960741.273351] [<ffffffff810669c2>] ? do_fork+0x152/0x390
[1960741.273353] [<ffffffff81009f2c>] ? xen_clocksource_get_cycles+0x1c/0x20
[1960741.273356] [<ffffffff810c7754>] ? __getnstimeofday+0x34/0xc0
[1960741.273357] [<ffffffff811a95d9>] ? SyS_pwritev+0x99/0xc0
[1960741.273360] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.273361] qemu-system-i38 D ffff880042f4eff8 0 6941 1 0x00000000
[1960741.273363] ffff880042f4eba0 0000000000000286 0000000000012f00 ffff880017b9bfd8
[1960741.273365] 0000000000012f00 ffff880042f4eba0 ffff88002b291c48 ffff880017b9bdf0
[1960741.273367] ffff88002b291c4c ffff880042f4eba0 00000000ffffffff ffff88002b291c50
[1960741.273369] Call Trace:
[1960741.273371] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.273373] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.273375] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.273377] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.273382] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.273384] [<ffffffff811a7ad4>] ? new_sync_write+0x74/0xa0
[1960741.273387] [<ffffffff811a8212>] ? vfs_write+0xb2/0x1f0
[1960741.273388] [<ffffffff811a8eb3>] ? SyS_pwrite64+0x63/0xa0
[1960741.273391] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.273392] qemu-system-i38 D ffff88001e9d86a8 0 6942 1 0x00000000
[1960741.273394] ffff88001e9d8250 0000000000000286 0000000000012f00 ffff8800300affd8
[1960741.273396] 0000000000012f00 ffff88001e9d8250 ffff88002b291c48 ffff8800300afdf0
[1960741.273398] ffff88002b291c4c ffff88001e9d8250 00000000ffffffff ffff88002b291c50
[1960741.273400] Call Trace:
[1960741.273402] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.273404] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.273406] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.273408] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.273413] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.273415] [<ffffffff811a7ad4>] ? new_sync_write+0x74/0xa0
[1960741.273417] [<ffffffff811a8212>] ? vfs_write+0xb2/0x1f0
[1960741.273419] [<ffffffff811a8eb3>] ? SyS_pwrite64+0x63/0xa0
[1960741.273422] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.273423] qemu-system-i38 D ffff88002539f7c8 0 6943 1 0x00000000
[1960741.273425] ffff88002539f370 0000000000000286 0000000000012f00 ffff88001b28ffd8
[1960741.273427] 0000000000012f00 ffff88002539f370 ffff88002b291c48 ffff88001b28fdf0
[1960741.273429] ffff88002b291c4c ffff88002539f370 00000000ffffffff ffff88002b291c50
[1960741.273431] Call Trace:
[1960741.273433] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.273438] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.273447] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.273456] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.273466] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.273476] [<ffffffff811a7ad4>] ? new_sync_write+0x74/0xa0
[1960741.273484] [<ffffffff811a8212>] ? vfs_write+0xb2/0x1f0
[1960741.273493] [<ffffffff811a8eb3>] ? SyS_pwrite64+0x63/0xa0
[1960741.273502] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.273507] qemu-system-i38 D ffff880024474eb8 0 6944 1 0x00000000
[1960741.273518] ffff880024474a60 0000000000000286 0000000000012f00 ffff880014763fd8
[1960741.273534] 0000000000012f00 ffff880024474a60 ffff88002b291c48 ffff880014763d40
[1960741.273539] ffff88002b291c4c ffff880024474a60 00000000ffffffff ffff88002b291c50
[1960741.273541] Call Trace:
[1960741.273543] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.273545] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.273547] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.273550] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.273554] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.273556] [<ffffffff811a7a60>] ? new_sync_read+0xa0/0xa0
[1960741.273559] [<ffffffff811a7b5f>] ? do_iter_readv_writev+0x5f/0x90
[1960741.273561] [<ffffffff811a90bb>] ? do_readv_writev+0xbb/0x240
[1960741.273565] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.273570] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.273571] [<ffffffff81094215>] ? check_preempt_curr+0x75/0xa0
[1960741.273574] [<ffffffff81096c6a>] ? wake_up_new_task+0xda/0x160
[1960741.273576] [<ffffffff810669c2>] ? do_fork+0x152/0x390
[1960741.273578] [<ffffffff81009f2c>] ? xen_clocksource_get_cycles+0x1c/0x20
[1960741.273581] [<ffffffff810c7754>] ? __getnstimeofday+0x34/0xc0
[1960741.273582] [<ffffffff811a95d9>] ? SyS_pwritev+0x99/0xc0
[1960741.273585] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.273586] qemu-system-i38 D ffff8800146cd988 0 6945 1 0x00000000
[1960741.273588] ffff8800146cd530 0000000000000286 0000000000012f00 ffff880014787fd8
[1960741.273590] 0000000000012f00 ffff8800146cd530 ffff88002b291c48 ffff880014787df0
[1960741.273592] ffff88002b291c4c ffff8800146cd530 00000000ffffffff ffff88002b291c50
[1960741.273594] Call Trace:
[1960741.273596] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.273598] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.273600] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.273602] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.273607] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.273609] [<ffffffff811a7ad4>] ? new_sync_write+0x74/0xa0
[1960741.273612] [<ffffffff811a8212>] ? vfs_write+0xb2/0x1f0
[1960741.273614] [<ffffffff811a8eb3>] ? SyS_pwrite64+0x63/0xa0
[1960741.273616] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.273618] qemu-system-i38 D ffff880033d52fb8 0 6946 1 0x00000000
[1960741.273621] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.273622] ffff880033d52b60 0000000000000286 0000000000012f00 ffff88002fdaffd8
[1960741.273624] 0000000000012f00 ffff880033d52b60 ffff88002b291c48 ffff88002fdafdf0
[1960741.273626] ffff88002b291c4c ffff880033d52b60 00000000ffffffff ffff88002b291c50
[1960741.273628] Call Trace:
[1960741.273630] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.273632] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.273634] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.273635] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.273638] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.273643] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.273645] [<ffffffff811a7ad4>] ? new_sync_write+0x74/0xa0
[1960741.273648] [<ffffffff811a8212>] ? vfs_write+0xb2/0x1f0
[1960741.273650] [<ffffffff811a8eb3>] ? SyS_pwrite64+0x63/0xa0
[1960741.273651] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.273654] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.273656] qemu-system-i38 D ffff880033e7d708 0 6947 1 0x00000000
[1960741.273658] ffff880033e7d2b0 0000000000000286 0000000000012f00 ffff8800303dffd8
[1960741.273660] 0000000000012f00 ffff880033e7d2b0 ffff88002b291c48 ffff8800303dfd40
[1960741.273662] ffff88002b291c4c ffff880033e7d2b0 00000000ffffffff ffff88002b291c50
[1960741.273664] Call Trace:
[1960741.273666] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.273667] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.273670] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.273672] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.273674] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.273679] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.273681] [<ffffffff811a7a60>] ? new_sync_read+0xa0/0xa0
[1960741.273683] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.273686] [<ffffffff811a7b5f>] ? do_iter_readv_writev+0x5f/0x90
[1960741.273688] [<ffffffff811a90bb>] ? do_readv_writev+0xbb/0x240
[1960741.273692] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.273697] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.273699] [<ffffffff81094215>] ? check_preempt_curr+0x75/0xa0
[1960741.273700] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.273702] [<ffffffff81096c6a>] ? wake_up_new_task+0xda/0x160
[1960741.273705] [<ffffffff810669c2>] ? do_fork+0x152/0x390
[1960741.273707] [<ffffffff81009f2c>] ? xen_clocksource_get_cycles+0x1c/0x20
[1960741.273710] [<ffffffff810c7754>] ? __getnstimeofday+0x34/0xc0
[1960741.273712] [<ffffffff811a95d9>] ? SyS_pwritev+0x99/0xc0
[1960741.273714] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.273715] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.273717] qemu-system-i38 D ffff88002fee6f38 0 6948 1 0x00000000
[1960741.273719] ffff88002fee6ae0 0000000000000286 0000000000012f00 ffff88003027ffd8
[1960741.273721] 0000000000012f00 ffff88002fee6ae0 ffff88002b291c48 ffff88003027fd40
[1960741.273730] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.273732] ffff88002b291c4c ffff88002fee6ae0 00000000ffffffff ffff88002b291c50
[1960741.273746] Call Trace:
[1960741.273754] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.273756] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.273761] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.273765] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.273775] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.273786] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.273796] [<ffffffff811a7a60>] ? new_sync_read+0xa0/0xa0
[1960741.273805] [<ffffffff811a7b5f>] ? do_iter_readv_writev+0x5f/0x90
[1960741.273814] [<ffffffff811a90bb>] ? do_readv_writev+0xbb/0x240
[1960741.273827] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.273838] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.273847] [<ffffffff81009f2c>] ? xen_clocksource_get_cycles+0x1c/0x20
[1960741.273851] [<ffffffff810c7754>] ? __getnstimeofday+0x34/0xc0
[1960741.273853] [<ffffffff811a95d9>] ? SyS_pwritev+0x99/0xc0
[1960741.273856] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.273857] qemu-system-i38 D ffff8800146cc6e8 0 6949 1 0x00000000
[1960741.273859] ffff8800146cc290 0000000000000286 0000000000012f00 ffff8800303c7fd8
[1960741.273861] 0000000000012f00 ffff8800146cc290 ffff88002b291c48 ffff8800303c7d40
[1960741.273863] ffff88002b291c4c ffff8800146cc290 00000000ffffffff ffff88002b291c50
[1960741.273865] Call Trace:
[1960741.273867] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.273869] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.273871] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.273873] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.273878] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.273880] [<ffffffff811a7a60>] ? new_sync_read+0xa0/0xa0
[1960741.273882] [<ffffffff811a7b5f>] ? do_iter_readv_writev+0x5f/0x90
[1960741.273884] [<ffffffff811a90bb>] ? do_readv_writev+0xbb/0x240
[1960741.273889] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.273893] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.273895] [<ffffffff81004d12>] ? xen_mc_flush+0x172/0x1a0
[1960741.273898] [<ffffffff81009f2c>] ? xen_clocksource_get_cycles+0x1c/0x20
[1960741.273900] [<ffffffff810c7754>] ? __getnstimeofday+0x34/0xc0
[1960741.273902] [<ffffffff811a95d9>] ? SyS_pwritev+0x99/0xc0
[1960741.273904] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.273906] qemu-system-i38 D ffff880032749a88 0 6952 1 0x00000000
[1960741.273908] ffff880032749630 0000000000000286 0000000000012f00 ffff880005ee7fd8
[1960741.273910] 0000000000012f00 ffff880032749630 ffff88002b291c48 ffff880005ee7df0
[1960741.273911] ffff88002b291c4c ffff880032749630 00000000ffffffff ffff88002b291c50
[1960741.273913] Call Trace:
[1960741.273915] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.273917] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.273919] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.273922] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.273926] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.273928] [<ffffffff811a7ad4>] ? new_sync_write+0x74/0xa0
[1960741.273931] [<ffffffff811a8212>] ? vfs_write+0xb2/0x1f0
[1960741.273933] [<ffffffff811a8eb3>] ? SyS_pwrite64+0x63/0xa0
[1960741.273935] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.273936] qemu-system-i38 D ffff880010a76ff8 0 6953 1 0x00000000
[1960741.273938] ffff880010a76ba0 0000000000000286 0000000000012f00 ffff880010a07fd8
[1960741.273940] 0000000000012f00 ffff880010a76ba0 ffff88002b291c48 ffff880010a07df0
[1960741.273942] ffff88002b291c4c ffff880010a76ba0 00000000ffffffff ffff88002b291c50
[1960741.273944] Call Trace:
[1960741.273946] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.273948] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.273950] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.273952] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.273957] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.273959] [<ffffffff811a7ad4>] ? new_sync_write+0x74/0xa0
[1960741.273962] [<ffffffff811a8212>] ? vfs_write+0xb2/0x1f0
[1960741.273964] [<ffffffff811a8eb3>] ? SyS_pwrite64+0x63/0xa0
[1960741.273966] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.273967] qemu-system-i38 D ffff8800301b6f38 0 6954 1 0x00000000
[1960741.273969] ffff8800301b6ae0 0000000000000286 0000000000012f00 ffff880005f73fd8
[1960741.273971] 0000000000012f00 ffff8800301b6ae0 ffff88002b291c48 ffff880005f73d40
[1960741.273973] ffff88002b291c4c ffff8800301b6ae0 00000000ffffffff ffff88002b291c50
[1960741.273975] Call Trace:
[1960741.273977] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.273979] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.273981] [<ffffffff812b304a>] ? number.isra.2+0x31a/0x350
[1960741.273983] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.273999] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.274004] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.274006] [<ffffffff811a7a60>] ? new_sync_read+0xa0/0xa0
[1960741.274009] [<ffffffff811a7b5f>] ? do_iter_readv_writev+0x5f/0x90
[1960741.274011] [<ffffffff811a90bb>] ? do_readv_writev+0xbb/0x240
[1960741.274015] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.274019] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.274022] [<ffffffff810669c2>] ? do_fork+0x152/0x390
[1960741.274024] [<ffffffff81009f2c>] ? xen_clocksource_get_cycles+0x1c/0x20
[1960741.274027] [<ffffffff810c7754>] ? __getnstimeofday+0x34/0xc0
[1960741.274029] [<ffffffff811a95d9>] ? SyS_pwritev+0x99/0xc0
[1960741.274031] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.274033] qemu-system-i38 D ffff880032f5a828 0 6955 1 0x00000000
[1960741.274037] ffff880032f5a3d0 0000000000000286 0000000000012f00 ffff88002fc2bfd8
[1960741.274039] 0000000000012f00 ffff880032f5a3d0 ffff88002b291c48 ffff88002fc2bd40
[1960741.274041] ffff88002b291c4c ffff880032f5a3d0 00000000ffffffff ffff88002b291c50
[1960741.274043] Call Trace:
[1960741.274045] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.274047] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.274049] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.274051] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.274055] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.274058] [<ffffffff811a7a60>] ? new_sync_read+0xa0/0xa0
[1960741.274060] [<ffffffff811a7b5f>] ? do_iter_readv_writev+0x5f/0x90
[1960741.274062] [<ffffffff811a90bb>] ? do_readv_writev+0xbb/0x240
[1960741.274067] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.274071] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.274081] [<ffffffff81094215>] ? check_preempt_curr+0x75/0xa0
[1960741.274089] [<ffffffff81096c6a>] ? wake_up_new_task+0xda/0x160
[1960741.274098] [<ffffffff810669c2>] ? do_fork+0x152/0x390
[1960741.274107] [<ffffffff81009f2c>] ? xen_clocksource_get_cycles+0x1c/0x20
[1960741.274116] [<ffffffff810c7754>] ? __getnstimeofday+0x34/0xc0
[1960741.274125] [<ffffffff811a95d9>] ? SyS_pwritev+0x99/0xc0
[1960741.274134] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.274139] qemu-system-i38 D ffff88001b2cfa08 0 6956 1 0x00000000
[1960741.274150] ffff88001b2cf5b0 0000000000000286 0000000000012f00 ffff8800253d7fd8
[1960741.274166] 0000000000012f00 ffff88001b2cf5b0 ffff88002b291c48 ffff8800253d7d40
[1960741.274176] ffff88002b291c4c ffff88001b2cf5b0 00000000ffffffff ffff88002b291c50
[1960741.274178] Call Trace:
[1960741.274180] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.274182] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.274184] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.274186] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.274191] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.274193] [<ffffffff811a7a60>] ? new_sync_read+0xa0/0xa0
[1960741.274195] [<ffffffff811a7b5f>] ? do_iter_readv_writev+0x5f/0x90
[1960741.274197] [<ffffffff811a90bb>] ? do_readv_writev+0xbb/0x240
[1960741.274202] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.274206] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.274208] [<ffffffff81094215>] ? check_preempt_curr+0x75/0xa0
[1960741.274210] [<ffffffff81096c6a>] ? wake_up_new_task+0xda/0x160
[1960741.274212] [<ffffffff810669c2>] ? do_fork+0x152/0x390
[1960741.274215] [<ffffffff81009f2c>] ? xen_clocksource_get_cycles+0x1c/0x20
[1960741.274217] [<ffffffff810c7754>] ? __getnstimeofday+0x34/0xc0
[1960741.274219] [<ffffffff811a95d9>] ? SyS_pwritev+0x99/0xc0
[1960741.274221] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.274223] qemu-system-i38 D
[1960741.274225] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274226] ffff880025c1eeb8
[1960741.274228] 0 6957 1 0x00000000
[1960741.274229] ffff880025c1ea60 0000000000000286 0000000000012f00 ffff880005f87fd8
[1960741.274231] 0000000000012f00 ffff880025c1ea60 ffff88002b291c48 ffff880005f87d40
[1960741.274233] ffff88002b291c4c ffff880025c1ea60 00000000ffffffff ffff88002b291c50
[1960741.274235] Call Trace:
[1960741.274237] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.274239] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.274240] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274243] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.274245] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.274250] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.274252] [<ffffffff811a7a60>] ? new_sync_read+0xa0/0xa0
[1960741.274255] [<ffffffff811a7b5f>] ? do_iter_readv_writev+0x5f/0x90
[1960741.274257] [<ffffffff811a90bb>] ? do_readv_writev+0xbb/0x240
[1960741.274258] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274263] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.274267] [<ffffffffa0509950>] ? nfs_invalidate_page+0x90/0x90 [nfs]
[1960741.274270] [<ffffffff81009f2c>] ? xen_clocksource_get_cycles+0x1c/0x20
[1960741.274273] [<ffffffff810c7754>] ? __getnstimeofday+0x34/0xc0
[1960741.274275] [<ffffffff811a95d9>] ? SyS_pwritev+0x99/0xc0
[1960741.274276] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274279] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.274280] qemu-system-i38 D ffff880042fe59c8 0 6958 1 0x00000000
[1960741.274282] ffff880042fe5570 0000000000000286 0000000000012f00 ffff880005f63fd8
[1960741.274285] 0000000000012f00 ffff880042fe5570 ffff88002b291c48 ffff880005f63df0
[1960741.274287] ffff88002b291c4c ffff880042fe5570 00000000ffffffff ffff88002b291c50
[1960741.274288] Call Trace:
[1960741.274291] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.274292] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274294] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.274297] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.274299] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.274303] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.274306] [<ffffffff811a7ad4>] ? new_sync_write+0x74/0xa0
[1960741.274307] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274310] [<ffffffff811a8212>] ? vfs_write+0xb2/0x1f0
[1960741.274312] [<ffffffff811a8eb3>] ? SyS_pwrite64+0x63/0xa0
[1960741.274315] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.274316] qemu-system-i38 D ffff88001b2cf0b8 0 6959 1 0x00000000
[1960741.274318] ffff88001b2cec60 0000000000000286 0000000000012f00 ffff88001e84ffd8
[1960741.274320] 0000000000012f00 ffff88001b2cec60 ffff88002b291c48 ffff88001e84fdf0
[1960741.274323] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274325] ffff88002b291c4c ffff88001b2cec60 00000000ffffffff ffff88002b291c50
[1960741.274327] Call Trace:
[1960741.274329] [<ffffffff8150e225>] ? schedule_preempt_disabled+0x25/0x70
[1960741.274331] [<ffffffff8150fcd3>] ? __mutex_lock_slowpath+0xd3/0x1c0
[1960741.274333] [<ffffffff8150fddb>] ? mutex_lock+0x1b/0x2a
[1960741.274335] [<ffffffff8113ef0e>] ? generic_file_write_iter+0x2e/0xa0
[1960741.274336] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274342] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.274344] [<ffffffff811a7ad4>] ? new_sync_write+0x74/0xa0
[1960741.274347] [<ffffffff811a8212>] ? vfs_write+0xb2/0x1f0
[1960741.274349] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274350] [<ffffffff811a8eb3>] ? SyS_pwrite64+0x63/0xa0
[1960741.274355] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.274356] vif29.0-q0-gues S ffff880033db7a08 0 20384 2 0x00000000
[1960741.274358] ffff880033db75b0 0000000000000246 0000000000012f00 ffff88001e85ffd8
[1960741.274360] 0000000000012f00 ffff880033db75b0 ffffc90015bd0930 ffff88001e85fde8
[1960741.274362] ffffc90015bd0980 0000000000000000 ffff88001e85fe80 ffffc90015bc6000
[1960741.274366] Call Trace:
[1960741.274371] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274374] [<ffffffff8150d2b9>] ? schedule_timeout+0x229/0x2a0
[1960741.274379] [<ffffffff815138da>] ? error_exit+0x2a/0x60
[1960741.274383] [<ffffffff815122ff>] ? retint_restore_args+0x5/0x6
[1960741.274393] [<ffffffff8118e2b8>] ? kfree+0x118/0x220
[1960741.274404] [<ffffffffa0644896>] ? xenvif_gop_frag_copy+0x346/0x3a0 [xen_netback]
[1960741.274413] [<ffffffff8118e2b8>] ? kfree+0x118/0x220
[1960741.274422] [<ffffffff8118cde6>] ? kmem_cache_free+0xe6/0x1e0
[1960741.274431] [<ffffffffa0646ba2>] ? xenvif_kthread_guest_rx+0xd2/0xce0 [xen_netback]
[1960741.274440] [<ffffffff810a7a40>] ? prepare_to_wait_event+0xf0/0xf0
[1960741.274450] [<ffffffffa0646ad0>] ? xenvif_map_frontend_rings+0xd0/0xd0 [xen_netback]
[1960741.274459] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.274468] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274477] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.274482] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274484] vif29.0-q0-deal S ffff880033db6768 0 20385 2 0x00000000
[1960741.274486] ffff880033db6310 0000000000000246 0000000000012f00 ffff880010abffd8
[1960741.274488] 0000000000012f00 ffff880033db6310 ffffc90015bc6000 0000000000000000
[1960741.274490] ffffc90015bd0908 ffff880010abfea8 0000000000000000 0000000000000000
[1960741.274491] Call Trace:
[1960741.274494] [<ffffffffa06478b5>] ? xenvif_dealloc_kthread+0x105/0x110 [xen_netback]
[1960741.274497] [<ffffffff810a7a40>] ? prepare_to_wait_event+0xf0/0xf0
[1960741.274499] [<ffffffffa06477b0>] ? xenvif_kthread_guest_rx+0xce0/0xce0 [xen_netback]
[1960741.274501] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.274504] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274506] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.274508] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274509] kworker/5:2 R running task 0 12517 2 0x00000000
[1960741.274515] ffff88001b3814b0 0000000000000246 0000000000012f00 ffff880005feffd8
[1960741.274517] 0000000000012f00 ffff88001b3814b0 ffff88005d2b2700 ffff88005d2b2700
[1960741.274519] ffff88001b3814b0 ffff88001b3814b0 ffff8800324d71c0 ffff8800324d71f0
[1960741.274521] Call Trace:
[1960741.274523] [<ffffffff81081d67>] ? worker_thread+0x187/0x4f0
[1960741.274525] [<ffffffff8150d981>] ? __schedule+0x2b1/0x710
[1960741.274527] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.274529] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.274531] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274533] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.274536] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274537] kworker/7:0 S ffff880025253038 0 19087 2 0x00000000
[1960741.274542] ffff880025252be0 0000000000000246 0000000000012f00 ffff880005eaffd8
[1960741.274544] 0000000000012f00 ffff880025252be0 ffff88005d2f2700 ffff88005d2f2700
[1960741.274546] ffff880025252be0 ffff880025252be0 ffff880005553580 ffff8800055535b0
[1960741.274548] Call Trace:
[1960741.274549] [<ffffffff81081d67>] ? worker_thread+0x187/0x4f0
[1960741.274551] [<ffffffff8150d981>] ? __schedule+0x2b1/0x710
[1960741.274553] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.274555] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.274558] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274560] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.274562] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274563] kworker/3:1 S ffff8800324cda08 0 20431 2 0x00000000
[1960741.274568] ffff8800324cd5b0 0000000000000246 0000000000012f00 ffff880017a2ffd8
[1960741.274570] 0000000000012f00 ffff8800324cd5b0 ffff88005d272700 ffff88005d272700
[1960741.274572] ffff8800324cd5b0 ffff8800324cd5b0 ffff880033c7fa00 ffff880033c7fa30
[1960741.274574] Call Trace:
[1960741.274576] [<ffffffff81081d67>] ? worker_thread+0x187/0x4f0
[1960741.274578] [<ffffffff8150d981>] ? __schedule+0x2b1/0x710
[1960741.274580] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.274582] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.274584] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274586] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.274588] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274589] kworker/4:0 S ffff880005fa19c8 0 10137 2 0x00000000
[1960741.274594] ffff880005fa1570 0000000000000246 0000000000012f00 ffff88003009bfd8
[1960741.274596] 0000000000012f00 ffff880005fa1570 ffff88005d292700 ffff88005d292700
[1960741.274598] ffff880005fa1570 ffff880005fa1570 ffff88000554a580 ffff88000554a5b0
[1960741.274600] Call Trace:
[1960741.274602] [<ffffffff81081d67>] ? worker_thread+0x187/0x4f0
[1960741.274604] [<ffffffff8150d981>] ? __schedule+0x2b1/0x710
[1960741.274606] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.274608] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.274610] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274612] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.274614] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274616] kworker/6:0 S ffff880005fa1078 0 10138 2 0x00000000
[1960741.274620] ffff880005fa0c20 0000000000000246 0000000000012f00 ffff88001e963fd8
[1960741.274622] 0000000000012f00 ffff880005fa0c20 ffff88005d2d2700 ffff88005d2d2700
[1960741.274624] ffff880005fa0c20 ffff880005fa0c20 ffff880030217040 ffff880030217070
[1960741.274626] Call Trace:
[1960741.274628] [<ffffffff81081d67>] ? worker_thread+0x187/0x4f0
[1960741.274630] [<ffffffff8150d981>] ? __schedule+0x2b1/0x710
[1960741.274632] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.274634] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.274636] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274638] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.274641] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274642] kworker/2:2 S ffff8800303a06a8 0 10142 2 0x00000000
[1960741.274647] ffff8800303a0250 0000000000000246 0000000000012f00 ffff88003029bfd8
[1960741.274649] 0000000000012f00 ffff8800303a0250 ffff88005d252700 ffff88005d252718
[1960741.274651] ffff8800303a0250 ffff8800303a0250 ffff88000f45f100 ffff88000f45f130
[1960741.274653] Call Trace:
[1960741.274655] [<ffffffff81081d67>] ? worker_thread+0x187/0x4f0
[1960741.274657] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.274666] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.274674] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274683] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.274692] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274697] kworker/u16:2 S ffff88003012f708 0 10616 2 0x00000000
[1960741.274710] ffff88003012f2b0 0000000000000246 0000000000012f00 ffff880017a57fd8
[1960741.274727] 0000000000012f00 ffff88003012f2b0 ffff880046da9000 ffff880046da9000
[1960741.274744] ffff88003012f2b0 ffff88003012f2b0 ffff8800301ac4c0 ffff8800301ac4f0
[1960741.274755] Call Trace:
[1960741.274757] [<ffffffff81081d67>] ? worker_thread+0x187/0x4f0
[1960741.274759] [<ffffffff8150d981>] ? __schedule+0x2b1/0x710
[1960741.274761] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.274763] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.274765] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274767] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.274770] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274771] kworker/0:0 S ffff8800324e4e38 0 11899 2 0x00000000
[1960741.274776] ffff8800324e49e0 0000000000000246
[1960741.274779] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274779] 0000000000012f00
[1960741.274782] ffff880010a5ffd8
[1960741.274783] 0000000000012f00 ffff8800324e49e0 ffff88005d212700 ffff88005d212700
[1960741.274786] ffff8800324e49e0 ffff8800324e49e0 ffff880033c16d00 ffff880033c16d30
[1960741.274788] Call Trace:
[1960741.274790] [<ffffffff81081d67>] ? worker_thread+0x187/0x4f0
[1960741.274792] [<ffffffff8150d981>] ? __schedule+0x2b1/0x710
[1960741.274794] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.274796] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.274798] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274800] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274802] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.274805] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.274806] sshd S ffff88001b2dd078 0 12339 1693 0x00000000
[1960741.274808] ffff88001b2dcc20 0000000000000286 0000000000012f00 ffff88002532bfd8
[1960741.274810] 0000000000012f00 ffff88001b2dcc20 0000000000000000 ffff88002532bd98
[1960741.274812] 0000000000000040 0000000000000400 000000000000000a
[1960741.274815] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274815] 000000000000000a
[1960741.274817] Call Trace:
[1960741.274820] [<ffffffff8150d67d>] ? schedule_hrtimeout_range_clock+0x14d/0x170
[1960741.274824] [<ffffffff81510a1b>] ? ldsem_down_read+0x2b/0x210
[1960741.274827] [<ffffffff815138da>] ? error_exit+0x2a/0x60
[1960741.274829] [<ffffffff815122ff>] ? retint_restore_args+0x5/0x6
[1960741.274831] [<ffffffff81511126>] ? _raw_spin_lock_irqsave+0x16/0x50
[1960741.274833] [<ffffffff810a7535>] ? add_wait_queue+0x15/0x40
[1960741.274836] [<ffffffff8136edab>] ? pty_write_room+0x2b/0x40
[1960741.274838] [<ffffffff8136727b>] ? n_tty_poll+0x22b/0x260
[1960741.274841] [<ffffffff811baf65>] ? poll_schedule_timeout+0x45/0x60
[1960741.274842] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274845] [<ffffffff811bb92e>] ? do_select+0x5ae/0x770
[1960741.274848] [<ffffffff811bb0f0>] ? poll_select_copy_remaining+0x140/0x140
[1960741.274850] [<ffffffff811bb0f0>] ? poll_select_copy_remaining+0x140/0x140
[1960741.274852] [<ffffffff811bb0f0>] ? poll_select_copy_remaining+0x140/0x140
[1960741.274854] [<ffffffff811bb0f0>] ? poll_select_copy_remaining+0x140/0x140
[1960741.274857] [<ffffffff8107250a>] ? internal_add_timer+0x2a/0x70
[1960741.274858] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274861] [<ffffffff81510dd3>] ? _raw_spin_unlock_irqrestore+0x13/0x20
[1960741.274863] [<ffffffff81074747>] ? mod_timer+0x127/0x1e0
[1960741.274866] [<ffffffff81407734>] ? sk_reset_timer+0x14/0x20
[1960741.274869] [<ffffffff8146f2f7>] ? tcp_schedule_loss_probe+0x137/0x1d0
[1960741.274872] [<ffffffff81470085>] ? tcp_write_xmit+0x2b5/0xca0
[1960741.274874] [<ffffffff81408da6>] ? release_sock+0xe6/0x170
[1960741.274875] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274878] [<ffffffff8106c87e>] ? __local_bh_enable_ip+0x1e/0x90
[1960741.274880] [<ffffffff81462670>] ? tcp_sendmsg+0xd0/0xd20
[1960741.274882] [<ffffffff811bbc78>] ? core_sys_select+0x188/0x280
[1960741.274886] [<ffffffff811e2c9c>] ? fsnotify+0x23c/0x300
[1960741.274888] [<ffffffff811a790c>] ? do_sync_write+0x5c/0x90
[1960741.274890] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274892] [<ffffffff811bbe1a>] ? SyS_select+0xaa/0xf0
[1960741.274895] [<ffffffff81009f2c>] ? xen_clocksource_get_cycles+0x1c/0x20
[1960741.274898] [<ffffffff810c7202>] ? get_monotonic_boottime+0x42/0xf0
[1960741.274900] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.274902] bash D ffff880002889ac8
[1960741.274904] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274905] 0 12362 12339 0x00000000
[1960741.274905] ffff880002889670 0000000000000282 0000000000012f00 ffff880017a8ffd8
[1960741.274910] 0000000000012f00 ffff880002889670 ffff880046860000 ffff880017a8fc00
[1960741.274912] ffff880017a8fb70 000000011d366af0 ffff880046860000 000000000000d158
[1960741.274914] Call Trace:
[1960741.274916] [<ffffffff8150d1f2>] ? schedule_timeout+0x162/0x2a0
[1960741.274918] [<ffffffff810966a3>] ? try_to_wake_up+0xd3/0x2d0
[1960741.274920] [<ffffffff81072a70>] ? ftrace_raw_event_tick_stop+0xb0/0xb0
[1960741.274922] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.274924] [<ffffffff8150e3b5>] ? io_schedule_timeout+0x95/0xe0
[1960741.274927] [<ffffffff811488d8>] ? balance_dirty_pages_ratelimited+0x378/0x830
[1960741.274931] [<ffffffff8107f802>] ? queue_delayed_work_on+0x32/0x50
[1960741.274942] [<ffffffff8115bb62>] ? bdi_wakeup_thread_delayed+0x52/0x60
[1960741.274951] [<ffffffff8106c87e>] ? __local_bh_enable_ip+0x1e/0x90
[1960741.274961] [<ffffffff8113cee7>] ? generic_perform_write+0x137/0x1c0
[1960741.274971] [<ffffffff8113ecf8>] ? __generic_file_write_iter+0x158/0x340
[1960741.274979] [<ffffffff8113ef19>] ? generic_file_write_iter+0x39/0xa0
[1960741.274991] [<ffffffffa05099d3>] ? nfs_file_write+0x83/0x1a0 [nfs]
[1960741.275001] [<ffffffff811a7ad4>] ? new_sync_write+0x74/0xa0
[1960741.275010] [<ffffffff811a8212>] ? vfs_write+0xb2/0x1f0
[1960741.275022] [<ffffffffa050961d>] ? nfs_file_fsync+0x5d/0x100 [nfs]
[1960741.275032] [<ffffffff811a8d52>] ? SyS_write+0x42/0xa0
[1960741.275041] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.275045] kworker/u16:0 D ffff880042f1efb8 0 12923 2 0x00000000
[1960741.275052] Workqueue: writeback bdi_writeback_workfn (flush-253:8)
[1960741.275053] ffff880042f1eb60 0000000000000246 0000000000012f00 ffff88001e953fd8
[1960741.275055] 0000000000012f00 ffff880042f1eb60 ffff8800424a9800 ffff8800424a9a98
[1960741.275057] 0000000000000008 0000000000000001 ffff880002292340 ffff88001e953bb8
[1960741.275059] Call Trace:
[1960741.275066] [<ffffffffa020a075>] ? md_write_start+0x95/0x180 [md_mod]
[1960741.275069] [<ffffffff810a7a40>] ? prepare_to_wait_event+0xf0/0xf0
[1960741.275073] [<ffffffffa0128cf6>] ? make_request+0x46/0xcd0 [raid1]
[1960741.275079] [<ffffffffa01dcb69>] ? __split_and_process_bio+0x299/0x410 [dm_mod]
[1960741.275083] [<ffffffffa0200872>] ? md_make_request+0xd2/0x220 [md_mod]
[1960741.275088] [<ffffffffa01dcdff>] ? dm_request+0x11f/0x190 [dm_mod]
[1960741.275091] [<ffffffff8127c8f0>] ? generic_make_request+0xb0/0x100
[1960741.275093] [<ffffffff8127c9b1>] ? submit_bio+0x71/0x150
[1960741.275101] [<ffffffffa02412e1>] ? ext4_io_submit+0x21/0x40 [ext4]
[1960741.275107] [<ffffffffa023da72>] ? ext4_writepages+0x4f2/0xd00 [ext4]
[1960741.275110] [<ffffffff810a1243>] ? update_group_capacity+0x163/0x260
[1960741.275113] [<ffffffff811ce539>] ? __writeback_single_inode+0x39/0x220
[1960741.275115] [<ffffffff811cf1a4>] ? writeback_sb_inodes+0x1a4/0x3e0
[1960741.275117] [<ffffffff811cf476>] ? __writeback_inodes_wb+0x96/0xc0
[1960741.275119] [<ffffffff811cf6e3>] ? wb_writeback+0x243/0x2d0
[1960741.275122] [<ffffffff811d193c>] ? bdi_writeback_workfn+0x1bc/0x420
[1960741.275124] [<ffffffff81081662>] ? process_one_work+0x172/0x420
[1960741.275126] [<ffffffff81081cf3>] ? worker_thread+0x113/0x4f0
[1960741.275128] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.275130] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.275132] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275134] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.275136] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275138] sshd S ffff88004683c728 0 13181 1693 0x00000000
[1960741.275140] ffff88004683c2d0 0000000000000286 0000000000012f00 ffff88001463ffd8
[1960741.275142] 0000000000012f00 ffff88004683c2d0 0000000000000000 ffff88001463fd98
[1960741.275144] 0000000000000040 0000000000000400 000000000000000a 000000000000000a
[1960741.275146] Call Trace:
[1960741.275148] [<ffffffff8150d67d>] ? schedule_hrtimeout_range_clock+0x14d/0x170
[1960741.275150] [<ffffffff81510a1b>] ? ldsem_down_read+0x2b/0x210
[1960741.275152] [<ffffffff8115abc5>] ? zone_statistics+0x85/0x90
[1960741.275154] [<ffffffff81511126>] ? _raw_spin_lock_irqsave+0x16/0x50
[1960741.275156] [<ffffffff810a7535>] ? add_wait_queue+0x15/0x40
[1960741.275158] [<ffffffff8136edab>] ? pty_write_room+0x2b/0x40
[1960741.275160] [<ffffffff8136727b>] ? n_tty_poll+0x22b/0x260
[1960741.275162] [<ffffffff811baf65>] ? poll_schedule_timeout+0x45/0x60
[1960741.275164] [<ffffffff811bb92e>] ? do_select+0x5ae/0x770
[1960741.275167] [<ffffffff811bb0f0>] ? poll_select_copy_remaining+0x140/0x140
[1960741.275169] [<ffffffff811bb0f0>] ? poll_select_copy_remaining+0x140/0x140
[1960741.275171] [<ffffffff811bb0f0>] ? poll_select_copy_remaining+0x140/0x140
[1960741.275173] [<ffffffff811bb0f0>] ? poll_select_copy_remaining+0x140/0x140
[1960741.275176] [<ffffffff8107250a>] ? internal_add_timer+0x2a/0x70
[1960741.275178] [<ffffffff81510dd3>] ? _raw_spin_unlock_irqrestore+0x13/0x20
[1960741.275180] [<ffffffff81074747>] ? mod_timer+0x127/0x1e0
[1960741.275183] [<ffffffff81407734>] ? sk_reset_timer+0x14/0x20
[1960741.275185] [<ffffffff8146f2f7>] ? tcp_schedule_loss_probe+0x137/0x1d0
[1960741.275188] [<ffffffff812bb62b>] ? memcpy_toiovec+0x4b/0x80
[1960741.275190] [<ffffffff81411d25>] ? skb_copy_datagram_iovec+0x55/0x2a0
[1960741.275192] [<ffffffff8118cde6>] ? kmem_cache_free+0xe6/0x1e0
[1960741.275195] [<ffffffff8109f606>] ? check_preempt_wakeup+0x106/0x1d0
[1960741.275197] [<ffffffff81094225>] ? check_preempt_curr+0x85/0xa0
[1960741.275199] [<ffffffff81094254>] ? ttwu_do_wakeup+0x14/0xd0
[1960741.275201] [<ffffffff811bbc78>] ? core_sys_select+0x188/0x280
[1960741.275203] [<ffffffff81510dd3>] ? _raw_spin_unlock_irqrestore+0x13/0x20
[1960741.275205] [<ffffffff81367b4a>] ? n_tty_write+0x37a/0x4e0
[1960741.275207] [<ffffffff810a7624>] ? __wake_up+0x34/0x50
[1960741.275209] [<ffffffff81510dd3>] ? _raw_spin_unlock_irqrestore+0x13/0x20
[1960741.275212] [<ffffffff81364668>] ? tty_write+0x1c8/0x2a0
[1960741.275214] [<ffffffff813677d0>] ? process_echoes+0x70/0x70
[1960741.275216] [<ffffffff811bbe1a>] ? SyS_select+0xaa/0xf0
[1960741.275219] [<ffffffff81009f2c>] ? xen_clocksource_get_cycles+0x1c/0x20
[1960741.275221] [<ffffffff810c7202>] ? get_monotonic_boottime+0x42/0xf0
[1960741.275223] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.275224] bash R running task 0 13183 13181 0x00000008
[1960741.275226] 0000000000000000 ffffffff8109635a ffff8800468a2f20 ffffffff818a4c40
[1960741.275235] 0000000000000074 0000000000000000 ffffffff8137061c 0000000000000002
[1960741.275252] 00000000016f2408 0000000000000002 ffff88003021ff58 ffffffff81370abb
[1960741.275265] Call Trace:
[1960741.275267] [<ffffffff8109635a>] ? show_state_filter+0x6a/0xa0
[1960741.275270] [<ffffffff8137061c>] ? __handle_sysrq+0xfc/0x160
[1960741.275272] [<ffffffff81370abb>] ? write_sysrq_trigger+0x2b/0x30
[1960741.275281] [<ffffffff81206919>] ? proc_reg_write+0x39/0x70
[1960741.275290] [<ffffffff811a8212>] ? vfs_write+0xb2/0x1f0
[1960741.275298] [<ffffffff811a8d52>] ? SyS_write+0x42/0xa0
[1960741.275307] [<ffffffff8151164d>] ? system_call_fast_compare_end+0x10/0x15
[1960741.275312] kworker/3:2 S ffff880024474568 0 13278 2 0x00000000
[1960741.275326] ffff880024474110 0000000000000246 0000000000012f00 ffff8800147affd8
[1960741.275337] 0000000000012f00 ffff880024474110 ffff88005d272700 ffff88005d272700
[1960741.275339] ffff880024474110 ffff880024474110 ffff8800324a2dc0 ffff8800324a2df0
[1960741.275341] Call Trace:
[1960741.275343] [<ffffffff81081d67>] ? worker_thread+0x187/0x4f0
[1960741.275345] [<ffffffff8150d981>] ? __schedule+0x2b1/0x710
[1960741.275347] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.275349] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.275352] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275354] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.275356] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275357] kworker/2:0 S ffff880000020568 0 13279 2 0x00000000
[1960741.275362] ffff880000020110 0000000000000246 0000000000012f00 ffff88001b2e3fd8
[1960741.275364] 0000000000012f00 ffff880000020110 ffff88005d252700 ffff88005d252700
[1960741.275366] ffff880000020110 ffff880000020110 ffff88003005ddc0 ffff88003005ddf0
[1960741.275368] Call Trace:
[1960741.275370] [<ffffffff81081d67>] ? worker_thread+0x187/0x4f0
[1960741.275372] [<ffffffff8150d981>] ? __schedule+0x2b1/0x710
[1960741.275374] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.275376] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.275378] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275380] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.275382] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275384] kworker/4:1 S ffff88000552bac8 0 13548 2 0x00000000
[1960741.275388] ffff88000552b670 0000000000000246 0000000000012f00 ffff88001e983fd8
[1960741.275390] 0000000000012f00 ffff88000552b670 ffff88005d292700 ffff88005d292718
[1960741.275392] ffff88000552b670 ffff88000552b670 ffff88003251f400 ffff88003251f430
[1960741.275394] Call Trace:
[1960741.275396] [<ffffffff81081d67>] ? worker_thread+0x187/0x4f0
[1960741.275398] [<ffffffff8150d981>] ? __schedule+0x2b1/0x710
[1960741.275400] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.275402] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.275405] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275407] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.275408] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.275411] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275413] kworker/6:1 S ffff880032e459c8 0 13549 2 0x00000000
[1960741.275417] ffff880032e45570 0000000000000246 0000000000012f00 ffff880030277fd8
[1960741.275419] 0000000000012f00 ffff880032e45570 ffff88005d2d2700 ffff88005d2d2718
[1960741.275421] ffff880032e45570
[1960741.275423] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.275424] ffff880032e45570
[1960741.275428] ffff88002fe357c0 ffff88002fe357f0
[1960741.275429] Call Trace:
[1960741.275431] [<ffffffff81081d67>] ? worker_thread+0x187/0x4f0
[1960741.275433] [<ffffffff8150d981>] ? __schedule+0x2b1/0x710
[1960741.275436] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.275438] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.275440] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275442] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.275444] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275446] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.275448] kworker/5:1 S ffff880032f5bac8 0 13557 2 0x00000000
[1960741.275453] ffff880032f5b670 0000000000000246 0000000000012f00 ffff88001b3a7fd8
[1960741.275454] 0000000000012f00 ffff880032f5b670 ffff88005d2b2700 ffff88005d2b2718
[1960741.275456] ffff880032f5b670 ffff880032f5b670 ffff88000f45f1c0 0000000000000000
[1960741.275458] Call Trace:
[1960741.275460] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.275463] [<ffffffff81081d67>] ? worker_thread+0x187/0x4f0
[1960741.275465] [<ffffffff8150d981>] ? __schedule+0x2b1/0x710
[1960741.275466] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.275469] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.275471] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275473] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.275475] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.275477] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275479] kworker/1:2 S ffff88001b3c26a8 0 14801 2 0x00000000
[1960741.275484] ffff88001b3c2250 0000000000000246 0000000000012f00 ffff88001e9cffd8
[1960741.275486] 0000000000012f00 ffff88001b3c2250 ffff88005d232700 ffff88005d232718
[1960741.275489] ffff88001b3c2250
[1960741.275489] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.275490] ffff88001b3c2250 ffff88001b2337c0 ffff88001b2337f0
[1960741.275492] Call Trace:
[1960741.275494] [<ffffffff81081d67>] ? worker_thread+0x187/0x4f0
[1960741.275496] [<ffffffff8150d981>] ? __schedule+0x2b1/0x710
[1960741.275498] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.275500] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.275502] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.275504] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275507] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.275510] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275512] kworker/7:2 S ffff8800028010b8 0 14806 2 0x00000000
[1960741.275517] ffff880002800c60 0000000000000246 0000000000012f00 ffff880030acffd8
[1960741.275519] 0000000000012f00 ffff880002800c60 ffff88005d2f2700 ffff88005d2f2718
[1960741.275520] ffff880002800c60 ffff880002800c60 ffff8800301a8d00 ffff8800301a8d30
[1960741.275522] Call Trace:
[1960741.275524] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.275526] [<ffffffff81081d67>] ? worker_thread+0x187/0x4f0
[1960741.275528] [<ffffffff8150d981>] ? __schedule+0x2b1/0x710
[1960741.275530] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.275532] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.275535] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275537] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.275539] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.275549] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275553] kworker/0:1 S ffff880032fc6628 0 14808 2 0x00000000
[1960741.275567] ffff880032fc61d0 0000000000000246 0000000000012f00 ffff880025353fd8
[1960741.275585] 0000000000012f00 ffff880032fc61d0 ffff88005d212700 ffff88005d212700
[1960741.275602] ffff880032fc61d0 ffff880032fc61d0 ffff8800029ef7c0 ffff8800029ef7f0
[1960741.275619] Call Trace:
[1960741.275627] [<ffffffff81081d67>] ? worker_thread+0x187/0x4f0
[1960741.275636] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.275640] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.275642] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275644] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.275646] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275648] kworker/u16:1 S ffff8800309e8628 0 14817 2 0x00000000
[1960741.275653] ffff8800309e81d0 0000000000000246 0000000000012f00 ffff88001e993fd8
[1960741.275655] 0000000000012f00 ffff8800309e81d0 ffff880046da9000 ffff880046da9000
[1960741.275658] ffff8800309e81d0 ffff8800309e81d0 ffff8800301a8040 ffff8800301a8070
[1960741.275660] Call Trace:
[1960741.275662] [<ffffffff81081d67>] ? worker_thread+0x187/0x4f0
[1960741.275664] [<ffffffff8150d981>] ? __schedule+0x2b1/0x710
[1960741.275665] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.275668] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.275670] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275672] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.275674] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275675] drbd_r_resource S ffff8800325137c8 0 14955 2 0x00000000
[1960741.275677] ffff880032513370 0000000000000246 0000000000012f00 ffff88001e93bfd8
[1960741.275679] 0000000000012f00 ffff880032513370 ffff880042e5e140 ffff88001e93bb48
[1960741.275681] ffff88001e93bbf8 ffff880042e5e61c 0000000000000000 0000000000000000
[1960741.275683] Call Trace:
[1960741.275685] [<ffffffff8150d2b9>] ? schedule_timeout+0x229/0x2a0
[1960741.275687] [<ffffffff812a97e0>] ? cpumask_next_and+0x30/0x40
[1960741.275690] [<ffffffff810a1d9a>] ? load_balance+0x1ca/0x850
[1960741.275692] [<ffffffff81408ef9>] ? sk_wait_data+0xc9/0xd0
[1960741.275694] [<ffffffff810a7a40>] ? prepare_to_wait_event+0xf0/0xf0
[1960741.275697] [<ffffffff8146402d>] ? tcp_recvmsg+0x7dd/0xc30
[1960741.275699] [<ffffffff8148c03a>] ? inet_recvmsg+0x6a/0x80
[1960741.275701] [<ffffffff8140464a>] ? sock_recvmsg+0x9a/0xd0
[1960741.275703] [<ffffffff8150d2b9>] ? schedule_timeout+0x229/0x2a0
[1960741.275708] [<ffffffffa0200872>] ? md_make_request+0xd2/0x220 [md_mod]
[1960741.275714] [<ffffffffa01dcdff>] ? dm_request+0x11f/0x190 [dm_mod]
[1960741.275716] [<ffffffff814046b5>] ? kernel_recvmsg+0x35/0x40
[1960741.275722] [<ffffffffa0324f32>] ? drbd_recv_short+0x52/0x60 [drbd]
[1960741.275727] [<ffffffffa0325075>] ? drbd_recv+0x25/0x1d0 [drbd]
[1960741.275733] [<ffffffffa0325d84>] ? drbd_recv_all_warn+0x14/0x70 [drbd]
[1960741.275739] [<ffffffffa0325e08>] ? drbd_recv_header+0x28/0x50 [drbd]
[1960741.275744] [<ffffffffa0332383>] ? drbd_receiver+0x93/0x250 [drbd]
[1960741.275750] [<ffffffffa033bd00>] ? drbd_destroy_connection+0xc0/0xc0 [drbd]
[1960741.275757] [<ffffffffa033bd46>] ? drbd_thread_setup+0x46/0x130 [drbd]
[1960741.275763] [<ffffffffa033bd00>] ? drbd_destroy_connection+0xc0/0xc0 [drbd]
[1960741.275765] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.275767] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275770] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.275772] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275773] drbd_a_resource S ffff880002a1e528 0 14958 2 0x00000000
[1960741.275775] ffff880002a1e0d0 0000000000000246 0000000000012f00 ffff880030373fd8
[1960741.275777] 0000000000012f00 ffff880002a1e0d0 ffff880046f8c000 ffff880030373b58
[1960741.275779] ffff880030373ad0 000000011d3670a5 ffff880046f8c000 000000000000d158
[1960741.275781] Call Trace:
[1960741.275783] [<ffffffff8150d1f2>] ? schedule_timeout+0x162/0x2a0
[1960741.275786] [<ffffffff81072a70>] ? ftrace_raw_event_tick_stop+0xb0/0xb0
[1960741.275788] [<ffffffff81408ef9>] ? sk_wait_data+0xc9/0xd0
[1960741.275791] [<ffffffff810a7a40>] ? prepare_to_wait_event+0xf0/0xf0
[1960741.275793] [<ffffffff8146402d>] ? tcp_recvmsg+0x7dd/0xc30
[1960741.275795] [<ffffffff8148c03a>] ? inet_recvmsg+0x6a/0x80
[1960741.275797] [<ffffffff8140464a>] ? sock_recvmsg+0x9a/0xd0
[1960741.275800] [<ffffffff81407734>] ? sk_reset_timer+0x14/0x20
[1960741.275802] [<ffffffff81470085>] ? tcp_write_xmit+0x2b5/0xca0
[1960741.275804] [<ffffffff8146de00>] ? tcp_select_initial_window+0x110/0x120
[1960741.275807] [<ffffffff814046b5>] ? kernel_recvmsg+0x35/0x40
[1960741.275812] [<ffffffffa0324f32>] ? drbd_recv_short+0x52/0x60 [drbd]
[1960741.275818] [<ffffffffa03327be>] ? drbd_asender+0x27e/0x750 [drbd]
[1960741.275825] [<ffffffffa033bd00>] ? drbd_destroy_connection+0xc0/0xc0 [drbd]
[1960741.275831] [<ffffffffa033bd46>] ? drbd_thread_setup+0x46/0x130 [drbd]
[1960741.275837] [<ffffffffa033bd00>] ? drbd_destroy_connection+0xc0/0xc0 [drbd]
[1960741.275839] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.275841] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275844] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.275846] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275847] kworker/0:2 S ffff8800021eaff8 0 16520 2 0x00000000
[1960741.275852] ffff8800021eaba0 0000000000000246 0000000000012f00 ffff8800146e7fd8
[1960741.275854] 0000000000012f00 ffff8800021eaba0 ffff88005d212700 ffff88005d212700
[1960741.275856] ffff8800021eaba0 ffff8800021eaba0 ffff8800308bd4c0 ffff8800308bd4f0
[1960741.275858] Call Trace:
[1960741.275860] [<ffffffff81081d67>] ? worker_thread+0x187/0x4f0
[1960741.275862] [<ffffffff8150d981>] ? __schedule+0x2b1/0x710
[1960741.275864] [<ffffffff81081be0>] ? rescuer_thread+0x2d0/0x2d0
[1960741.275866] [<ffffffff81087f7d>] ? kthread+0xbd/0xe0
[1960741.275868] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275870] [<ffffffff81511598>] ? ret_from_fork+0x58/0x90
[1960741.275873] [<ffffffff81087ec0>] ? kthread_create_on_node+0x180/0x180
[1960741.275875] Sched Debug Version: v0.11, 3.16.0-4-amd64 #1
[1960741.275877] ktime : 1960722313.890781
[1960741.275878] sched_clk : 1960741275.874826
[1960741.275879] cpu_clk : 1960741275.874872
[1960741.275881] jiffies : 4785072875
[1960741.275882] sched_clock_stable() : 1
[1960741.275883] sysctl_sched
[1960741.275884] .sysctl_sched_latency : 24.000000
[1960741.275886] .sysctl_sched_min_granularity : 3.000000
[1960741.275887] .sysctl_sched_wakeup_granularity : 4.000000
[1960741.275888] .sysctl_sched_child_runs_first : 0
[1960741.275889] .sysctl_sched_features : 77435
[1960741.275890] .sysctl_sched_tunable_scaling : 1 (logaritmic)
[1960741.275892] cpu#0, 2400.164 MHz
[1960741.275894] .nr_running : 3
[1960741.275895] .load : 2048
[1960741.275896] .nr_switches : 2933466340
[1960741.275897] .nr_load_updates : 316712569
[1960741.275898] .nr_uninterruptible : -2436302
[1960741.275899] .next_balance : 4785.072900
[1960741.275900] .curr->pid : 3
[1960741.275902] .clock : 1960741275.899428
[1960741.275903] .cpu_load[0] : 154
[1960741.275904] .cpu_load[1] : 97
[1960741.275905] .cpu_load[2] : 54
[1960741.275906] .cpu_load[3] : 28
[1960741.275907] .cpu_load[4] : 15
[1960741.275909]
cfs_rq[0]:/
[1960741.275910] .exec_clock : 0.000000
[1960741.275912] .MIN_vruntime : 27575685.439399
[1960741.275913] .min_vruntime : 27575697.438389
[1960741.275914] .max_vruntime : 27575695.208814
[1960741.275915] .spread : 9.769415
[1960741.275916] .spread0 : 0.000000
[1960741.275917] .nr_spread_over : 0
[1960741.275918] .nr_running : 3
[1960741.275919] .load : 90809
[1960741.275921] .runnable_load_avg : 379
[1960741.275922] .blocked_load_avg : 0
[1960741.275923] .tg_load_contrib : 250
[1960741.275924] .tg_runnable_contrib : 222
[1960741.275925] .tg_load_avg : 804
[1960741.275926] .tg->runnable_avg : 775
[1960741.275927] .avg->runnable_avg_sum : 10325
[1960741.275928] .avg->runnable_avg_period : 47411
[1960741.275929]
rt_rq[0]:
[1960741.275931] .rt_nr_running : 0
[1960741.275932] .rt_throttled : 0
[1960741.275933] .rt_time : 0.457047
[1960741.275934] .rt_runtime : 950.000000
[1960741.275935]
runnable tasks:
task PID tree-key switches prio exec-runtime sum-exec sum-sleep
----------------------------------------------------------------------------------------------------------
[1960741.275937] ksoftirqd/0 3 27575685.469763 137870191 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.275942] kworker/0:0H 5 351.261420 6 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.275946] rcu_bh 8 27569303.814492 22118 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.275949] migration/0 9 0.000000 5307 0 0 0 0.000000 0.000000 0.000000 0 /
[1960741.275953] watchdog/0 10 0.000000 490183 0 0 0 0.000000 0.000000 0.000000 0 /
[1960741.275958] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.275961] kdevtmpfs 47 21225420.824876 310 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.275975] khungtaskd 51 27574622.573901 16341 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.275994] fsnotify_mark 62 27566077.434221 150 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.275998] khubd 122 348.891724 56 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276002] fw_event0 128 328.508796 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276018] kworker/0:1H 164 27575685.439421 51705182 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276040] jbd2/dm-0-8 228 27575560.617537 139570 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276063] jbd2/dm-8-8 521 27574111.884139 361966 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276067] smartd 1692 27556513.812188 30912 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276081] R in:imklog 1710 27575695.351957 339 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276086] xenconsoled 2321 27566011.850648 2542 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276089] drbd_w_resource 3005 5397.745397 282 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276093] Rdrbd_r_resource 3025 27575685.668265 96602356 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276097] drbd_a_resource 3028 0.000000 44315150 97 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276100] ganeti-metad 2944 22882781.671004 587 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276104] qemu-system-i38 3266 27575672.446636 2789267 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276108] vif2.0-q0-deall 3340 27538611.467758 797037 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276111] qemu-system-i38 18238 27575672.452360 1276337 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276115] qemu-system-i38 6925 27575685.112569 8984 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276119] qemu-system-i38 26549 13745139.760737 97 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276123] qemu-system-i38 26554 13757419.220442 301 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276126] qemu-system-i38 5367 27575685.460500 9294 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276130] vif12.0-q0-gues 26659 27575674.435172 2719909 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276133] rpcbind 6642 27575154.654711 11499 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276137] vif15.0-q0-gues 26822 27575576.830994 119093 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276141] vif15.0-q0-deal 26823 25602711.587910 545799 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276144] vif15.0-q1-gues 26824 27575685.486367 7046712 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276148] vif15.0-q1-deal 26825 25602345.010464 299 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276151] xl 19989 27566011.619970 547 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276155] xl 19990 27566011.682826 1314 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276159] qemu-system-i38 20154 26625925.240768 35 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276162] qemu-system-i38 25104 27520907.692807 50248 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276167] vif29.0-q0-gues 20384 27575674.466257 187286 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276171] vif29.0-q0-deal 20385 27572357.309601 6871 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276175] kworker/0:0 11899 27575685.448858 8480 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276178] sshd 12339 27553000.767725 1716 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276182] sshd 13181 27575685.537667 3370 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276186] kworker/0:1 14808 27575086.627100 120 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276189] kworker/0:2 16520 27575632.369492 3 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276194] cpu#1, 2400.164 MHz
[1960741.276195] .nr_running : 0
[1960741.276197] .load : 0
[1960741.276198] .nr_switches : 89917580
[1960741.276199] .nr_load_updates : 24120818
[1960741.276200] .nr_uninterruptible : 37736
[1960741.276201] .next_balance : 4785.072876
[1960741.276202] .curr->pid : 0
[1960741.276203] .clock : 1960741274.032637
[1960741.276204] .cpu_load[0] : 0
[1960741.276205] .cpu_load[1] : 0
[1960741.276206] .cpu_load[2] : 0
[1960741.276207] .cpu_load[3] : 0
[1960741.276208] .cpu_load[4] : 0
[1960741.276209]
cfs_rq[1]:/
[1960741.276211] .exec_clock : 0.000000
[1960741.276212] .MIN_vruntime : 0.000001
[1960741.276213] .min_vruntime : 45279451.456486
[1960741.276214] .max_vruntime : 0.000001
[1960741.276215] .spread : 0.000000
[1960741.276217] .spread0 : 17703754.018097
[1960741.276218] .nr_spread_over : 0
[1960741.276219] .nr_running : 0
[1960741.276220] .load : 0
[1960741.276221] .runnable_load_avg : 0
[1960741.276222] .blocked_load_avg : 2
[1960741.276223] .tg_load_contrib : 2
[1960741.276224] .tg_runnable_contrib : 5
[1960741.276225] .tg_load_avg : 929
[1960741.276226] .tg->runnable_avg : 779
[1960741.276227] .avg->runnable_avg_sum : 270
[1960741.276228] .avg->runnable_avg_period : 46319
[1960741.276229]
rt_rq[1]:
[1960741.276230] .rt_nr_running : 0
[1960741.276231] .rt_throttled : 0
[1960741.276233] .rt_time : 0.000000
[1960741.276234] .rt_runtime : 950.000000
[1960741.276235]
runnable tasks:
task PID tree-key switches prio exec-runtime sum-exec sum-sleep
----------------------------------------------------------------------------------------------------------
[1960741.276237] watchdog/1 11 -2.988520 490183 0 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276241] migration/1 12 0.000000 1140598 0 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276245] ksoftirqd/1 13 45279439.522234 2885011 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276248] kworker/1:0H 15 215.650443 6 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276252] writeback 52 10.993279 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276256] ksmd 53 23.041010 2 125 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276260] md0_raid1 182 45279439.489452 994617 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276264] bioset 273 171.793833 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276267] drbd-reissue 274 183.822558 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276271] kworker/1:1H 285 45272956.849500 8563 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276275] kdmflush 417 728.641129 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276279] ext4-rsv-conver 522 1037.170462 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276282] rpciod 1665 5903.537031 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276286] rs:main Q:Reg 1711 45279439.651491 64173 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276290] drbd4_submit 3139 11862.047189 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276293] drbd_w_resource 3191 12919.908573 31 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276297] drbd_r_resource 3238 45279424.742159 4041804 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276300] drbd_a_resource 3303 0.000000 2066485 97 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276304] drbd2_submit 4420 17170.530333 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276308] xl 18313 45271159.708496 84 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276312] qemu-system-i38 26750 39149109.925261 172 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276315] kworker/1:0 24121 45279440.165063 90503 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276319] qemu-system-i38 6931 45231668.790896 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276323] qemu-system-i38 6938 45231693.855916 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276327] qemu-system-i38 6942 45231705.953859 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276330] qemu-system-i38 6946 45231718.052832 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276334] qemu-system-i38 6949 45231730.105168 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276337] qemu-system-i38 6954 45231742.326843 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276341] qemu-system-i38 6957 45231754.428581 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276345] kworker/u16:2 10616 45279439.504103 14264 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276348] kworker/1:2 14801 45269861.947282 9 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276353] cpu#2, 2400.164 MHz
[1960741.276359] .nr_running : 0
[1960741.276364] .load : 0
[1960741.276369] .nr_switches : 1156153587
[1960741.276375] .nr_load_updates : 190528997
[1960741.276377] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.276383] .nr_uninterruptible : 1591476
[1960741.276388] .next_balance : 4785.072844
[1960741.276394] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.276394] .curr->pid : 0
[1960741.276396] .clock : 1960741275.813553
[1960741.276399] .cpu_load[0] : 0
[1960741.276401] .cpu_load[1] : 0
[1960741.276403] .cpu_load[2] : 0
[1960741.276405] .cpu_load[3] : 0
[1960741.276408] .cpu_load[4] : 0
[1960741.276410]
cfs_rq[2]:/
[1960741.276412] .exec_clock : 0.000000
[1960741.276414] .MIN_vruntime : 0.000001
[1960741.276417] .min_vruntime : 31670653.836677
[1960741.276419] .max_vruntime : 0.000001
[1960741.276422] .spread : 0.000000
[1960741.276424] .spread0 : 4094956.398288
[1960741.276426] .nr_spread_over : 0
[1960741.276428] .nr_running : 0
[1960741.276430] .load : 0
[1960741.276432] .runnable_load_avg : 0
[1960741.276434] .blocked_load_avg : 182
[1960741.276437] .tg_load_contrib : 181
[1960741.276439] .tg_runnable_contrib : 75
[1960741.276441] .tg_load_avg : 929
[1960741.276443] .tg->runnable_avg : 779
[1960741.276445] .avg->runnable_avg_sum : 3400
[1960741.276448] .avg->runnable_avg_period : 46382
[1960741.276450]
rt_rq[2]:
[1960741.276452] .rt_nr_running : 0
[1960741.276454] .rt_throttled : 0
[1960741.276457] .rt_time : 0.000000
[1960741.276459] .rt_runtime : 950.000000
[1960741.276462]
runnable tasks:
task PID tree-key switches prio exec-runtime sum-exec sum-sleep
----------------------------------------------------------------------------------------------------------
[1960741.276464] watchdog/2 16 -5.989698 490183 0 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276484] migration/2 17 0.000000 5463 0
[1960741.276490] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.276495] 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276511] ksoftirqd/2 18 31670565.500181 1018406 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276516] kworker/2:0H 20 44.007035 6 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276520] khvcd 69 2305.907765 6 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276524] scsi_eh_0 126 29.671241 2 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276528] scsi_tmf_0 127 37.697838 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276531] scsi_eh_4 143 142.513520 72 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276535] kworker/2:1H 231 31670383.264895 2901823 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276539] mdadm 393 31662515.045205 2005 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276543] sshd 1693 31666206.644847 22156 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276547] systemd-logind 1696 31668001.524960 86330 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276550] ntpd 2063 31670580.232045 2228618 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276554] xenstored 2308 31662273.889403 97007 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276557] ganeti-noded 2763 31663112.614867 184487 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276561] ganeti-confd 2837 31669835.504591 4669620 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276564] ganeti-mond 2852 31670383.453892 12932448 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276568] drbd_w_resource 4443 31649025.102700 1574062 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276572] xl 3084 31648850.682002 587 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276575] xl 3085 31648850.776127 758 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276578] qemu-system-i38 3267 12107634.420957 146 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276582] qemu-system-i38 4878 31670637.648031 9339 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276585] vif2.0-q0-guest 3339 31670583.151260 5684573 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276589] vif5.0-q0-deall 18317 31668122.788436 25587 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276593] qemu-system-i38 26537 31670653.751901 646517944 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276596] vif12.0-q0-deal 26660 31633775.867680 326864 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276600] qemu-system-i38 26749 31670514.543862 503645 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276603] qemu-system-i38 20139 31670653.836677 34912443 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276608] kworker/2:2 10142 31663101.985218 634 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276611] kworker/u16:0 12923 31670641.215239 9675 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276615] kworker/2:0 13279 31670641.142843 551 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276618] drbd_r_resource 14955 31670379.285142 568 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276622] drbd_a_resource 14958 0.000000 196 97 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276627] cpu#3, 2400.164 MHz
[1960741.276628] .nr_running : 0
[1960741.276629] .load : 0
[1960741.276630] .nr_switches : 93513962
[1960741.276631] .nr_load_updates : 25479659
[1960741.276632] .nr_uninterruptible : 34888
[1960741.276633] .next_balance : 4785.072743
[1960741.276634] .curr->pid : 0
[1960741.276636] .clock : 1960740742.056086
[1960741.276637] .cpu_load[0] : 0
[1960741.276638] .cpu_load[1] : 0
[1960741.276639] .cpu_load[2] : 0
[1960741.276640] .cpu_load[3] : 0
[1960741.276641] .cpu_load[4] : 0
[1960741.276642]
cfs_rq[3]:/
[1960741.276643] .exec_clock : 0.000000
[1960741.276644] .MIN_vruntime : 0.000001
[1960741.276645] .min_vruntime : 45239326.305651
[1960741.276647] .max_vruntime : 0.000001
[1960741.276648] .spread : 0.000000
[1960741.276649] .spread0 : 17663628.867262
[1960741.276650] .nr_spread_over : 0
[1960741.276651] .nr_running : 0
[1960741.276652] .load : 0
[1960741.276653] .runnable_load_avg : 0
[1960741.276654] .blocked_load_avg : 0
[1960741.276655] .tg_load_contrib : 0
[1960741.276656] .tg_runnable_contrib : 0
[1960741.276657] .tg_load_avg : 929
[1960741.276658] .tg->runnable_avg : 779
[1960741.276659] .avg->runnable_avg_sum : 14
[1960741.276660] .avg->runnable_avg_period : 48999
[1960741.276661]
rt_rq[3]:
[1960741.276663] .rt_nr_running : 0
[1960741.276664] .rt_throttled : 0
[1960741.276665] .rt_time : 0.000000
[1960741.276666] .rt_runtime : 950.000000
[1960741.276667]
runnable tasks:
task PID tree-key switches prio exec-runtime sum-exec sum-sleep
----------------------------------------------------------------------------------------------------------
[1960741.276670] watchdog/3 21 -5.991207 490183 0 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276673] migration/3 22 0.000000 1282801 0 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276677] ksoftirqd/3 23 45239314.355470 2982207 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276681] kworker/3:0H 25 1258.771687 6 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276685] crypto 54 10.989077 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276703] kintegrityd 55 23.026471 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276725] bioset 56 35.043379 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276746] kblockd 57 47.058272 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276768] xenbus_frontend 58 59.117061 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276783] kthrotld 68 179.629565 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276787] irq/131-ahci0 131 0.000000 2 49 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276791] irq/132-ahci1 132 0.000000 2 49 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276794] irq/133-ahci2 133 0.000000 2 49 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276798] irq/134-ahci3 134 0.000000 957484 49 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276801] irq/135-ahci4 135 0.000000 2 49 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276805] irq/136-ahci5 136 0.000000 2 49 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276808] scsi_eh_1 137 718.977022 14 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276812] scsi_tmf_1 138 550.402261 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276815] scsi_eh_2 139 719.063814 14 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276819] scsi_tmf_2 140 574.478190 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276822] scsi_tmf_3 142 598.520997 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276826] scsi_tmf_4 144 622.563381 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276829] scsi_eh_5 145 731.128050 14 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276833] scsi_tmf_5 146 646.605403 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276836] scsi_eh_6 147 743.206520 14 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276839] scsi_tmf_6 148 670.646431 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276843] kworker/3:1H 277 45233635.616608 29001 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276847] bioset 405 1662.702109 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276851] kdmflush 412 1670.728614 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276854] bioset 414 1682.752834 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276858] kdmflush 494 1832.702834 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276861] bioset 495 1844.741467 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276865] lockd 1946 5576.486952 2 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276869] drbd1_submit 2993 15020.954081 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276873] xl 18312 45230557.464834 45 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276877] qemu-system-i38 20146 44240991.745996 343 120 0 0 0.000000 0.000000 0.000000
[1960741.276882] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.276883] 0
[1960741.276884] /
[1960741.276884] qemu-system-i38 6928 45182827.395454 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276888] qemu-system-i38 6932 45182839.465263 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276892] qemu-system-i38 6935 45182851.525865 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276896] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.276897] qemu-system-i38 6937 45182863.544659 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276901] qemu-system-i38 6939 45183925.166581 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276905] qemu-system-i38 6943 45183937.234296 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276908] qemu-system-i38 6947 45183949.300672 1 120
[1960741.276911] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.276913] 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276915] qemu-system-i38 6955 45183987.168431 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276918] qemu-system-i38 6958 45183999.256824 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276922] kworker/3:1 20431 45239314.962844 42978 120
[1960741.276925] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.276926] 0 0 0.000000 0.000000 0.000000
[1960741.276928] 0 /
[1960741.276929] kworker/3:2 13278 45231182.473379 8 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.276934] cpu#4, 2400.164 MHz
[1960741.276935] .nr_running : 0
[1960741.276937] .load : 0
[1960741.276938] .nr_switches : 1403931534
[1960741.276939] .nr_load_updates : 184290790
[1960741.276940] .nr_uninterruptible : 570198
[1960741.276941] .next_balance : 4785.072876
[1960741.276943] .curr->pid : 0
[1960741.276944] .clock : 1960741276.157628
[1960741.276945] .cpu_load[0] : 0
[1960741.276946] .cpu_load[1] : 0
[1960741.276947] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.276949] .cpu_load[2] : 0
[1960741.276950] .cpu_load[3] : 0
[1960741.276951] .cpu_load[4] : 0
[1960741.276952]
cfs_rq[4]:/
[1960741.276954] .exec_clock : 0.000000
[1960741.276955] .MIN_vruntime : 0.000001
[1960741.276956] .min_vruntime : 43080567.084700
[1960741.276957] .max_vruntime : 0.000001
[1960741.276958] .spread : 0.000000
[1960741.276959] .spread0 : 15504869.646311
[1960741.276961] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.276962] .nr_spread_over : 0
[1960741.276963] .nr_running : 0
[1960741.276965] .load : 0
[1960741.276966] .runnable_load_avg : 0
[1960741.276967] .blocked_load_avg : 4
[1960741.276968] .tg_load_contrib : 4
[1960741.276969] .tg_runnable_contrib : 15
[1960741.276970] .tg_load_avg : 928
[1960741.276971] .tg->runnable_avg : 779
[1960741.276972] .avg->runnable_avg_sum : 719
[1960741.276973] .avg->runnable_avg_period : 46209
[1960741.276975] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.276976]
rt_rq[4]:
[1960741.276977] .rt_nr_running : 0
[1960741.276980] .rt_throttled : 0
[1960741.276983] .rt_time : 0.000000
[1960741.276986] .rt_runtime : 950.000000
[1960741.276988]
runnable tasks:
task PID tree-key switches prio exec-runtime sum-exec sum-sleep
----------------------------------------------------------------------------------------------------------
[1960741.276990] rcu_sched 7 43080555.249395 83791697 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277009] watchdog/4 26 -8.990452 490183 0
[1960741.277016] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277021] 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277035] migration/4 27 0.000000 4445 0 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277057] ksoftirqd/4 28 43080384.468894 915231 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277078] kworker/4:0H 30 53.349792 6 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277093] kswapd0 61 43079530.230785 145891 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277097] md1_raid1 177 43080557.127584 68963912 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277101] edac-poller 315 62.191849 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277104] kworker/4:1H 325 43080472.425110 1518485 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277108] rpc.idmapd 1690 332.637959 6 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277112] cron 1691 43076838.040472 49753 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277116] xl 13527 43061886.841565 812 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277120] xl 13528 43061886.861429 1575 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277124] qemu-system-i38 8486 43080555.114213 7399 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277127] qemu-system-i38 20155 41156199.772010 17 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277131] qemu-system-i38 20158 41227456.902638 1126 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277134] qemu-system-i38 739 43080550.077547 26898 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277139] kworker/4:0 10137 43080531.802169 1270 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277142] bash 12362 43080550.083527 3316 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277146] kworker/4:1 13548 43074120.465985 290 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277151] cpu#5, 2400.164 MHz
[1960741.277152] .nr_running : 3
[1960741.277153] .load : 2048
[1960741.277154] .nr_switches : 130760309
[1960741.277155] .nr_load_updates : 28073280
[1960741.277156] .nr_uninterruptible : 42007
[1960741.277158] .next_balance : 4785.072905
[1960741.277159] .curr->pid : 13183
[1960741.277160] .clock : 1960741274.033518
[1960741.277161] .cpu_load[0] : 209
[1960741.277162] .cpu_load[1] : 148
[1960741.277163] .cpu_load[2] : 89
[1960741.277164] .cpu_load[3] : 49
[1960741.277165] .cpu_load[4] : 27
[1960741.277166]
cfs_rq[5]:/
[1960741.277168] .exec_clock : 0.000000
[1960741.277169] .MIN_vruntime : 41384730.482736
[1960741.277170] .min_vruntime : 41384741.814536
[1960741.277171] .max_vruntime : 41384730.482736
[1960741.277172] .spread : 0.000000
[1960741.277173] .spread0 : 13809044.376147
[1960741.277174] .nr_spread_over : 0
[1960741.277175] .nr_running : 2
[1960741.277177] .load : 2048
[1960741.277178] .runnable_load_avg : 209
[1960741.277179] .blocked_load_avg : 0
[1960741.277180] .tg_load_contrib : 209
[1960741.277181] .tg_runnable_contrib : 212
[1960741.277182] .tg_load_avg : 928
[1960741.277183] .tg->runnable_avg : 779
[1960741.277184] .avg->runnable_avg_sum : 9949
[1960741.277185] .avg->runnable_avg_period : 47835
[1960741.277186]
rt_rq[5]:
[1960741.277187] .rt_nr_running : 0
[1960741.277188] .rt_throttled : 0
[1960741.277189] .rt_time : 0.000000
[1960741.277191] .rt_runtime : 950.000000
[1960741.277192]
runnable tasks:
task PID tree-key switches prio exec-runtime sum-exec sum-sleep
----------------------------------------------------------------------------------------------------------
[1960741.277194] watchdog/5 31 -8.990992 490183 0 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277198] migration/5 32 0.000000 1154137 0 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277202] ksoftirqd/5 33 41384726.327381 3154036 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277205] kworker/5:0H 35 570.361912 6 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277209] ipv6_addrconf 71 23.050913 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277213] deferwq 73 47.130752 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277216] ata_sff 123 247.085805 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277221] kworker/5:1H 260 41384609.306536 31804 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277225] kdmflush 404 865.369411 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277228] bioset 408 877.397381 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277232] bioset 411 885.417520 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277235] nfsiod 1667 5153.671486 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277239] rpc.statd 1678 6659.265847 10 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277243] xenconsoled 2323 41380079.975097 3506 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277247] qemu-system-i38 18239 24174017.855983 161 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277250] qemu-system-i38 18240 6248264.336214 2 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277254] qemu-system-i38 26751 34249120.227128 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277258] qemu-system-i38 20152 40356620.261991 35 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277262] qemu-system-i38 6929 41333922.270063 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277265] qemu-system-i38 6933 41333934.387391 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277269] qemu-system-i38 6936 41333946.447342 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277272] qemu-system-i38 6940 41334348.852450 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277279] qemu-system-i38 6944 41334360.970884 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277301] qemu-system-i38 6948 41334373.090653 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277322] qemu-system-i38 6952 41335372.155742 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277343] qemu-system-i38 6956 41335384.284957 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277365] qemu-system-i38 6959 41335396.307527 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277376] kworker/5:2 12517 41384730.482736 39766 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277379] R bash 13183 41384741.707999 347 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277383] kworker/5:1 13557 41371707.974861 3 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277387] kworker/u16:1 14817 41384721.684408 6873 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277392] cpu#6, 2400.164 MHz
[1960741.277393] .nr_running : 1
[1960741.277394] .load : 1024
[1960741.277395] .nr_switches : 1886726660
[1960741.277396] .nr_load_updates : 209683126
[1960741.277397] .nr_uninterruptible : 122973
[1960741.277399] .next_balance : 4785.072904
[1960741.277400] .curr->pid : 267
[1960741.277401] .clock : 1960741273.992918
[1960741.277402] .cpu_load[0] : 154
[1960741.277403] .cpu_load[1] : 97
[1960741.277404] .cpu_load[2] : 54
[1960741.277405] .cpu_load[3] : 28
[1960741.277406] .cpu_load[4] : 15
[1960741.277408] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277410]
cfs_rq[6]:/
[1960741.277412] .exec_clock : 0.000000
[1960741.277413] .MIN_vruntime : 0.000001
[1960741.277414] .min_vruntime : 54293429.537773
[1960741.277415] .max_vruntime : 0.000001
[1960741.277416] .spread : 0.000000
[1960741.277417] .spread0 : 26717732.099384
[1960741.277418] .nr_spread_over : 0
[1960741.277420] .nr_running : 1
[1960741.277421] .load : 1024
[1960741.277422] .runnable_load_avg : 154
[1960741.277423] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277424] .blocked_load_avg : 0
[1960741.277426] .tg_load_contrib : 154
[1960741.277427] .tg_runnable_contrib : 242
[1960741.277428] .tg_load_avg : 928
[1960741.277429] .tg->runnable_avg : 779
[1960741.277430] .avg->runnable_avg_sum : 11013
[1960741.277431] .avg->runnable_avg_period : 46577
[1960741.277432]
rt_rq[6]:
[1960741.277434] .rt_nr_running : 0
[1960741.277435] .rt_throttled : 0
[1960741.277436] .rt_time : 0.000000
[1960741.277437] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277439] .rt_runtime : 950.000000
[1960741.277440]
runnable tasks:
task PID tree-key switches prio exec-runtime sum-exec sum-sleep
----------------------------------------------------------------------------------------------------------
[1960741.277442] kthreadd 2 54292143.618414 30281 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277447] watchdog/6 36 -8.991061 490183 0 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277451]
[1960741.277452] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277454] migration/6 37 0.000000 4111 0 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277457] ksoftirqd/6 38 54293335.567287 977452 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277460] kworker/6:0H 40 106.586714 6 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277464]
[1960741.277466] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277467] xenbus 50 54283714.387390 12911 120
[1960741.277472] 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277473] scsi_eh_3 141 94.642527 14 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277478] Rsystemd-journal 267 54293425.534674 136316 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277482] systemd-udevd 281 54284001.717853 2268 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277485] kworker/6:1H 290 54292815.519280 1158201 100
[1960741.277488] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277490] 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277492] kpsmoused 388 297.076071 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277496] dbus-daemon 1698 54289467.665524 39699 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277499] rsyslogd 1704 54289769.032764 3306 120
[1960741.277502] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277504] 0 0 0.000000 0.000000 0.000000
[1960741.277505] 0 /
[1960741.277506] in:imuxsock 1709 54291384.186079 62281 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277510] acpid 1705 478.998503 10 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277513] munin-node 1712 54293383.344311 987537 120 0 0 0.000000 0.000000 0.000000
[1960741.277517] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277518] 0 /
[1960741.277520] agetty 1973 763.366712 10 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277524] vif5.0-q0-guest 18316 54293417.510020 336213723 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277527] xl 23191 54283718.894322 495 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277532] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277534] xl 23192 54283718.919824 1001 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277537] qemu-system-i38 26541 19832615.164477 224 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277542] kworker/6:0 10138 54293384.956305 2131 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277547] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277549] kworker/6:1 13549 54290130.606679 120 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277559] cpu#7, 2400.164 MHz
[1960741.277564] .nr_running : 0
[1960741.277569] .load : 0
[1960741.277575] .nr_switches : 186294874
[1960741.277579] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277582] .nr_load_updates : 68745901
[1960741.277587] .nr_uninterruptible : 37064
[1960741.277592] .next_balance : 4785.072873
[1960741.277597] .curr->pid : 0
[1960741.277603] .clock : 1960741266.306129
[1960741.277604] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277610] .cpu_load[0] : 0
[1960741.277615] .cpu_load[1] : 0
[1960741.277620] .cpu_load[2] : 0
[1960741.277625] .cpu_load[3] : 0
[1960741.277630] .cpu_load[4] : 0
[1960741.277631] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277638]
cfs_rq[7]:/
[1960741.277643] .exec_clock : 0.000000
[1960741.277647] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277651] .MIN_vruntime : 0.000001
[1960741.277656] .min_vruntime : 47556467.468207
[1960741.277661] .max_vruntime : 0.000001
[1960741.277663] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277669] .spread : 0.000000
[1960741.277674] .spread0 : 19980770.029818
[1960741.277676] .nr_spread_over : 0
[1960741.277677] .nr_running : 0
[1960741.277679] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277680] .load : 0
[1960741.277681] .runnable_load_avg : 0
[1960741.277683] .blocked_load_avg : 4
[1960741.277684] .tg_load_contrib : 4
[1960741.277685] .tg_runnable_contrib : 4
[1960741.277686] .tg_load_avg : 928
[1960741.277687] .tg->runnable_avg : 779
[1960741.277688] .avg->runnable_avg_sum : 195
[1960741.277689] .avg->runnable_avg_period : 46898
[1960741.277690]
rt_rq[7]:
[1960741.277692] .rt_nr_running : 0
[1960741.277693] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277694] .rt_throttled : 0
[1960741.277696] .rt_time : 0.000000
[1960741.277697] .rt_runtime : 950.000000
[1960741.277698]
runnable tasks:
task PID tree-key switches prio exec-runtime sum-exec sum-sleep
----------------------------------------------------------------------------------------------------------
[1960741.277701] systemd 1 47556455.668824 253780 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277705] watchdog/7 41 -8.991854 490183 0 0 0 0.000000 0.000000 0.000000
[1960741.277709] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277710] 0 /
[1960741.277711] migration/7 42 0.000000 1302200 0 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277715] ksoftirqd/7 43 47556455.584045 3554714 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277719] kworker/7:0H 45 1105.532708 6 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277723] khelper 46 11.021284 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277726] netns 48 35.148863 2 100
[1960741.277729] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277730] 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277732] xenwatch 49 47548883.443188 5912 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277737] poll_0_status 160 629.597085 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277741] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277742] md 172 687.220414 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277746] bioset 176 712.724984 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277750] bioset 181 748.927229 2 100 0 0 0.000000 0.000000 0.000000
[1960741.277753] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277755] 0 /
[1960741.277756] kdmflush 198 847.971881 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277760] bioset 199 860.004677 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277763] kdmflush 205 885.666940 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277767] bioset 206 897.700373 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277771]
[1960741.277772] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277773] ext4-rsv-conver 229 968.223059 2 100
[1960741.277778] 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277779] kauditd 262 1053.411296 2 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277783] kworker/7:1H 271 47549633.541118 28087 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277787] kdmflush 407 1756.451159 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277792]
[1960741.277792] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277794] kdmflush 410 1764.501082 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277797] bioset 419 1777.864996 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277801] kdmflush 421 1789.899365 2 100 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277804] bioset 422 1801.925998 2 100
[1960741.277807] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277809] 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277811] agetty 1975 9194.033187 7 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277815] qemu-system-i38 3268 2227003.776826 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277819] qemu-system-i38 26547 30784775.609842 15 120
[1960741.277822] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277823] 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277826] qemu-system-i38 20153 46527567.572801 35 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277830] qemu-system-i38 6930 47508481.912498 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277833] qemu-system-i38 6934 47508494.051706 1 120
[1960741.277836] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277837] 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277839] qemu-system-i38 6941 47508762.751080 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277843] qemu-system-i38 6945 47508774.819249 1 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277847] qemu-system-i38 6953 47509373.932740 1 120 0 0 0.000000 0.000000 0.000000
[1960741.277850] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
[1960741.277851] 0 /
[1960741.277853] kworker/7:0 19087 47556456.056524 41079 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277857] kworker/7:2 14806 47549190.060810 10 120 0 0 0.000000 0.000000 0.000000 0 /
[1960741.277864] systemd-journald[267]: /dev/kmsg buffer overrun, some messages lost.
More information about the Pkg-ganeti-devel
mailing list