Bug#855895: lvm2: lvchange while raid1 conversion active causes instant and serious loss of whole device
Marc Lehmann
debian-reportbug at plan9.de
Wed Feb 22 23:26:12 UTC 2017
Package: lvm2
Version: 2.02.168(2) (2016-11-30)
Severity: critical
Justification: causes serious data loss
Dear Maintainer,
I just lost the root filesystem on one of my boxes within a few seconds by
converting an existing LV to raid1 type and then trying to set writemostly
behaviour on the origin disk. The fs is now completey corrupted and I have
very limited logs, but I will try to splice together what happened in the
hope of this being useful to replicate and fix the issue.
I might also note that I didn't lose the actual data, as I have a complete
backup, so I got away with having some hours of extra work and a reboot
(which unfortunately involves a lot of manual steps...), but I think this
is very unexpected behaviour and can result in very serious data loss.
Basically, the following sequence of commands trashed the fs.
First convert an existing linear lv on sda to raid1. The only allocatable
space was on sdb:
# lvconvert --type raid1 --mirrors 1 vg_fuji/root
All ok till here, and then about 40 seconds later I entered this, which
apparently triggered the destruction:
# lvchange --writemostly /dev/sda2 vg_fuji/root
Logical volume vg_fuji/root changed.
I skimmed the manpage and tried again (this probably didn't make it worse):
# lvchange --writemostly /dev/sda2 vg_fuji/root
Logical volume vg_fuji/root changed.
And then a few seconds later, btrfs complained about corruption in the
kernel log, and...
# df -h /
-bash: /bin/df: Input/output error
I had dstat running concurrently (see "appendix"), so I have a good idea
of what happened. Immediately after the lvconvert, I had lots of read I/O
from the existing lv on sda2, and the same amount of write activity on
sdb2, which is the only device where the mirror could be created. When
I issued the lvchange command, the I/O direction suddenly changed - it
started reading from the new device, writing back to the old device.
The time between commands was long enough to copy about 1.2GB at 30MB/s,
and since the root device is 15GB large, it's absolutely impossible that
the whole device was mirrored fully before lvm/md started "syncing" back.
The kernel log gives some more insights. It starts when I issued the
lvconvert, as I did dmesg -c before:
[ 7027.947881] async_tx: api initialized (async)
[ 7027.969794] md: raid6 personality registered for level 6
[ 7027.969801] md: raid5 personality registered for level 5
[ 7027.969803] md: raid4 personality registered for level 4
[ 7027.973665] device-mapper: raid: Loading target version 1.7.0
[ 7028.269268] device-mapper: raid: Superblocks created for new array
[ 7028.277085] md: raid1 personality registered for level 1
[ 7028.279282] md/raid1:mdX: not clean -- starting background reconstruction
[ 7028.279287] md/raid1:mdX: active with 2 out of 2 mirrors
[ 7028.279293] Choosing daemon_sleep default (5 sec)
[ 7028.279298] created bitmap (15 pages) for device mdX
[ 7028.335126] mdX: bitmap file is out of date, doing full recovery
[ 7028.342576] mdX: bitmap initialized from disk: read 1 pages, set 30720 of 30720 bits
[ 7028.354762] md: resync of RAID array mdX
[ 7028.354771] md: minimum _guaranteed_ speed: 1000 KB/sec/disk.
[ 7028.354775] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for resync.
[ 7028.354791] md: using 128k window, over a total of 15728640k.
Very likely, at this point I issued the lvchange:
[ 7067.066129] md/raid1:mdX: not clean -- starting background reconstruction
[ 7067.066136] md/raid1:mdX: active with 2 out of 2 mirrors
[ 7067.066303] created bitmap (15 pages) for device mdX
[ 7067.117388] md: mdX: resync interrupted.
[ 7067.182336] md: checkpointing resync of mdX.
[ 7067.238944] mdX: bitmap initialized from disk: read 1 pages, set 28390 of 30720 bits
[ 7067.253829] md: resync of RAID array mdX
[ 7067.253841] md: minimum _guaranteed_ speed: 1000 KB/sec/disk.
[ 7067.253843] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for resync.
[ 7067.253848] md: using 128k window, over a total of 15728640k.
The above seems to have been the point where data copy changed
direction. What follows is likely the result of my second lvchange
command:
[ 7086.544989] md/raid1:mdX: not clean -- starting background reconstruction
[ 7086.545000] md/raid1:mdX: active with 2 out of 2 mirrors
[ 7086.545177] created bitmap (15 pages) for device mdX
[ 7086.944772] md: mdX: resync interrupted.
[ 7086.946987] md: checkpointing resync of mdX.
[ 7101.047749] mdX: bitmap initialized from disk: read 1 pages, set 27932 of 30720 bits
[ 7101.780179] md: resync of RAID array mdX
[ 7101.780186] md: minimum _guaranteed_ speed: 1000 KB/sec/disk.
[ 7101.780188] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for resync.
[ 7101.780191] md: using 128k window, over a total of 15728640k.
And this is then btrfs starting to complain about corruption (I did a
scrub a few hours ago, and the fs was fine):
[ 7203.586793] BTRFS info (device dm-2): csum failed ino 354148 extent 5818155008 csum 1119649079 wanted 2440406057 mirror 0
[ 7203.587375] BTRFS info (device dm-2): csum failed ino 354148 extent 5818138624 csum 1119649079 wanted 2440406057 mirror 0
[ 7203.587903] BTRFS info (device dm-2): csum failed ino 354148 extent 5818138624 csum 1119649079 wanted 2440406057 mirror 1
[ 7203.588833] BTRFS info (device dm-2): csum failed ino 354148 extent 6623444992 csum 301513774 wanted 2440406057 mirror 2
At this point I couldn't run anything that wasn't already in the cache,
including btrfs, but I had a second root fs and with some LD_LIBRARY_PATH
magic I managed to start btrfs scrub ("for fun"), which complained with
thousands of corruption messages, e.g.:
[ 7247.050736] BTRFS info (device dm-2): csum failed ino 348114 extent 5812977664 csum 2495936305 wanted 2094823222 mirror 0
[ 7247.051595] BTRFS info (device dm-2): csum failed ino 348114 extent 5812977664 csum 2495936305 wanted 2094823222 mirror 1
[ 7247.052731] BTRFS info (device dm-2): csum failed ino 348114 extent 6618284032 csum 3008065880 wanted 2094823222 mirror 2
[...]
[ 7298.073308] BTRFS error (device dm-2): bdev /dev/mapper/cryptroot errs: wr 0, rd 171, flush 0, corrupt 8, gen 0
[ 7298.073531] BTRFS error (device dm-2): unable to fixup (regular) error at logical 33056243712 on dev /dev/mapper/cryptroot
[ 7298.074074] BTRFS error (device dm-2): unable to fixup (regular) error at logical 33069858816 on dev /dev/mapper/cryptroot
[ 7298.075649] BTRFS warning (device dm-2): checksum error at logical 33070219264 on dev /dev/mapper/cryptroot, sector 7492032: metadata leaf (level 0) in tree 5
[ 7298.075654] BTRFS warning (device dm-2): checksum error at logical 33070219264 on dev /dev/mapper/cryptroot, sector 7492032: metadata leaf (level 0) in tree 5
[ 7298.075659] BTRFS error (device dm-2): bdev /dev/mapper/cryptroot errs: wr 0, rd 171, flush 0, corrupt 9, gen 0
[ 7298.076033] BTRFS warning (device dm-2): checksum error at logical 33070284800 on dev /dev/mapper/cryptroot, sector 7492160: metadata leaf (level 0) in tree 5
[ 7298.076037] BTRFS warning (device dm-2): checksum error at logical 33070284800 on dev /dev/mapper/cryptroot, sector 7492160: metadata leaf (level 0) in tree 5
[ 7298.076040] BTRFS error (device dm-2): bdev /dev/mapper/cryptroot errs: wr 0, rd 171, flush 0, corrupt 10, gen 0
[ 7298.076134] BTRFS error (device dm-2): unable to fixup (regular) error at logical 33066762240 on dev /dev/mapper/cryptroot
[ 7298.076879] BTRFS error (device dm-2): unable to fixup (regular) error at logical 33070219264 on dev /dev/mapper/cryptroot
[ 7298.077253] BTRFS error (device dm-2): unable to fixup (regular) error at logical 33070284800 on dev /dev/mapper/cryptroot
[ 7298.178008] BTRFS error (device dm-2): bad tree block start 10966164392228822201 33042038784
[ 7298.179620] BTRFS error (device dm-2): bad tree block start 10966164392228822201 33042038784
[ 7298.212375] BTRFS error (device dm-2): bad tree block start 13163893123998496487 33042038784
My unscientific theory is that lvchange --writemostly will interrupt a
running background sync and start to sync the new, incomplete mirror back
to the original device, overwriting all data. Indeed, the new device was
zeroed out (blkdiscard on an ssd), and the original root fs device shows
(with xxd) all zeroes after the ~1.3gb mark.
This bugreport was written on another system but the lvm version is
correct (and should be current from stretch). The affected system is
running debian stretch last updated today except for the kernel, which
is 4.4.50 from kernel.org. The root fs lv is also luks-encrypted (i.e.
vg_fuji/root is encrypted and mounted as /dev/mapper/cryptroot).
The system stopped responding when I tried to get the lvm history, and
is now toast, so I only had the info I had onscreen at the time (dmesg,
dstat, command history).
"Appendix" with dstat output:
sda is the original device, sdb is the new mirror, and mmcblk0 is an
(unrelated) sdcard with a (rsync-)backup of the root fs.
This is before I ran lvconvert:
----total-cpu-usage---- --dsk/sda-----dsk/sdb---dsk/mmcblk0 -net/total- ---paging-- ---system--
usr sys idl wai hiq siq| read writ: read writ: read writ| recv send| in out | int csw
0 0 100 0 0 0| 0 0 : 0 0 : 0 0 | 265B 513B| 0 0 | 89 152
0 1 99 0 0 0| 0 0 : 0 0 : 0 0 | 132B 1087B| 0 0 | 65 97
0 0 100 0 0 0| 0 0 : 0 0 : 0 0 | 66B 378B| 0 0 | 31 36
0 1 99 0 0 0| 0 0 : 0 0 : 0 0 | 731B 713B| 0 0 | 150 185
0 0 100 0 0 0| 0 0 : 0 0 : 0 0 | 731B 713B| 0 0 | 80 99
0 1 98 1 0 0| 0 328k: 0 0 : 0 0 | 465B 579B| 0 0 | 282 546
0 0 98 2 0 0| 0 680k: 0 0 : 0 0 | 398B 585B| 0 0 | 194 311
0 0 100 0 0 0| 0 0 : 0 0 : 0 0 | 332B 519B| 0 0 | 56 78
around here I did the lvconvert, note the apparent mirroring from sda to sdb, as expected:
3 9 76 13 0 0| 397k 16k: 17k 16k: 0 0 | 265B 512B| 0 0 | 888 1770
2 8 39 51 0 1| 26M 601k:6144B 25M: 0 0 | 132B 527B| 0 0 |3713 7541
1 1 53 45 0 0| 31M 0 : 36k 31M: 0 0 | 132B 562B| 0 0 |4071 7893
0 1 99 0 0 0| 31M 0 : 0 31M: 0 0 | 66B 399B| 0 0 |3533 7811
0 4 93 0 0 3| 30M 0 : 0 30M: 0 0 | 66B 392B| 0 0 |4090 7420
0 4 95 0 0 1| 30M 0 : 0 30M: 0 0 | 66B 392B| 0 0 |4189 7492
0 5 95 0 0 0| 29M 8704B: 0 29M: 0 0 | 265B 525B| 0 0 |3907 7289
0 3 96 0 0 1| 30M 0 : 0 30M: 0 0 |1020B 963B| 0 0 |3655 7706
0 3 97 0 0 0| 30M 0 : 0 30M: 0 0 | 864B 797B| 0 0 |3728 7606
0 5 95 0 0 1| 30M 0 : 0 30M: 0 0 | 930B 864B| 0 0 |4189 7420
0 6 93 0 0 1| 30M 0 : 0 30M: 0 0 | 397B 822B| 0 0 |4206 7444
0 6 92 0 0 1| 30M 4608B: 0 30M: 0 0 | 132B 458B| 0 0 |4150 7174
0 7 91 0 0 3| 30M 0 : 0 30M: 0 0 | 132B 465B| 0 0 |3700 7590
1 1 98 0 0 0| 31M 0 : 0 31M: 0 0 | 132B 458B| 0 0 |3594 7844
0 2 98 0 0 0| 30M 0 : 0 30M: 0 0 | 66B 392B| 0 0 |4247 7532
0 7 93 0 0 1| 30M 0 : 0 30M: 0 0 | 132B 458B| 0 0 |4179 7451
1 2 97 0 0 1| 31M 4608B: 0 31M: 0 0 | 796B 1129B| 0 0 |3631 7784
1 5 94 0 0 1| 31M 0 : 0 31M: 0 0 | 66B 399B| 0 0 |3442 7913
0 2 98 0 0 0| 31M 0 : 0 31M: 0 0 | 66B 392B| 0 0 |3322 7820
0 2 98 0 0 0| 31M 0 : 0 31M: 0 0 | 132B 458B| 0 0 |4086 7549
0 1 98 0 0 1| 31M 0 : 0 31M: 0 0 | 66B 392B| 0 0 |3895 7547
0 1 99 0 0 0| 30M 8704B: 0 30M: 0 0 | 132B 458B| 0 0 |3813 7292
1 9 91 0 0 0| 31M 0 : 0 31M: 0 0 | 132B 465B| 0 0 |3301 7756
0 4 95 0 0 1| 30M 0 : 0 30M: 0 0 | 132B 458B| 0 0 |3546 7693
0 5 94 0 0 1| 30M 0 : 0 30M: 0 0 | 66B 392B| 0 0 |4029 7574
0 1 96 1 0 3| 31M 0 : 0 31M: 0 0 | 66B 392B| 0 0 |4139 7489
0 0 100 0 0 0| 31M 4608B: 0 31M: 0 0 | 66B 392B| 0 0 |3786 7515
0 5 92 1 0 2| 26M 992k: 0 27M: 0 0 |1196B 1001B| 0 0 |3591 7383
0 3 96 0 0 1| 31M 0 : 0 31M: 0 0 |1053B 666B| 0 0 |3624 7821
0 9 91 0 0 0| 30M 0 : 0 30M: 0 0 | 66B 392B| 0 0 |4044 7609
0 3 96 1 0 1| 30M 0 : 0 30M: 0 0 | 66B 392B| 0 0 |4220 7489
0 1 99 0 0 1| 30M 8704B: 0 30M: 0 0 | 864B 794B| 0 0 |4168 7253
1 3 95 0 0 1| 30M 0 : 0 30M: 0 0 | 731B 734B| 0 0 |3988 7671
1 3 95 0 0 1| 30M 0 : 0 30M: 0 0 | 731B 727B| 0 0 |3431 7711
1 3 93 0 0 3| 30M 0 : 0 30M: 0 0 | 799B 858B| 0 0 |3780 7709
0 5 93 0 0 3| 30M 0 : 0 30M: 0 0 |1494B 2125B| 0 0 |4237 7635
0 6 94 0 0 0| 30M 4608B: 0 30M: 0 0 | 940B 1270B| 0 0 |4070 7458
0 4 96 0 0 1| 30M 0 : 0 30M: 0 0 | 930B 965B| 0 0 |3068 7697
----total-cpu-usage---- --dsk/sda-----dsk/sdb---dsk/mmcblk0 -net/total- ---paging-- ---system--
usr sys idl wai hiq siq| read writ: read writ: read writ| recv send| in out | int csw
1 0 86 14 0 0| 29M 624k: 0 30M: 0 0 | 331B 609B| 0 0 |3416 7501
Around here I did lvchange, note the sudden reversal of reading from sdb
(mirror) and writing to sda (original device).
1 9 84 4 0 2| 26M 358k:2252k 26M: 0 0 | 664B 1425B| 0 0 |3111 7607
2 2 90 5 0 2|4608B 20M: 19M 516k: 0 0 | 396B 938B| 0 0 |3115 5387
0 4 96 0 0 0| 0 21M: 21M 0 : 0 0 | 132B 472B| 0 0 |2468 5512
0 2 96 0 0 2| 0 21M: 21M 0 : 0 0 | 132B 458B| 0 0 |2525 5549
0 1 98 0 0 2| 0 21M: 21M 0 : 0 0 | 66B 392B| 0 0 |2447 5497
0 1 97 1 0 2| 0 21M: 20M 4096B: 0 0 | 310B 650B| 0 0 |2695 5390
0 2 97 0 0 1| 0 20M: 21M 4608B: 0 0 | 66B 399B| 0 0 |3111 5255
0 2 95 0 0 3| 0 21M: 21M 0 : 0 0 | 66B 399B| 0 0 |3072 5367
0 1 89 10 0 0| 0 8256k:8192k 0 : 0 0 | 66B 392B| 0 0 |1209 2209
1 3 97 0 0 0| 0 14M: 14M 0 : 0 0 | 132B 458B| 0 0 |1985 3644
0 1 99 0 0 0| 0 10M: 10M 0 : 0 0 | 126B 434B| 0 0 |1094 2618
0 1 99 0 0 0| 0 2048k:2048k 4096B: 0 0 | 66B 392B| 0 0 | 240 439
0 0 95 5 0 0| 0 4608B: 0 512B: 0 0 | 66B 399B| 0 0 | 64 74
1 2 95 2 0 1| 0 14M: 14M 0 : 0 0 | 66B 392B| 0 0 |1797 3696
0 1 99 0 0 1| 0 15M: 15M 0 : 0 0 | 132B 458B| 0 0 |2259 3823
0 1 86 13 0 0| 0 12M: 12M 0 : 0 0 | 133B 392B| 0 0 |1439 3199
1 1 98 0 0 0| 0 5568k:5568k 4096B: 0 0 | 200B 630B| 0 0 | 928 1528
0 0 88 12 0 0| 0 2056k:2048k 4608B: 0 0 | 66B 399B| 0 0 | 247 435
1 2 52 45 0 0|4096B 3584B:4096B 563k: 0 0 | 199B 467B| 0 0 | 273 675
0 0 70 30 0 0|1536B 129k: 130k 512B: 0 0 | 132B 472B| 0 0 | 125 201
0 1 25 74 0 0| 512B 1988k: 512B 4096B: 0 0 | 132B 472B| 0 0 | 422 554
0 1 0 99 0 0| 0 8192B: 0 0 : 0 0 | 66B 406B| 0 0 | 128 123
0 0 0 100 0 0| 0 4608B: 0 13k: 0 0 | 66B 385B| 0 0 | 62 81
0 0 0 100 0 0| 0 124k: 0 0 : 0 0 | 66B 392B| 0 0 | 84 153
0 0 0 100 0 0| 0 8192B: 0 4096B: 0 0 | 66B 385B| 0 0 | 64 98
0 1 30 70 0 0| 0 124k: 0 512B: 0 0 | 66B 392B| 0 0 | 94 108
0 1 49 50 0 0| 0 8704B: 0 0 : 0 0 | 66B 392B| 0 0 | 125 133
0 0 47 53 0 0| 0 16k: 0 0 : 0 0 | 66B 385B| 0 0 | 68 82
0 0 50 50 0 0| 0 4096B: 0 0 : 0 0 | 66B 385B| 0 0 | 79 132
0 0 50 50 0 0| 0 16k: 0 0 : 0 0 | 66B 385B| 0 0 | 73 105
0 0 22 78 0 0| 0 4096B: 0 0 : 0 0 | 66B 385B| 0 0 | 64 67
0 1 49 50 0 0| 0 16k: 0 0 : 0 0 | 66B 385B| 0 0 | 116 120
0 0 50 50 0 0| 0 4096B: 0 0 : 0 0 | 66B 385B| 0 0 | 41 43
1 0 35 65 0 0| 0 240k: 0 0 : 0 0 | 156B 475B| 0 0 | 143 217
1 5 48 47 0 1|1536B 8704B:5632B 9216B: 0 0 | 66B 385B| 0 0 | 268 577
0 1 50 50 0 0| 0 389k: 0 776k: 0 0 | 66B 406B| 0 0 | 119 174
0 4 77 19 0 0|4608B 14M: 15M 445k: 0 0 | 462B 990B| 0 0 |1921 3863
0 0 99 0 0 1| 0 21M: 21M 0 : 0 0 | 66B 406B| 0 0 |2672 5502
1 4 95 0 0 1| 0 21M: 21M 0 : 0 0 | 192B 500B| 0 0 |3050 5512
0 2 98 0 0 0| 0 21M: 21M 4096B: 0 0 | 66B 392B| 0 0 |3031 5555
0 1 98 0 0 2| 0 21M: 21M 4608B: 0 0 | 66B 399B| 0 0 |3009 5211
0 4 95 0 0 1| 0 21M: 21M 0 : 0 0 | 192B 465B| 0 0 |3026 5455
1 3 96 0 0 1| 0 16M: 16M 0 : 0 0 |3176B 3250B| 0 0 |1846 4212
0 1 91 8 0 1| 0 12M: 12M 0 : 0 0 | 997B 861B| 0 0 |1546 3163
0 1 98 0 0 1| 0 6016k:6016k 0 : 0 0 | 597B 894B| 0 0 |1000 1663
----total-cpu-usage---- --dsk/sda-----dsk/sdb---dsk/mmcblk0 -net/total- ---paging-- ---system--
usr sys idl wai hiq siq| read writ: read writ: read writ| recv send| in out | int csw
0 2 91 7 0 0| 0 14M: 14M 4096B: 0 0 | 531B 661B| 0 0 |2114 3452
0 1 78 21 0 0| 0 4608B: 0 512B: 0 0 | 531B 1309B| 0 0 | 132 186
0 1 99 0 0 1| 0 18M: 18M 0 : 0 0 |1263B 995B| 0 0 |2493 4641
1 2 78 19 0 0| 0 1708k:1728k 704k: 0 0 | 466B 730B| 0 0 | 445 739
0 1 99 0 0 1| 0 7764k:7104k 0 : 0 0 | 463B 1173B| 0 0 |1108 2222
0 4 96 0 0 0| 0 21M: 21M 8704B: 0 0 | 132B 458B| 0 0 |2839 5229
0 4 95 0 0 1| 0 21M: 21M 0 : 0 0 | 132B 465B| 0 0 |3206 5430
0 0 100 0 0 0| 0 21M: 21M 0 : 0 0 | 66B 392B| 0 0 |3263 5519
0 3 96 0 0 1| 0 21M: 21M 0 : 0 0 | 132B 458B| 0 0 |3253 5541
1 1 97 0 0 1| 0 21M: 21M 0 : 0 0 | 132B 458B| 0 0 |2631 5512
0 1 98 0 0 1| 0 18M: 18M 4096B: 0 0 | 66B 392B| 0 0 |2681 4524
0 1 99 0 0 0| 0 4608B: 0 512B: 0 0 | 66B 399B| 0 0 | 110 129
0 1 99 0 0 0| 0 14M: 14M 0 : 0 0 | 66B 392B| 0 0 |2124 3569
1 1 98 0 0 1| 0 5504k:5504k 0 : 0 0 | 132B 458B| 0 0 | 711 1509
0 2 97 1 0 1| 0 20M: 20M 0 : 0 0 | 333B 670B| 0 0 |2974 5304
0 0 100 0 0 0| 0 196k: 192k 4096B: 0 0 | 66B 392B| 0 0 | 76 118
0 2 98 0 0 0| 0 11M: 11M 4608B: 0 0 | 66B 399B| 0 0 |1658 2686
0 3 97 0 0 1| 0 21M: 21M 0 : 0 0 | 397B 1107B| 0 0 |3117 5599
1 4 95 0 0 1| 0 21M: 21M 144k: 0 0 | 66B 392B| 0 0 |2772 5393
0 2 96 0 0 2| 0 21M: 21M 0 : 0 0 | 66B 399B| 0 0 |3249 5510
0 4 95 0 0 1| 0 21M: 21M 4096B: 0 0 | 132B 458B| 0 0 |3189 5478
0 2 47 51 0 1| 0 7528k:7168k 712k: 0 0 | 132B 465B| 0 0 |1215 2051
0 0 45 55 0 0| 0 2404k:2048k 8192B: 0 0 | 66B 399B| 0 0 | 344 543
0 0 50 50 0 0| 0 4096B: 0 512B: 0 0 | 132B 465B| 0 0 | 96 161
0 1 46 54 0 0| 0 73k: 64k 8192B: 0 0 | 66B 392B| 0 0 | 96 144
0 0 100 0 0 0| 0 320k: 320k 4096B: 0 0 | 132B 465B| 0 0 | 83 140
0 1 99 0 0 0| 0 7108k:7104k 0 : 0 0 | 66B 399B| 0 0 |1057 1897
0 0 100 0 0 0| 0 6528k:6528k 4096B: 0 0 | 132B 458B| 0 0 | 959 1513
0 1 99 0 0 0| 0 4608B: 0 512B: 0 0 | 66B 399B| 0 0 | 122 188
1 3 97 0 0 0| 0 13M: 13M 0 : 0 0 | 66B 392B| 0 0 |1370 3345
0 5 95 0 0 0| 0 14M: 14M 0 : 0 0 | 531B 659B| 0 0 |2247 3777
1 2 82 14 0 2| 0 14M: 14M 0 : 0 0 | 663B 1062B| 0 0 |2325 3909
0 1 99 0 0 0| 0 8192k:8256k 4096B: 0 0 | 731B 730B| 0 0 |1061 1999
1 0 90 9 0 0| 0 4608B: 0 512B: 0 0 | 465B 603B| 0 0 | 132 204
0 2 88 10 0 1| 0 14M: 14M 0 : 0 0 |1130B 928B| 0 0 |1711 3679
0 1 98 0 0 1| 0 9092k:9024k 4096B: 0 0 |1042B 986B| 0 0 |1298 2448
2 4 93 0 0 1| 0 21M: 21M 0 : 0 0 | 795B 1638B| 0 0 |3325 5648
0 0 99 0 0 1| 0 21M: 21M 4608B: 0 0 | 66B 392B| 0 0 |3130 5222
0 1 99 0 0 1| 0 21M: 21M 0 : 0 0 | 66B 399B| 0 0 |2941 5600
0 3 97 0 0 0| 0 21M: 21M 0 : 0 0 | 132B 458B| 0 0 |2631 5446
0 4 94 0 0 2| 0 21M: 21M 0 : 0 0 | 126B 434B| 0 0 |3206 5492
1 5 94 0 0 1| 0 21M: 21M 0 : 0 0 | 66B 392B| 0 0 |3220 5449
0 1 99 0 0 0| 0 12M: 12M 0 : 0 0 | 66B 392B| 0 0 |1891 3178
0 0 89 11 0 0| 0 2048k:2048k 4096B: 0 0 | 66B 392B| 0 0 | 269 478
0 1 99 0 0 0| 0 2181k:2112k 512B: 0 0 | 66B 399B| 0 0 | 394 651
0 3 97 0 0 1| 0 15M: 15M 4096B: 0 0 | 132B 465B| 0 0 |2322 3905
----total-cpu-usage---- --dsk/sda-----dsk/sdb---dsk/mmcblk0 -net/total- ---paging-- ---system--
usr sys idl wai hiq siq| read writ: read writ: read writ| recv send| in out | int csw
0 2 98 0 0 1| 0 4420k:4416k 0 : 0 0 | 132B 467B| 0 0 | 564 1321
0 2 98 0 0 0| 0 13M: 13M 0 : 0 0 | 132B 1101B| 0 0 |1400 3378
0 2 98 0 0 1| 0 8512k:8512k 248k: 0 0 | 132B 458B| 0 0 |1090 2433
1 0 100 0 0 0| 0 2176k:2048k 4608B: 0 0 | 132B 465B| 0 0 | 236 480
0 0 98 3 0 0| 0 125k: 0 0 : 0 0 | 66B 399B| 0 0 | 88 112
1 1 98 0 0 0| 0 3460k:3392k 4096B: 0 0 | 132B 451B| 0 0 | 616 999
0 2 88 10 0 0| 0 14M: 15M 0 : 0 0 | 132B 465B| 0 0 |1972 3765
0 2 96 0 0 2| 0 12M: 12M 0 : 0 0 | 156B 482B| 0 0 |1591 3250
0 0 98 2 0 0| 0 2052k:2048k 8704B: 0 0 | 66B 392B| 0 0 | 254 499
0 0 50 50 0 0| 0 4608B: 0 52k: 0 0 | 66B 399B| 0 0 | 64 83
0 1 43 57 0 0| 0 52k: 0 496k: 0 0 | 66B 392B| 0 0 | 109 121
0 0 29 71 0 0| 0 288k: 64k 4096B: 0 0 | 132B 458B| 0 0 | 73 94
0 0 50 50 0 1| 0 1072k: 0 0 : 0 0 | 126B 441B| 0 0 | 155 280
0 1 71 28 0 1| 0 9525k: 10M 17k: 0 0 | 66B 385B| 0 0 | 995 2419
0 4 95 0 0 2| 0 21M: 21M 0 : 0 0 | 66B 399B| 0 0 |2234 5464
0 4 95 0 0 1| 0 21M: 21M 0 : 0 0 | 66B 392B| 0 0 |3033 5471
0 3 95 0 0 3| 0 21M: 21M 0 : 0 0 | 66B 392B| 0 0 |3119 5463
0 2 98 0 0 1| 0 21M: 21M 0 : 0 0 | 66B 392B| 0 0 |2477 5578
0 1 98 0 0 1| 0 21M: 21M 4608B: 0 0 | 66B 392B| 0 0 |2387 5245
0 3 97 0 0 0| 0 21M: 21M 0 : 0 0 | 132B 465B| 0 0 |3211 5408
0 3 71 27 0 0| 0 6656k:6656k 0 : 0 0 | 132B 458B| 0 0 | 786 1753
0 0 97 3 0 0| 0 8192k:8192k 4096B: 0 0 | 267B 612B| 0 0 | 882 2117
0 1 99 0 0 0| 0 7556k:7552k 0 : 0 0 |1420B 2035B| 0 0 |1125 2304
0 2 97 0 0 2| 0 14M: 14M 4096B: 0 0 | 465B 696B| 0 0 |1714 3627
1 1 68 31 0 0| 0 4608B: 0 512B: 0 0 | 664B 1661B| 0 0 | 154 259
1 3 96 0 0 2| 0 13M: 13M 0 : 0 0 |1552B 2163B| 0 0 |1852 3437
0 1 99 0 0 0| 0 5696k:5696k 0 : 0 0 | 267B 593B| 0 0 | 906 1476
1 5 94 0 0 1| 0 21M: 21M 0 : 0 0 | 930B 2240B| 0 0 |3356 5763
0 1 99 0 0 0| 0 10M: 10M 0 : 0 0 | 66B 392B| 0 0 |1369 2700
0 1 98 0 0 1| 0 16M: 16M 4608B: 0 0 |1557B 2145B| 0 0 |1860 4096
0 4 95 0 0 1| 0 21M: 21M 0 : 0 0 | 599B 853B| 0 0 |2928 5486
0 1 99 0 0 0| 0 21M: 21M 4096B: 0 0 | 66B 392B| 0 0 |3243 5503
0 3 96 0 0 1| 0 21M: 21M 0 : 0 0 | 132B 465B| 0 0 |2581 5514
0 2 97 0 0 2| 0 21M: 21M 0 : 0 0 | 132B 458B| 0 0 |2502 5483
0 2 97 0 0 1| 0 21M: 21M 4608B: 0 0 | 66B 392B| 0 0 |2552 5236
0 3 96 0 0 1| 0 21M: 21M 0 : 0 0 | 66B 399B| 0 0 |3238 5488
0 1 80 20 0 1| 0 5760k:5760k 0 : 0 0 | 132B 458B| 0 0 | 903 1482
0 2 98 0 0 0| 0 13M: 13M 0 : 0 0 | 66B 392B| 0 0 |1715 3411
1 2 97 0 0 1| 0 14M: 14M 0 : 0 0 | 66B 392B| 0 0 |1697 3605
0 2 98 1 0 0| 0 7680k:7680k 0 : 0 0 | 132B 458B| 0 0 |1178 1976
0 1 99 0 0 0| 0 2885k:2880k 4608B: 0 0 | 66B 392B| 0 0 | 461 749
0 3 75 20 0 1| 0 8128k:8128k 0 : 0 0 | 199B 467B| 0 0 |1299 2262
1 3 91 6 0 0| 0 11M: 11M 4096B: 0 0 | 396B 1429B| 0 0 |1772 2997
1 1 75 23 0 1| 0 12M: 11M 660k: 0 0 | 66B 399B| 0 0 |1848 3195
0 1 98 0 0 1| 0 21M: 21M 0 : 0 0 | 332B 533B| 0 0 |3284 5522
0 4 94 0 0 2| 0 20M: 20M 4608B: 0 0 | 930B 860B| 0 0 |2870 5221
----total-cpu-usage---- --dsk/sda-----dsk/sdb---dsk/mmcblk0 -net/total- ---paging-- ---system--
usr sys idl wai hiq siq| read writ: read writ: read writ| recv send| in out | int csw
-- System Information:
Debian Release: 8.5
APT prefers stable
APT policy: (990, 'stable'), (500, 'unstable'), (500, 'testing'), (1, 'experimental')
Architecture: amd64 (x86_64)
Foreign Architectures: i386
Kernel: Linux 4.4.50-fuji (SMP w/2 CPU cores)
Locale: LANG=C, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/bash
Init: systemd (via /run/systemd/system)
-- Configuration Files:
/etc/lvm/lvm.conf changed [not included]
-- debconf information:
lvm2/kernel:
lvm2/snapshots:
More information about the pkg-lvm-maintainers
mailing list