Bug#529876: lvm2: pvmove lost my full lv (bad interaction with kvm ?)

[Vincent Danjean]

  Hi,

Alasdair G Kergon wrote:
> For pvmove completing when it hadn't actually moved, you need a bug fix:
>     Fix pvmove to revert operation if temporary mirror creation fails.
> which is in 2.02.47 upstream that I'll be releasing in a few hours.
> (It's actually in 2.02.46 I released the other day, but I've withdrawn that
> release due to a build bug.)

  Glad to know this bug will be fixed :-)

> On Fri, May 22, 2009 at 01:49:09AM +0200, Vincent Danjean wrote:
>>     Removing temporary pvmove LV
> 
> This step probably failed - I don't know why - can you check your
> kernel messages log for any device-mapper errors during this period?
> 
> Typically something like udev might have been holding onto the device
> preventing its removal.  We need to improve our logging messages so
> that they tell us about these problems.

I've a few logs on the host machine. But, as I said in my initial report,
the device (PV and the LV in it) contains only a ext3 FS with very few files.
However, two of theses files were disk images for two running kvm (virtual)
machines.

Here are the relevent logs I have in /var/log/syslog (dm-1 was the LV
on the PV I tried to move):
May 22 00:33:26 aya kernel: [84740.882402] device-mapper: table: 253:1: linear: dm-linear: Device lookup failed
May 22 00:33:26 aya kernel: [84740.882453] device-mapper: ioctl: error adding target to table
[...]
May 22 00:40:29 aya kernel: [85164.276120] attempt to access beyond end of device
May 22 00:40:29 aya kernel: [85164.276125] dm-1: rw=0, want=13108585144, limit=19529728
[...]
May 22 00:47:18 aya kernel: [85572.764165] EXT3-fs error (device dm-1): htree_dirblock_to_tree: bad entry in directory #2: directory entry across blocks - offset=0, inode=4294967295, rec_len=65536, name_len=255
May 22 00:47:34 aya kernel: [85589.092525] EXT3-fs error (device dm-1): htree_dirblock_to_tree: bad entry in directory #2: directory entry across blocks - offset=0, inode=4294967295, rec_len=65536, name_len=255
May 22 00:47:46 aya kernel: [85600.986601] EXT3-fs error (device dm-1): htree_dirblock_to_tree: bad entry in directory #2: directory entry across blocks - offset=0, inode=4294967295, rec_len=65536, name_len=255
May 22 00:48:57 aya kernel: [85672.183028] attempt to access beyond end of device
May 22 00:48:57 aya kernel: [85672.183033] dm-1: rw=0, want=5462874352, limit=19529728
May 22 00:48:57 aya kernel: [85672.183037] attempt to access beyond end of device
May 22 00:48:57 aya kernel: [85672.183040] dm-1: rw=0, want=5462874352, limit=19529728
May 22 00:49:09 aya kernel: [85683.975770] attempt to access beyond end of device
May 22 00:49:09 aya kernel: [85672.183040] dm-1: rw=0, want=5462874352, limit=19529728
[and then, more and more identical lines (about 30 per seconde) until I reboot]
May 22 00:51:02 aya kernel: [85796.603342] attempt to access beyond end of device
May 22 00:51:02 aya kernel: [85796.603347] dm-1: rw=0, want=24441388824, limit=19529728
May 22 00:52:47 aya kernel: imklog 3.18.6, log source = /proc/kmsg started.
May 22 00:52:47 aya rsyslogd: [origin software="rsyslogd" swVersion="3.18.6" x-pid="3439" x-info="http://www.rsyslog.com"] restart
May 22 00:52:47 aya kernel: [    0.000000] Initializing cgroup subsys cpuset
May 22 00:52:47 aya kernel: [    0.000000] Initializing cgroup subsys cpu
May 22 00:52:47 aya kernel: [    0.000000] Linux version 2.6.29-2-amd64 (Debian 2.6.29-5) (waldi at debian.org) (gcc version 4.3.3 (Debian 4.3.3-10) ) #1
 SMP Sun May 17 17:15:47 UTC 2009
[...]

  Regards,
    Vincent