As far as I know this bug is not related to bcache. I included this piece of information for completness.<br/>
<br/>
The bug is that all partition are tagged SYSTEMD_READY=0 which prevents systemd from mounting the bare ones. That is the dm, bcache and raid ones are fine. <br/>
But I cannot move /boot/efi to lvm thus I cannot fix boot out of modifying multipath configuration.<br/>
<br/>
This since the introduction of <a href="http://60-multipath.rules">60-multipath.rules</a> the 25th of match.<br/>
Mind this might be a local issue as I do not know if /etc/multipath/wwids is supposed to list all disks as it was here. Emptying it fixes boot.<br/>
<br/>
If I remove the multipath udev rules that tags all my partitions as SYSTEMD_READY=0 systemd manage to boot.<br/>
<br/>
Best regards<br/>
Alban<br/>
<br/>
<font color="#888888"><font color="#888888">Envoyé depuis mon appareil Android.</font></font><br/>
<br/>
<font color="#888888">-----Original Message-----</font><br/>
<font color="#888888">From: Ritesh Raj Sarraf <</font><font color="#888888"><a href="mailto:rrs@debian.org">rrs@debian.org</a></font><font color="#888888">></font><br/>
<font color="#888888">To: Alban Browaeys <</font><font color="#888888"><a href="mailto:prahal@yahoo.com">prahal@yahoo.com</a></font><font color="#888888">>, </font><font color="#888888"><a href="mailto:859156@bugs.debian.org">859156@bugs.debian.org</a></font><br/>
<font color="#888888">Sent: ven., 31 mars 2017 10:41</font><br/>
<font color="#888888">Subject: Re: Bug#859156: multipath-tools: boot ends in rescue mode - boot partition marked as systemd_ready=0</font><br/>
<br/>
<font color="#888888">Control: tag -1 +moreinfo</font><br/>
<br/>
<br/>
<font color="#888888">Hello Alban,</font><br/>
<br/>
<br/>
<font color="#888888">Thanks for the bug report.</font><br/>
<br/>
<font color="#888888">On Fri, 2017-03-31 at 05:55 +0200, Alban Browaeys wrote:</font><br/>
<font color="#888888">> Package: multipath-tools</font><br/>
<font color="#888888">> Version: 0.6.4-5</font><br/>
<font color="#888888">> Severity: normal</font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">> systemd at bootup mounts / and /home both lvm2 logical volumes above</font><br/>
<font color="#888888">> bcache0 physical volume. But then it timeout waiting for /boot and</font><br/>
<font color="#888888">> /boot/efi device UUIDs... and fallbacks to the rescue shell.</font><br/>
<font color="#888888">> </font><br/>
<br/>
<font color="#888888">I haven't worked of bcache so far, so please bear with my questions.</font><br/>
<br/>
<font color="#888888">> </font><br/>
<font color="#888888">> I flushed all entries from /etc/multipath/wwids (after backing it up)</font><br/>
<font color="#888888">> and now all is fine.</font><br/>
<font color="#888888">> Leaving the above entries there and commenting out </font><font color="#888888"><a href="http://60-multipath.rules">60-multipath.rules</a></font><font color="#888888"> the code</font><br/>
<font color="#888888">> which sets SYSTEMD_READ=0 also let me boot properly.</font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">> From tests, where sda7 is /boot a "bare metal" partition:</font><br/>
<font color="#888888">> sudo sh -c "env - SEQNUM="1" ACTION="add" $(udevadm info -x /dev/sda7|sed -n</font><br/>
<font color="#888888">> '/^E:/ { s@E: \(.*\)=\(.*\)@\1="\2"@p }' | tr '\n' ' ' ) /sbin/multipath</font><br/>
<font color="#888888">> -u /dev/sda7; ";echo $?</font><br/>
<font color="#888888">> with wwids cleanup up I get:</font><br/>
<font color="#888888">> /dev/sda7 is not a valid multipath device path</font><br/>
<font color="#888888">> 1</font><br/>
<font color="#888888">> but with wwids restored:</font><br/>
<font color="#888888">> sda7 is a valid multipath device path</font><br/>
<font color="#888888">> 0</font><br/>
<font color="#888888">> thus SYSTEMD_READY="0" and DM_MULTIPATH_DEVICE_PATH="1" are both set.</font><br/>
<font color="#888888">> Thus systemd waits and timeout bringing the /boot device unit (then the mount</font><br/>
<font color="#888888">> unit fails</font><br/>
<font color="#888888">> because of dependency to this device unit).</font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">> Configuration is a bit uncommon:</font><br/>
<font color="#888888">> /boot and /boot/efi on sda<n> partitions</font><br/>
<font color="#888888">> bcache (backing and caching devices are sda<n> partition and sdb disk)</font><br/>
<font color="#888888">> is an lvm2 physical volume, above that are mostly root / and /home</font><br/>
<font color="#888888">> logical volumes.</font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">> </font><br/>
<br/>
<br/>
<font color="#888888">From your report so far, here's what I understand.</font><br/>
<br/>
<font color="#888888">bcache is stacked directly on top of physical SCSI block device.</font><br/>
<font color="#888888">A Device Mapper Physical Volume is created on top of the bcache based enumerated</font><br/>
<font color="#888888"> device.</font><br/>
<font color="#888888">LVM linear </font><font color="#888888">targets</font><font color="#888888"> are </font><font color="#888888">created</font><font color="#888888"> on top of the </font><font color="#888888">DM</font><font color="#888888"> </font><font color="#888888">Physical</font><font color="#888888"> device.</font><br/>
<br/>
<font color="#888888">This is </font><font color="#888888">so</font><font color="#888888">.</font><br/>
<br/>
<font color="#888888">In which layer is multipath involved ?</font><br/>
<font color="#888888">Or is your bug report about multipath misbehaving in this setup ? But I still</font><br/>
<font color="#888888">don't see where </font><font color="#888888">exactly</font><font color="#888888"> are </font><font color="#888888">multipath</font><font color="#888888"> </font><font color="#888888">targets</font><font color="#888888"> </font><font color="#888888">involved</font><font color="#888888"> in this setup.</font><br/>
<br/>
<font color="#888888">bcache that is not </font><font color="#888888">involved</font><font color="#888888">. Multipath udev rules are.</font><br/>
<br/>
<font color="#888888">> This is pretty serious an issue (fail to boot) though I have been unable to</font><br/>
<font color="#888888">> sort out</font><br/>
<font color="#888888">> if the wwids file entries I cleanup were a local issue, another package issue</font><br/>
<font color="#888888">> or added by multipathd itself.</font><br/>
<font color="#888888">> They were not restored after reboot.</font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">> Best regards</font><br/>
<font color="#888888">> Alban</font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">> PS: mind my current is a local binnmu per I fixed a locking bug in</font><br/>
<font color="#888888">> uev_update_path when called</font><br/>
<font color="#888888">> by udev. This should not relate to this issue. Pending another bug report.</font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">> -- Package-specific info:</font><br/>
<font color="#888888">> /etc/</font><font color="#888888"><a href="http://multipath.conf">multipath.conf</a></font><font color="#888888"> does not exist.</font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">> -- System Information:</font><br/>
<font color="#888888">> Debian Release: 9.0</font><br/>
<font color="#888888">> APT prefers unstable-debug</font><br/>
<font color="#888888">> APT policy: (500, 'unstable-debug'), (500, 'unstable'), (500, 'testing'),</font><br/>
<font color="#888888">> (1, 'experimental-debug'), (1, 'experimental')</font><br/>
<font color="#888888">> Architecture: amd64 (x86_64)</font><br/>
<font color="#888888">> Foreign Architectures: i386</font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">> Kernel: Linux 4.10.0-trunk-amd64 (SMP w/4 CPU cores)</font><br/>
<font color="#888888">> Locale: LANG=fr_</font><font color="#888888"><a href="http://FR.UTF">FR.UTF</a></font><font color="#888888">-8, LC_CTYPE=fr_</font><font color="#888888"><a href="http://FR.UTF">FR.UTF</a></font><font color="#888888">-8 (charmap=UTF-8)</font><br/>
<font color="#888888">> Shell: /bin/sh linked to /bin/dash</font><br/>
<font color="#888888">> Init: systemd (via /run/systemd/system)</font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">> Versions of packages multipath-tools depends on:</font><br/>
<font color="#888888">> ii init-system-helpers 1.47</font><br/>
<font color="#888888">> ii kpartx 0.6.4-5.1</font><br/>
<font color="#888888">> ii libaio1 0.3.110-3</font><br/>
<font color="#888888">> ii libc6 2.24-9</font><br/>
<font color="#888888">> ii libdevmapper1.02.1 2:1.02.137-2</font><br/>
<font color="#888888">> ii librados2 10.2.5-6</font><br/>
<font color="#888888">> ii libreadline7 7.0-2</font><br/>
<font color="#888888">> ii libsystemd0 232-22</font><br/>
<font color="#888888">> ii libudev1 232-22</font><br/>
<font color="#888888">> ii liburcu4 0.9.3-3</font><br/>
<font color="#888888">> ii lsb-base </font><font color="#888888"><a href="tel:920161125">9.20161125</a></font><br/>
<font color="#888888">> ii sg3-utils-udev 1.42-2</font><br/>
<font color="#888888">> ii udev 232-22</font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">> multipath-tools recommends no packages.</font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">> Versions of packages multipath-tools suggests:</font><br/>
<font color="#888888">> ii multipath-tools-boot 0.6.4-5.1</font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">> -- no debconf information</font><br/>
<font color="#888888">> </font><br/>
<font color="#888888">-- </font><br/>
<font color="#888888">Ritesh Raj Sarraf | </font><font color="#888888"><a href="http://people.debian.org/~rrs">http://people.debian.org/~rrs</a></font><br/>
<font color="#888888">Debian - The Universal Operating System</font>