Your message dated Sat, 11 Aug 2018 21:37:23 +0200
with message-id <20180811193723.tp3f7jcaa2mab...@percival.namespace.at>
and subject line Re: #843953: multipath-tools: LVM on internal disks +
multipath-toosl = no multipaths
has caused the Debian Bug report #843953,
regarding multipath-tools: LVM on internal disks + multipath-toosl = no
to be marked as done.
This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.
(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact ow...@bugs.debian.org
Debian Bug Tracking System
Contact ow...@bugs.debian.org with problems
--- Begin Message ---
* What led up to the situation?
Upgrade working wheezy system to jessie
Apply patch to fix multipath segfault, see #751993
The system boots off an internal physical disk
That disk has one / partition and an LVM partition
/usr is one of the LVs on that disk
There are two other internal disks, LVM is not used on these.
The multipath devices are connected via a qlogic ISP2432-based card,
through a FC switch to two Promise VTrak units.
LVM is not used on the multipath devices.
* What exactly did you do (or not do) that was effective (or
Cold-plug FC connection to external storage, boot system.
* What was the outcome of this action?
multipath -l shows no devices. no related device maps in /dev/mapper.
The FC and SCSI layers all worked fine, I see lots of /dev/sdX devices.
multipath -l -v3 shows the /dev/sdX devices as blacklisted
sdd: blacklisted, udev property missing
sde: blacklisted, udev property missing
sdp: blacklisted, udev property missing
* What outcome did you expect instead?
usable multipaths to the configured devices
/dev/mapper populated, including kpartx partitions
On some reboots the system log shows multipath timing out. Below is 'sdd'.
The timeout occurs 33 seconds after the disk was attached.
I was unable to determine the cause of this or reproduce consistently.
Nov 11 11:11:53 kernel: sd 1:0:0:4: [sdd] 25769805824 512-byte logical
blocks: (13.1 TB/12.0 TiB)
Nov 11 11:11:53 kernel: sd 1:0:0:4: [sdd] Write Protect is off
Nov 11 11:11:53 kernel: sd 1:0:0:4: [sdd] Mode Sense: 97 00 10 08
Nov 11 11:11:53 kernel: sd 1:0:0:4: [sdd] Write cache: enabled, read cache:
enabled, supports DPO and FUA
Nov 11 11:11:53 kernel: sdd: sdd1
Nov 11 11:11:53 kernel: sd 1:0:0:4: [sdd] Attached SCSI disk
Nov 11 11:12:25 systemd-udevd: timeout '/sbin/multipath -v0 /dev/sdd'
Nov 11 11:12:26 systemd-udevd: timeout: killing '/sbin/multipath -v0
Nov 11 11:12:26 systemd-udevd: '/sbin/multipath -v0 /dev/sdd' 
terminated by signal 9 (Killed)
On some reboots, there was a bad interaction between LVM and multipathd
and/or udev. On the console systemd showed it was waiting for tasks to
complete for both of these.
device-mapper would try to handle the multipath devices before the LVM
ones, which sometimes caused the system to fail to boot; it went into
I was unable to determine the cause of this or reproduce it consistently.
I don't know where the multipath-tools-boot line comes from, that
package is not even installed.
You can however see the two running contemporaneously
# journalctl |egrep -i -e '(multipath|lvm|-udev)'
Nov 11 16:52:57 systemd: Starting LVM2 metadata daemon socket.
Nov 11 16:52:57 systemd: Listening on LVM2 metadata daemon socket.
Nov 11 16:52:57 systemd-udevd: starting version 215
Nov 11 16:52:58 systemd: Starting LSB: early multipath boot script...
Nov 11 16:52:58 kernel: device-mapper: multipath: version 1.7.0 loaded
Nov 11 16:52:59 multipath-tools-boot: Discovering and coalescing
Nov 11 16:52:59 systemd: Started LSB: early multipath boot script.
Nov 11 16:52:59 systemd: Starting system-lvm2\x2dpvscan.slice.
Nov 11 16:52:59 systemd: Created slice system-lvm2\x2dpvscan.slice.
Nov 11 16:52:59 systemd: Starting LVM2 PV scan on device 8:2...
Nov 11 16:52:59 systemd: Starting Activation of LVM2 logical volumes...
Nov 11 16:52:59 systemd: Started LVM2 PV scan on device 8:2.
Nov 11 16:52:59 lvm: 10 logical volume(s) in volume group "testbox" now
Nov 11 16:53:00 systemd: Started Activation of LVM2 logical volumes.
Nov 11 16:53:00 systemd: Starting Activation of LVM2 logical volumes...
Nov 11 16:53:01 lvm: 10 logical volume(s) in volume group "testbox" now
Nov 11 16:53:01 systemd: Started Activation of LVM2 logical volumes.
Nov 11 16:53:01 systemd: Starting Monitoring of LVM2 mirrors, snapshots
etc. using dmeventd or progress polling...
Nov 11 16:53:01 lvm: 10 logical volume(s) in volume group "testbox"
Nov 11 16:53:01 systemd: Started Monitoring of LVM2 mirrors, snapshots
etc. using dmeventd or progress polling.
Nov 11 16:53:09 systemd: Starting LSB: multipath daemon...
Nov 11 16:53:10 multipath-tools: Starting multipath daemon: multipathd.
Nov 11 16:53:10 systemd: Started LSB: multipath daemon.
Nov 11 16:53:10 multipathd: path checkers start up
First I applied the patch discussed in #799781 (shared lock with udev).
This didn't fix things but may have helped.
Then after reviewing #782487, I built sg3-utils v1.42 and installed it,
including sg3-utils-udev. This got the system working.
hot-plugging the fibre doesn't work properly but that will have to wait
for another bug.
I reverted the shared lock patch, to test if that is essential.
It appears not - I was able to boot the system fine as long as I
had the sg3-utils packages installed. Nonetheless it seems worth
including it as I did notice that multipath-tools and LVM were
trying to do things at the same time (systemd was waiting for both).
Notice also the dm ordering:
# dmsetup ls |sort -t: -k2,2 -n |column -t
Can we please have sg3-utils v1.42 added to a stable point release?
Also multipath-tools needs to depend on sg3-utils-udev.
It seems a shame to not include the shared lock patch as it avoids
a known deadlock and the system still works fine with it included.
-- Package-specific info:
Contents of /etc/multipath.conf:
getuid_callout "/lib/udev/scsi_id --whitelisted
--replace-whitespace --device /dev/%n"
path_selector "round-robin 0"
features "1 queue_if_no_path"
product_blacklist "VTrak V-LUN"
-- System Information:
Debian Release: 8.6
APT prefers stable
APT policy: (990, 'stable')
Architecture: amd64 (x86_64)
Kernel: Linux 3.16.0-4-amd64 (SMP w/12 CPU cores)
Locale: LANG=en_AU.UTF-8, LC_CTYPE=en_AU.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)
Versions of packages multipath-tools depends on:
ii initscripts 2.88dsf-59
ii kpartx 0.5.0-6+deb8u2
ii libaio1 0.3.110-1
ii libc6 2.19-18+deb8u6
ii libdevmapper1.02.1 2:1.02.90-2.2+deb8u1
ii libgcc1 1:4.9.2-10
ii libreadline6 6.3-8+b3
ii libudev1 215-17+deb8u5
ii lsb-base 4.1+Debian13+nmu1
ii udev 215-17+deb8u5
multipath-tools recommends no packages.
Versions of packages multipath-tools suggests:
pn multipath-tools-boot <none>
-- no debconf information
--- End Message ---
--- Begin Message ---
The versions and bug history imply that this is only relevant to
oldstable, and we cannot push fixes there anymore.
If the problem persists in stretch and/or buster, please reopen
--- End Message ---