Bug#740701: multipath-tools: mkfs fails "Add. Sense: Incompatible medium installed"

[Hans van Kranenburg]

On 06/23/2014 01:30 AM, Hans van Kranenburg wrote:
>
> If there's no obvious way to be found to trigger the same error in the
> test environment, I think I'm going to propose to trigger the same again
> while having the test physical server attached to the production luns.
>  From the past occurance, I know that if the only thing that breaks is
> the storage connection on the physical server that executes the UNMAP.
> It's still not the most reassuring choice, but a kind of a calculated risk.
>
> If that's possible I can do a couple of tcpdumps on the iscsi and
> blktrace dumps to capture what's going on and post them here. Doing so
> will prove whether the SCSI error was actually being sent by the NetApp
> device or not.

And that's what I just did, together with a colleague of mine. On one 
lun, the NetApp box accepts unmap, on another lun it throws up with 
Incompatible Medium Installed. All other iSCSI connections from other 
physical servers to the same production lun are not impacted, only the 
connection to this server.

10G are the test luns, 5.0T are the prod luns on either of the two 
controllers:

# multipath -ll
mpathb (360a9800042577239353f4532614a6339) dm-4 NETAPP,LUN
size=10G features='1 queue_if_no_path' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=0 status=active
   |- 50:0:0:1 sdq 65:0  active ready running
   |- 49:0:0:1 sdp 8:240 active ready running
   |- 47:0:0:1 sdk 8:160 active ready running
   `- 48:0:0:1 sdo 8:224 active ready running
mpatha (360a9800042576c32412b4532614a6750) dm-2 NETAPP,LUN
size=10G features='1 queue_if_no_path' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=0 status=active
   |- 43:0:0:1 sdc 8:32  active ready running
   |- 45:0:0:1 sdf 8:80  active ready running
   |- 46:0:0:1 sdh 8:112 active ready running
   `- 44:0:0:1 sdj 8:144 active ready running
mpath_scylla1 (360a9800042576c32412b4532614a674e) dm-1 NETAPP,LUN
size=5.0T features='1 queue_if_no_path' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=0 status=active
   |- 43:0:0:0 sdb 8:16  active ready running
   |- 44:0:0:0 sdd 8:48  active ready running
   |- 45:0:0:0 sde 8:64  active ready running
   `- 46:0:0:0 sdg 8:96  active ready running
mpath_scylla0 (360a9800042577239353f4532614a6337) dm-3 NETAPP,LUN
size=5.0T features='1 queue_if_no_path' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=0 status=active
   |- 47:0:0:0 sdi 8:128 active ready running
   |- 50:0:0:0 sdn 8:208 active ready running
   |- 49:0:0:0 sdm 8:192 active ready running
   `- 48:0:0:0 sdl 8:176 active ready running

/mnt/discard 0-# dd if=/dev/zero of=bla bs=1G count=1
1+0 records in
0+0 records out
1021984768 bytes (1.0 GB) copied, 4.29729 s, 238 MB/s
/mnt/discard 0-# sync
/mnt/discard 0-# rm bla
/mnt/discard 0-# sync
/mnt/discard 0-# fstrim -v -o 0MB -l 512MB ./
./: 494333952 bytes were trimmed


/mnt/prodlv 0-# dd if=/dev/zero of=bla bs=1G count=1
1+0 records in
1+0 records out
1073741824 bytes (1.1 GB) copied, 4.47536 s, 240 MB/s
/mnt/prodlv 0-# sync
/mnt/prodlv 0-# rm bla
/mnt/prodlv 0-# sync
/mnt/prodlv 0-# fstrim -v -o 0MB -l 512MB ./
^C^C^C^C

When executing on the test lun, fstrim succeeds.
When executing on the production lun, the error occurs.

tcpdump files of iSCSI traffic (showing traffic on 4 separate paths in 2 
multipath groups to 2 IP addresses) are attached. They can be viewed 
with e.g. wireshark.

-- 
Hans van Kranenburg - System / Network Engineer
+31 (0)10 2760434 | hans.van.kranenburg at mendix.com | www.mendix.com
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 740701-iSCSI-tcpdump.zip
Type: application/zip
Size: 140142 bytes
Desc: not available
URL: <http://lists.alioth.debian.org/pipermail/pkg-lvm-maintainers/attachments/20140623/bf7a16ec/attachment-0001.zip>