[ofa-general] ***SPAM*** SRP Initiator port -> SRP Target port mismatch?

[Shipman, Galen M.]

My setup is as follows:

I have 4 ports on a DDN, each port has 2 LUNs mapped to it.
I have 4 ports active on the SRP initiator machine. I want to do a one to
one mapping of SRP initiator ports to SRP target ports. All ports are
connected via a switch.


Here are the 4 ports as seen by SRP:

[lce2 ~] $  /usr/sbin/ibsrpdm -cd /dev/infiniband/umad0 |
/bin/sed 's/pkey/max_sect=16384,max_cmd_per_lun=6,pkey/'
id_ext=25000001ff040528,ioc_guid=25000001ff040528,dgid=fe8000000000000025000
001ff040528,max_sect=16384,max_cmd_per_lun=6,pkey=ffff,service_id=280504ff01
000025
id_ext=27000001ff040528,ioc_guid=27000001ff040528,dgid=fe8000000000000027000
001ff040528,max_sect=16384,max_cmd_per_lun=6,pkey=ffff,service_id=280504ff01
000027
id_ext=21000001ff0404ec,ioc_guid=21000001ff0404ec,dgid=fe8000000000000021000
001ff0404ec,max_sect=16384,max_cmd_per_lun=6,pkey=ffff,service_id=ec0404ff01
000021
id_ext=23000001ff0404ec,ioc_guid=23000001ff0404ec,dgid=fe8000000000000023000
001ff0404ec,max_sect=16384,max_cmd_per_lun=6,pkey=ffff,service_id=ec0404ff01
000023


I add one of the above SRP target ports to an SRP initiator port:

echo 
id_ext=25000001ff040528,ioc_guid=25000001ff040528,dgid=fe8000000000000025000
001ff040528,max_sect=16384,max_cmd_per_lun=6,pkey=ffff,service_id=280504ff01
000025 > /sys/class/infiniband_srp/srp-mthca0-1/add_target



Unfortunately this results in the device showing up on BOTH ports on the SRP
initiator's HCA0: 

find /sys/class/infiniband_srp/srp-mthca*/device/host*/target*/*/block -ls
31820    0 lrwxrwxrwx   1 root     root            0 Oct 12 17:19
/sys/class/infiniband_srp/srp-mthca0-1/device/host24/target24:0:0/24:0:0:4/b
lock -> ../../../../../../../block/sdb
 31869    0 lrwxrwxrwx   1 root     root            0 Oct 12 17:19
/sys/class/infiniband_srp/srp-mthca0-1/device/host24/target24:0:0/24:0:0:6/b
lock -> ../../../../../../../block/sdc
 31820    0 lrwxrwxrwx   1 root     root            0 Oct 12 17:19
/sys/class/infiniband_srp/srp-mthca0-2/device/host24/target24:0:0/24:0:0:4/b
lock -> ../../../../../../../block/sdb
 31869    0 lrwxrwxrwx   1 root     root            0 Oct 12 17:19
/sys/class/infiniband_srp/srp-mthca0-2/device/host24/target24:0:0/24:0:0:6/b
lock -> ../../../../../../../block/sdc


Note that I added the SRP  target only to srp-mthca0-1, but it now shows up
under both srp-mthca0-1 and srp-mthca0-2.
This is not what I want, I want to ensure that data written to say /dev/sdb
always goes over srp_mthca0-1 and NOT srp_mthca0-2.

Any ideas on what is going on here? I am new to SRP so I may be missing
something very trivial here.

Thanks,

Galen