[ofw] SRP debugging level

John Carbone john-carbone at quantum-logic.com
Mon Nov 25 14:47:28 PST 2013


Hi all,

We tried a different SRP target with the same results, the initiator
fails to enumerate the targets.

Any help at all would be greatly appreciated. Thank you.

Here is the disk detail:

DISKPART> select disk 3
Disk 3 is now the selected disk.
DISKPART> detail disk
SCST_FIO disk0 SCSI Disk Device
Disk ID: 00000000
Type   : FIBRE
Status : Offline (Policy)
Path   : 0
Target : 0
LUN ID : 0
Location Path : UNAVAILABLE
Current Read-only State : Yes
Read-only  : Yes
Boot Disk  : No
Pagefile Disk  : No
Hibernation File Disk  : No
Crashdump Disk  : No
Clustered Disk  : No
There are no volumes.

Here is the registry:
 
Windows Registry Editor Version 5.00
[HKEY_LOCAL_MACHINE\HARDWARE\DEVICEMAP\Scsi\Scsi Port 6]
"Dma64BitAddresses"=dword:00000001
"Driver"="ibsrp"
[HKEY_LOCAL_MACHINE\HARDWARE\DEVICEMAP\Scsi\Scsi Port 6\Scsi Bus 0]
[HKEY_LOCAL_MACHINE\HARDWARE\DEVICEMAP\Scsi\Scsi Port 6\Scsi Bus
0\Initiator Id 255]
[HKEY_LOCAL_MACHINE\HARDWARE\DEVICEMAP\Scsi\Scsi Port 6\Scsi Bus
0\Target Id 0]
[HKEY_LOCAL_MACHINE\HARDWARE\DEVICEMAP\Scsi\Scsi Port 6\Scsi Bus
0\Target Id 0\Logical Unit Id 0]
"InquiryData"=hex:00,00,05,02,3d,00,10,02,53,43,53,54,5f,46,49,4f,64,69,
73,6b,\
  30,20,20,20,20,20,20,20,20,20,20,20,20,32,32,30
"SerialNumber"="ab5f2545"
"Identifier"="SCST_FIOdisk0            220"
"DeviceType"="DiskPeripheral"
"DeviceIdentifierPage"=hex:00,83,00,2e,02,01,00,16,53,43,53,54,5f,46,49,
4f,61,\
 
62,35,66,32,35,34,35,2d,64,69,73,6b,30,01,14,00,04,00,00,00,01,01,02,00,
08,\
  61,62,35,66,32,35,34,35


-----Original Message-----
From: John Carbone 
Sent: Saturday, November 23, 2013 9:20 PM
To: John Carbone; Tzachi Dar; Leonid Keller; ofw at lists.openfabrics.org
Subject: RE: [ofw] SRP debugging level

The ioc_guid's are uniquely listed, and I would guess that there should
be a unique target ID for each, for example, here is one of the targets:

# stmfadm list-target -v
Target: eui.0002C9030059337C
    Operational Status: Online
    Provider Name     : srpt
    Alias             : -
    Protocol          : SRP
    Sessions          : 5

-----Original Message-----
From: ofw-bounces at lists.openfabrics.org
[mailto:ofw-bounces at lists.openfabrics.org] On Behalf Of John Carbone
Sent: Saturday, November 23, 2013 8:16 PM
To: Tzachi Dar; Leonid Keller; ofw at lists.openfabrics.org
Subject: Re: [ofw] SRP debugging level

Thanks! That made all the difference. The logs are so huge I don't know
what is relevant. I pasted 3 parts I thought looked interesting. I
appears that the SRP driver is indeed seeing the three separate targets:

00000742 26.69642830 __srp_dump_ioc_info(): Dumping IOC Info
00000743 26.69643211 __srp_dump_ioc_info():  chassis_guid =
0x2c903002b1559
00000744 26.69643593 __srp_dump_ioc_info():  chassis_slot = 0
00000745 26.69643974 __srp_dump_ioc_info():  iou_guid = 0x2c903002b1556
00000746 26.69644356 __srp_dump_ioc_info():  iou_slot = 1 
00000747 26.69644737 __srp_dump_ioc_info():   
00000748 26.69645119 __srp_dump_ioc_info(): Dumping IOC Info Profile
00000749 26.69645500 __srp_dump_ioc_info():  ioc_guid = 0x2c903002b1556
00000750 26.69645882 __srp_dump_ioc_info():  vend_id = 0x15b300
00000751 26.69646263 __srp_dump_ioc_info():  dev_id = 0x673c
00000752 26.69646835 __srp_dump_ioc_info():  dev_ver = 0xb0
00000753 26.69647217 __srp_dump_ioc_info():  subsys_vend_id = 0x15b300
00000754 26.69647598 __srp_dump_ioc_info():  subsys_id = 0x0
00000755 26.69647980 __srp_dump_ioc_info():  io_class = 0x100
00000756 26.69648170 __srp_dump_ioc_info():  io_subclass = 0x690e
00000757 26.69648552 __srp_dump_ioc_info():  protocol = 0x108
00000758 26.69649124 __srp_dump_ioc_info():  protocol_ver = 0x1
00000759 26.69649506 __srp_dump_ioc_info():  send_msg_depth = 128
00000760 26.69649887 __srp_dump_ioc_info():  rdma_read_depth = 16
00000761 26.69650459 __srp_dump_ioc_info():  send_msg_size = 4160
00000762 26.69650841 __srp_dump_ioc_info():  rdma_size  = 65536
00000763 26.69651031 __srp_dump_ioc_info():  ctrl_ops_cap = 0xD4
00000764 26.69651413 __srp_dump_ioc_info():  num_svc_entries = 0x1
00000765 26.69651794 __srp_dump_ioc_info():  id_string = Solaris SRP
Target 0.9a
00000766 26.69652557 __srp_validate_ioc() !ERROR!: Not an SRP
PROTOCOL/PROTOCOL_VER. 
00000767 26.69653702 __srp_pnp_cb(): p_pnp_rec->pnp_event = 0x1808
(IB_PNP_IOC_PATH_ADD)
00000768 26.69654274 __srp_pnp_cb(): IB_PNP_IOC_PATH_ADD (slid:0x1
dlid:0x4) for Solaris SRP Target 0.9a. 
00000769 26.69655418 __srp_add_path(): Current Path count for Solaris
SRP Target 0.9a = 1
00000770 26.69656181 __srp_connect_path(): Searching for path to Solaris
SRP Target 0.9a. 
00000771 26.69657707 __srp_connect_sessions(): Attempting to connect
Solaris SRP Target 0.9a. Svc Idx 0; Connection Attempt Count = 1. 
00000772 26.69658470 [AL]ib_open_ca() !ERROR!: ib_open_ca: open  CA
00000773 26.69659615 [AL]init_al_obj() !ERROR!: init_al_obj: init CA
ASYNCHRONICALLY, obj state 1
00000774 26.70417976 __srp_issue_session_login() !ERROR!:
(init_to_targ_iu_sz requested)  req_max_iu_msg_size 4160, (from profile)
ioc_max_send_msg_size 4160
00000775 26.70679665 __srp_cm_reply_cb(): Request Limit = 128, SendQ
Depth = 128, RecvQDepth = 128, ItoT size = 4160, TtoI size = 4160, Max
S/G = 255
00000776 26.70687294 __srp_cm_reply_cb(): Cannot Modify Send Completion
Queue Depth. Status = 10
00000777 26.70687866 __srp_cm_reply_cb(): Cannot Modify Recv Completion
Queue Depth. Status = 10
00000778 26.70731163 __srp_connect_path(): Path to Solaris SRP Target
0.9a has connected.
 
 
 
00001010 26.74258423 __srp_dump_ioc_info(): Dumping IOC Info
00001011 26.74258995 __srp_dump_ioc_info():  chassis_guid =
0x2c903002b179d
00001012 26.74259377 __srp_dump_ioc_info():  chassis_slot = 0
00001013 26.74259758 __srp_dump_ioc_info():  iou_guid = 0x2c903002b179a
00001014 26.74260139 __srp_dump_ioc_info():  iou_slot = 1 
00001015 26.74260521 __srp_dump_ioc_info():   
00001016 26.74260712 __srp_dump_ioc_info(): Dumping IOC Info Profile
00001017 26.74261284 __srp_dump_ioc_info():  ioc_guid = 0x2c903002b179a
00001018 26.74261665 __srp_dump_ioc_info():  vend_id = 0x15b300
00001019 26.74262047 __srp_dump_ioc_info():  dev_id = 0x673c
00001020 26.74262428 __srp_dump_ioc_info():  dev_ver = 0xb0
00001021 26.74263000 __srp_dump_ioc_info():  subsys_vend_id = 0x15b300
00001022 26.74263191 __srp_dump_ioc_info():  subsys_id = 0x0
00001023 26.74263573 __srp_dump_ioc_info():  io_class = 0x100
00001024 26.74263954 __srp_dump_ioc_info():  io_subclass = 0x690e
00001025 26.74264336 __srp_dump_ioc_info():  protocol = 0x108
00001026 26.74264717 __srp_dump_ioc_info():  protocol_ver = 0x1
00001027 26.74265289 __srp_dump_ioc_info():  send_msg_depth = 128
00001028 26.74265671 __srp_dump_ioc_info():  rdma_read_depth = 16
00001029 26.74265862 __srp_dump_ioc_info():  send_msg_size = 4160
00001030 26.74266434 __srp_dump_ioc_info():  rdma_size  = 65536
00001031 26.74266815 __srp_dump_ioc_info():  ctrl_ops_cap = 0xD4
00001032 26.74267197 __srp_dump_ioc_info():  num_svc_entries = 0x1
00001033 26.74267578 __srp_dump_ioc_info():  id_string = Solaris SRP
Target 0.9a
00001034 26.74268150 __srp_validate_ioc() !ERROR!: Not an SRP
PROTOCOL/PROTOCOL_VER. 
00001035 26.74269676 __srp_pnp_cb(): p_pnp_rec->pnp_event = 0x1808
(IB_PNP_IOC_PATH_ADD)
00001036 26.74270248 __srp_pnp_cb(): IB_PNP_IOC_PATH_ADD (slid:0x1
dlid:0x3) for Solaris SRP Target 0.9a. 
00001037 26.74271393 __srp_add_path(): Current Path count for Solaris
SRP Target 0.9a = 1
00001038 26.74271965 __srp_connect_path(): Searching for path to Solaris
SRP Target 0.9a. 
00001039 26.74273872 __srp_connect_sessions(): Attempting to connect
Solaris SRP Target 0.9a. Svc Idx 0; Connection Attempt Count = 1. 
00001040 26.74274635 [AL]ib_open_ca() !ERROR!: ib_open_ca: open  CA
00001041 26.74275970 [AL]init_al_obj() !ERROR!: init_al_obj: init CA
ASYNCHRONICALLY, obj state 1
00001042 26.75138855 __srp_issue_session_login() !ERROR!:
(init_to_targ_iu_sz requested)  req_max_iu_msg_size 4160, (from profile)
ioc_max_send_msg_size 4160
00001043 26.75385666 __srp_cm_reply_cb(): Request Limit = 128, SendQ
Depth = 128, RecvQDepth = 128, ItoT size = 4160, TtoI size = 4160, Max
S/G = 255
00001044 26.75392532 __srp_cm_reply_cb(): Cannot Modify Send Completion
Queue Depth. Status = 10
00001045 26.75392914 __srp_cm_reply_cb(): Cannot Modify Recv Completion
Queue Depth. Status = 10
00001046 26.75439262 __srp_connect_path(): Path to Solaris SRP Target
0.9a has connected.
 
 

00001277 26.79562187 __srp_dump_ioc_info(): Dumping IOC Info
00001278 26.79562569 __srp_dump_ioc_info():  chassis_guid =
0x2c9030059337f
00001279 26.79562950 __srp_dump_ioc_info():  chassis_slot = 0
00001280 26.79563522 __srp_dump_ioc_info():  iou_guid = 0x2c9030059337c
<--- here
00001281 26.79563904 __srp_dump_ioc_info():  iou_slot = 1 
00001282 26.79564285 __srp_dump_ioc_info():   
00001283 26.79564667 __srp_dump_ioc_info(): Dumping IOC Info Profile
00001284 26.79565048 __srp_dump_ioc_info():  ioc_guid = 0x2c9030059337c
<--- here
00001285 26.79566383 __srp_dump_ioc_info():  vend_id = 0x15b300
00001286 26.79566765 __srp_dump_ioc_info():  dev_id = 0x673c
00001287 26.79567146 __srp_dump_ioc_info():  dev_ver = 0xb0
00001288 26.79567528 __srp_dump_ioc_info():  subsys_vend_id = 0x15b300
00001289 26.79567719 __srp_dump_ioc_info():  subsys_id = 0x0
00001290 26.79568291 __srp_dump_ioc_info():  io_class = 0x100
00001291 26.79568672 __srp_dump_ioc_info():  io_subclass = 0x690e
00001292 26.79569054 __srp_dump_ioc_info():  protocol = 0x108
00001293 26.79569626 __srp_dump_ioc_info():  protocol_ver = 0x1
00001294 26.79570007 __srp_dump_ioc_info():  send_msg_depth = 128
00001295 26.79570389 __srp_dump_ioc_info():  rdma_read_depth = 16
00001296 26.79570580 __srp_dump_ioc_info():  send_msg_size = 4160
00001297 26.79571152 __srp_dump_ioc_info():  rdma_size  = 65536
00001298 26.79571533 __srp_dump_ioc_info():  ctrl_ops_cap = 0xD4
00001299 26.79571915 __srp_dump_ioc_info():  num_svc_entries = 0x1
00001300 26.79572487 __srp_dump_ioc_info():  id_string = Solaris SRP
Target 0.9a
00001301 26.79572868 __srp_validate_ioc() !ERROR!: Not an SRP
PROTOCOL/PROTOCOL_VER. 
00001302 26.79574013 __srp_pnp_cb(): p_pnp_rec->pnp_event = 0x1808
(IB_PNP_IOC_PATH_ADD)
00001303 26.79574585 __srp_pnp_cb(): IB_PNP_IOC_PATH_ADD (slid:0x1
dlid:0xd) for Solaris SRP Target 0.9a. 
00001304 26.79575729 __srp_add_path(): Current Path count for Solaris
SRP Target 0.9a = 1
00001305 26.79576111 __srp_connect_path(): Searching for path to Solaris
SRP Target 0.9a. 
00001306 26.79578209 __srp_connect_sessions(): Attempting to connect
Solaris SRP Target 0.9a. Svc Idx 0; Connection Attempt Count = 1. 
00001307 26.79578781 [AL]ib_open_ca() !ERROR!: ib_open_ca: open  CA
00001308 26.79580116 [AL]init_al_obj() !ERROR!: init_al_obj: init CA
ASYNCHRONICALLY, obj state 1
00001309 26.80298805 __srp_issue_session_login() !ERROR!:
(init_to_targ_iu_sz requested)  req_max_iu_msg_size 4160, (from profile)
ioc_max_send_msg_size 4160
00001310 26.80540085 __srp_cm_reply_cb(): Request Limit = 128, SendQ
Depth = 128, RecvQDepth = 128, ItoT size = 4160, TtoI size = 4160, Max
S/G = 255
00001311 26.80547142 __srp_cm_reply_cb(): Cannot Modify Send Completion
Queue Depth. Status = 10
00001312 26.80547905 __srp_cm_reply_cb(): Cannot Modify Recv Completion
Queue Depth. Status = 10
00001313 26.80590057 __srp_connect_path(): Path to Solaris SRP Target
0.9a has connected.

-----Original Message-----
From: Tzachi Dar [mailto:tzachid at mellanox.com]
Sent: Saturday, November 23, 2013 10:40 AM
To: John Carbone; Leonid Keller; ofw at lists.openfabrics.org
Subject: RE: SRP debugging level

Did you use chk builds for srp? prints will only happen for debug
drivers.

Thanks
Tzachi
________________________________________
From: ofw-bounces at lists.openfabrics.org
[ofw-bounces at lists.openfabrics.org] on behalf of John Carbone
[john-carbone at quantum-logic.com]
Sent: Friday, November 22, 2013 3:37 PM
To: Leonid Keller; ofw at lists.openfabrics.org
Subject: Re: [ofw] SRP debugging level

Hi Leonid,

I have to ask for your patience, as I'm not at all a windows developer
and have no familiarity with WinDbg, so I may not be doing this
correctly.

When I attach to the kernel in WinDbg, this is output:
Microsoft (R) Windows Debugger Version 6.12.0002.633 AMD64 Copyright (c)
Microsoft Corporation. All rights reserved.
Connected to Windows 7 7601 x64 target at (Fri Nov 22 08:08:41.274 2013
(UTC - 5:00)), ptr64 TRUE Symbol search path is:
SRV*c:\WINDOWS\symbols*http://msdl.microsoft.com/download/symbols
Executable search path is:
Windows 7 Kernel Version 7601 (Service Pack 1) MP (8 procs) Free x64
Product: Server, suite: TerminalServer SingleUserTS Built by:
7601.18113.amd64fre.win7sp1_gdr.130318-1533
Machine Name:
Kernel base = 0xfffff800`01804000 PsLoadedModuleList =
0xfffff800`01a47670 Debug session time: Fri Nov 22 08:08:41.960 2013
(UTC - 5:00) System Uptime: 0 days 0:10:02.022

Here is a part of ntbtlog:
...
Loaded driver \SystemRoot\System32\drivers\tcpipreg.sys
Loaded driver \SystemRoot\System32\DRIVERS\srv2.sys
Loaded driver \SystemRoot\system32\DRIVERS\ibiou.sys
Loaded driver \SystemRoot\system32\DRIVERS\ibsrp.sys
...


From: Leonid Keller [mailto:leonid at mellanox.com]
Sent: Friday, November 22, 2013 3:52 AM
To: John Carbone; ofw at lists.openfabrics.org
Subject: RE: SRP debugging level

Don't you see the debug output in windbg ?

From: John Carbone [mailto:john-carbone at quantum-logic.com]
Sent: Friday, November 22, 2013 12:14 AM
To: Leonid Keller; ofw at lists.openfabrics.org
Subject: RE: SRP debugging level

Hi all,

I downloaded and installed WinDbg, set the debug level to 4, set
"bcdedit /debug on" and rebooted  but I do not know where to locate the
debug output. I cannot determine if the targets are being enumerated and
just not being reported to windows.

However, I tried setting one of the LUNs on the SAN filer to 1, and
Windows maps the drive correctly every time now. So, I suspect that
because the diskpart  is reporting that all the targets are zero Window
is indeed getting confused as to which drive is which as I had
suspected.

Leonid, is this something you could please help with?

From: Leonid Keller [mailto:leonid at mellanox.com]
Sent: Wednesday, November 20, 2013 10:55 AM
To: John Carbone; ofw at lists.openfabrics.org
Subject: RE: SRP debugging level

Did you try to install checked drivers and look into debug prints ?
(DbgView or Windbg)

Re to  debug level:
Many years ago you could have done it by setting DebugLevel/DebugFlags
DWORD-32bit parameters in Registry (under Services\srp\parameters).
By default, DebugLevel was then 2 and DebugFlags 0xffff.
You can try to set DebugLevel to 3 or 4 and see what happen.
(All this is relevant only for checked drivers).



From: John Carbone [mailto:john-carbone at quantum-logic.com]
Sent: Wednesday, November 20, 2013 5:08 PM
To: ofw at lists.openfabrics.org
Cc: Leonid Keller
Subject: SRP debugging level

Hi all,

I'm trying to determine why SRP is not assigning target numbers with
WinOF. Is there a way to change the debug level without compiling? Where
can the output of SRP_PRINT be found?

Any help would be greatly appreciated. Thank you.

Kind regards,
John.

John Carbone | Quantum Logic Corporation
1225 Franklin Avenue, Suite 325 | Garden City, NY 11530
p: 800.482.2105 | f: 516.873.8881
john-carbone at quantum-logic.com


_______________________________________________
ofw mailing list
ofw at lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ofw
_______________________________________________
ofw mailing list
ofw at lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ofw



More information about the ofw mailing list