[openib-general] Fw: SRP problems

[Helen Chen]

RE: configurationHelp needed!

Helen 

----- Original Message ----- 
From: Helen Chen 
To: vuhuong at mellanox.com 
Cc: Ellis, Dave ; Korpacz, Joe ; hycsw at ca (Helen Chen) ; Decker, Jeffrey C 
Sent: Thursday, May 11, 2006 9:16 AM
Subject: Fw: SRP problems


Vu,

Dave Ellis from Engenio suggested that we contact you for the SRP problems we are experiencing.  Currently we are running the SRP implementation distributed in the 2.6.16.5 kernel.  Your help will be highly appreciated.

Thanks,
Helen

----- Original Message ----- 
From: Decker, Jeffrey C 
To: Ellis, Dave 
Cc: Chen, Helen Y 
Sent: Wednesday, April 26, 2006 5:01 PM
Subject: RE: configuration


Hi Dave,

Basically I was doing exactly what these instructions say to do.

What I did find is that I need to echo each target separately and also that for whatever reason it shows twice as many entries in /proc/scsi/scsi. Mitch hooked his Mellanox IB Gold up to it and we also found that it registers twice as many entries in /proc/scsi/scsi. Anyway, we have 4 accessible devices in /dev/sd*.

The problem I am having now is getting a bunch of errors from dmesg and the disks are reallly slow.

Do you know how to fix this? The output is the same as I showed you before. And there is not a lun 31 or whatever showing up on the gui.

........
printk: 97 messages suppressed.
ib_srp: Target has req_lim 0
printk: 147 messages suppressed.
ib_srp: Target has req_lim 0
printk: 104 messages suppressed.
ib_srp: Target has req_lim 0
printk: 103 messages suppressed.
ib_srp: Target has req_lim 0
printk: 119 messages suppressed.
ib_srp: Target has req_lim 0
printk: 146 messages suppressed.
ib_srp: Target has req_lim 0
printk: 65 messages suppressed.
ib_srp: Target has req_lim 0
printk: 90 messages suppressed.
ib_srp: Target has req_lim 0
printk: 139 messages suppressed.
ib_srp: Target has req_lim 0
printk: 116 messages suppressed.
ib_srp: Target has req_lim 0
printk: 133 messages suppressed.
ib_srp: Target has req_lim 0
on3 ~ #

Thanks!

Jeff


-----Original Message-----
From: Ellis, Dave [mailto:Dave.Ellis at engenio.com]
Sent: Tue 4/25/2006 7:49 AM
To: Decker, Jeffrey C; Helen Chen
Cc: Korpacz, Joe; Ellis, Dave; Snider, Tim
Subject: RE: configuration

Jeff,



Here are the LUN discovery instructions provided by Vu Phan of Mellanox
at the IBTA Plugfest last month.  The file is attached.



Please do the following steps:



+ tar zxvf srptools.tgz

+ cd srptools;  ./autogen.sh;  ./configure; make; make install



Now you have ibsrpdm.  I assume that you have user mode verbs working
and /dev/umadX are available.



+ modprobe ib_umad

+ modprobe ib_uverbs

+ modprobe ib_srp

+ ibsrpdm -vc -d /dev/umad0



The output look like this:



lab105:/usr/src/linux-2.6.15 # ibsrpdm -vc -d /dev/umad0
id_ext=200400A0B811149B,ioc_guid=0002c902004001a0,dgid=fe800000000000000
002c902004001a2,pkey=ffff,service_id=200400a0b811149b



Then:



+ echo

id_ext=200400A0B811149B,ioc_guid=0002c902004001a0,dgid=fe800000000000000
002c90200400,pkey=ffff,service_id=200400a0b811149b

 > /sys/class/infiniband_srp/srp-mthca0-1/add_target



+ fdisk -l  or lsscsi will show you the new scsi device







One additional note, you need to make sure all four of your LUNs are in
the Default Group in the mappings view.



Left click on the + to expand the view, then right click on each LUN,
adding it to the Default Group.











Dave Ellis

Director HPC Architecture

Engenio Storage Group - Storage Solutions

LSI Logic Corporation



256-895-0517 (Office)

770-330-9486 (Cell)

dellis at lsi.com

www.lsilogic.com/engenio



________________________________

From: Decker, Jeffrey C [mailto:jcdecke at sandia.gov]
Sent: Monday, April 24, 2006 4:55 PM
To: Ellis, Dave
Subject: configuration





- 2.6.12.5 vanilla kernel
- Open IB stack
- Gentoo Linux (distro)



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20060511/b79fb52a/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.jpg
Type: image/jpeg
Size: 37129 bytes
Desc: not available
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20060511/b79fb52a/attachment.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.jpg
Type: image/jpeg
Size: 28207 bytes
Desc: not available
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20060511/b79fb52a/attachment-0001.jpg>