<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD><TITLE>RE: configuration</TITLE>
<META http-equiv=Content-Type content="text/html; charset=iso-8859-1">
<META content="MSHTML 6.00.2800.1498" name=GENERATOR>
<STYLE></STYLE>
</HEAD>
<BODY bgColor=#ffffff>
<DIV><FONT face=Arial size=2>Help needed!</FONT></DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV>
<DIV><FONT face=Arial size=2>Helen </FONT></DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV>
<DIV style="FONT: 10pt arial">----- Original Message -----
<DIV style="BACKGROUND: #e4e4e4; font-color: black"><B>From:</B> <A
title=hycsw@ca.sandia.gov href="mailto:hycsw@ca.sandia.gov">Helen Chen</A>
</DIV>
<DIV><B>To:</B> <A title=vuhuong@mellanox.com
href="mailto:vuhuong@mellanox.com">vuhuong@mellanox.com</A> </DIV>
<DIV><B>Cc:</B> <A title=Dave.Ellis@engenio.com
href="mailto:Dave.Ellis@engenio.com">Ellis, Dave</A> ; <A
title=joe.korpacz@engenio.com href="mailto:joe.korpacz@engenio.com">Korpacz,
Joe</A> ; <A title="hycsw@ca (Helen Chen)"
href="mailto:hycsw@ca (Helen Chen)">hycsw@ca (Helen Chen)</A> ; <A
title=jcdecke@sandia.gov href="mailto:jcdecke@sandia.gov">Decker, Jeffrey C</A>
</DIV>
<DIV><B>Sent:</B> Thursday, May 11, 2006 9:16 AM</DIV>
<DIV><B>Subject:</B> Fw: SRP problems</DIV></DIV>
<DIV><BR></DIV>
<DIV><FONT face=Arial size=2>Vu,</FONT></DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV>
<DIV><FONT face=Arial size=2>Dave Ellis from Engenio suggested that we contact
you for the SRP problems we are experiencing. Currently we are running the
SRP implementation distributed in the 2.6.16.5 kernel. </FONT><FONT
face=Arial size=2>Your help will be highly appreciated.</FONT></DIV>
<DIV><FONT face=Arial size=2></FONT> </DIV>
<DIV><FONT face=Arial size=2>Thanks,</FONT></DIV>
<DIV><FONT face=Arial size=2>Helen</FONT></DIV>
<DIV> </DIV>
<DIV style="FONT: 10pt arial">----- Original Message -----
<DIV style="BACKGROUND: #e4e4e4; font-color: black"><B>From:</B> <A
title=jcdecke@sandia.gov href="mailto:jcdecke@sandia.gov">Decker, Jeffrey C</A>
</DIV>
<DIV><B>To:</B> <A title=Dave.Ellis@engenio.com
href="mailto:Dave.Ellis@engenio.com">Ellis, Dave</A> </DIV>
<DIV><B>Cc:</B> <A title=hycsw@mailgate.sandia.gov
href="mailto:hycsw@mailgate.sandia.gov">Chen, Helen Y</A> </DIV>
<DIV><B>Sent:</B> Wednesday, April 26, 2006 5:01 PM</DIV>
<DIV><B>Subject:</B> RE: configuration</DIV></DIV>
<DIV><BR></DIV><!-- Converted from text/plain format -->
<P><FONT size=2>Hi Dave,<BR><BR>Basically I was doing exactly what these
instructions say to do.<BR><BR>What I did find is that I need to echo each
target separately and also that for whatever reason it shows twice as many
entries in /proc/scsi/scsi. Mitch hooked his Mellanox IB Gold up to it and we
also found that it registers twice as many entries in /proc/scsi/scsi. Anyway,
we have 4 accessible devices in /dev/sd*.<BR><BR>The problem I am having now is
getting a bunch of errors from dmesg and the disks are reallly slow.<BR><BR>Do
you know how to fix this? The output is the same as I showed you before. And
there is not a lun 31 or whatever showing up on the
gui.<BR><BR>........<BR>printk: 97 messages suppressed.<BR>ib_srp: Target has
req_lim 0<BR>printk: 147 messages suppressed.<BR>ib_srp: Target has req_lim
0<BR>printk: 104 messages suppressed.<BR>ib_srp: Target has req_lim 0<BR>printk:
103 messages suppressed.<BR>ib_srp: Target has req_lim 0<BR>printk: 119 messages
suppressed.<BR>ib_srp: Target has req_lim 0<BR>printk: 146 messages
suppressed.<BR>ib_srp: Target has req_lim 0<BR>printk: 65 messages
suppressed.<BR>ib_srp: Target has req_lim 0<BR>printk: 90 messages
suppressed.<BR>ib_srp: Target has req_lim 0<BR>printk: 139 messages
suppressed.<BR>ib_srp: Target has req_lim 0<BR>printk: 116 messages
suppressed.<BR>ib_srp: Target has req_lim 0<BR>printk: 133 messages
suppressed.<BR>ib_srp: Target has req_lim 0<BR>on3 ~
#<BR><BR>Thanks!<BR><BR>Jeff<BR><BR><BR>-----Original Message-----<BR>From:
Ellis, Dave [<A
href="mailto:Dave.Ellis@engenio.com">mailto:Dave.Ellis@engenio.com</A>]<BR>Sent:
Tue 4/25/2006 7:49 AM<BR>To: Decker, Jeffrey C; Helen Chen<BR>Cc: Korpacz, Joe;
Ellis, Dave; Snider, Tim<BR>Subject: RE:
configuration<BR><BR>Jeff,<BR><BR><BR><BR>Here are the LUN discovery
instructions provided by Vu Phan of Mellanox<BR>at the IBTA Plugfest last
month. The file is attached.<BR><BR><BR><BR>Please do the following
steps:<BR><BR><BR><BR>+ tar zxvf srptools.tgz<BR><BR>+ cd srptools;
./autogen.sh; ./configure; make; make install<BR><BR><BR><BR>Now you have
ibsrpdm. I assume that you have user mode verbs working<BR>and /dev/umadX
are available.<BR><BR><BR><BR>+ modprobe ib_umad<BR><BR>+ modprobe
ib_uverbs<BR><BR>+ modprobe ib_srp<BR><BR>+ ibsrpdm -vc -d
/dev/umad0<BR><BR><BR><BR>The output look like
this:<BR><BR><BR><BR>lab105:/usr/src/linux-2.6.15 # ibsrpdm -vc -d
/dev/umad0<BR>id_ext=200400A0B811149B,ioc_guid=0002c902004001a0,dgid=fe800000000000000<BR>002c902004001a2,pkey=ffff,service_id=200400a0b811149b<BR><BR><BR><BR>Then:<BR><BR><BR><BR>+
echo<BR><BR>id_ext=200400A0B811149B,ioc_guid=0002c902004001a0,dgid=fe800000000000000<BR>002c90200400,pkey=ffff,service_id=200400a0b811149b<BR><BR> >
/sys/class/infiniband_srp/srp-mthca0-1/add_target<BR><BR><BR><BR>+ fdisk
-l or lsscsi will show you the new scsi
device<BR><BR><BR><BR><BR><BR><BR><BR>One additional note, you need to make sure
all four of your LUNs are in<BR>the Default Group in the mappings
view.<BR><BR><BR><BR>Left click on the + to expand the view, then right click on
each LUN,<BR>adding it to the Default
Group.<BR><BR><BR><BR><BR><BR><BR><BR><BR><BR><BR><BR>Dave Ellis<BR><BR>Director
HPC Architecture<BR><BR>Engenio Storage Group - Storage Solutions<BR><BR>LSI
Logic Corporation<BR><BR><BR><BR>256-895-0517 (Office)<BR><BR>770-330-9486
(Cell)<BR><BR>dellis@lsi.com<BR><BR>www.lsilogic.com/engenio<BR><BR><BR><BR>________________________________<BR><BR>From:
Decker, Jeffrey C [<A
href="mailto:jcdecke@sandia.gov">mailto:jcdecke@sandia.gov</A>]<BR>Sent: Monday,
April 24, 2006 4:55 PM<BR>To: Ellis, Dave<BR>Subject:
configuration<BR><BR><BR><BR><BR><BR>- 2.6.12.5 vanilla kernel<BR>- Open IB
stack<BR>- Gentoo Linux (distro)<BR><BR><BR></FONT></P></BODY></HTML>