<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD><TITLE>IB Setup</TITLE>
<META http-equiv=Content-Type content="text/html; charset=us-ascii">
<META content="MSHTML 6.00.2900.3314" name=GENERATOR></HEAD>
<BODY>
<DIV dir=ltr align=left><SPAN class=561230005-15082008><FONT face=Arial
size=2>Okay, from what you sent before you have ib1 cabled on the remote system
but ib0 is assigned the ip address. Either move the cable to the other
interface on the remote system or ifconfig ib1 to
11.4.8.36/16</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=561230005-15082008><FONT face=Arial
size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=561230005-15082008><FONT face=Arial
size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=561230005-15082008></SPAN> </DIV><BR>
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> Majumder, Rajib
[mailto:rajib.majumder@credit-suisse.com] <BR><B>Sent:</B> Thursday, August 14,
2008 10:59 PM<BR><B>To:</B> Robert Cummins;
general@lists.openfabrics.org<BR><B>Subject:</B> RE: [ofa-general] IB
Setup<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=338425404-15082008>local interface</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=338425404-15082008>--------------------</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff
size=2></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff
size=2>ib0 Link encap:UNSPEC HWaddr
80-00-00-48-FE-80-00-00-00-00-00-00-00-00-00-00
<BR> inet
addr:11.4.8.35 Bcast:11.4.255.255
Mask:255.255.0.0<BR> UP
BROADCAST MULTICAST MTU:65520
Metric:1<BR> RX packets:0
errors:0 dropped:0 overruns:0
frame:0<BR> TX packets:0
errors:0 dropped:0 overruns:0
carrier:0<BR> collisions:0
txqueuelen:256 <BR> RX
bytes:0 (0.0 b) TX bytes:0 (0.0 b)</FONT></DIV>
<DIV><FONT face=Arial color=#0000ff size=2></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff
size=2>ib1 Link encap:UNSPEC HWaddr
80-00-00-49-FE-80-00-00-00-00-00-00-00-00-00-00
<BR> inet6 addr:
fe80::21b:78ff:ff34:4282/64
Scope:Link<BR> UP
BROADCAST RUNNING MULTICAST MTU:65520
Metric:1<BR> RX packets:0
errors:0 dropped:0 overruns:0
frame:0<BR> TX packets:1
errors:0 dropped:5 overruns:0
carrier:0<BR> collisions:0
txqueuelen:256 <BR> RX
bytes:0 (0.0 b) TX bytes:68 (68.0 b)<BR></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff
size=2></FONT> </DIV>
<DIV dir=ltr align=left>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=338425404-15082008>remote interface</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=338425404-15082008>-----------------------</SPAN></FONT></DIV></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff
size=2></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff
size=2>ib0 Link encap:UNSPEC HWaddr
80-00-00-48-FE-80-00-00-00-00-00-00-00-00-00-00
<BR> inet
addr:11.4.8.36 Bcast:11.4.255.255
Mask:255.255.0.0<BR> UP
BROADCAST MULTICAST MTU:65520
Metric:1<BR> RX packets:0
errors:0 dropped:0 overruns:0
frame:0<BR> TX packets:0
errors:0 dropped:0 overruns:0
carrier:0<BR> collisions:0
txqueuelen:256 <BR> RX
bytes:0 (0.0 b) TX bytes:0 (0.0 b)</FONT></DIV>
<DIV><FONT face=Arial color=#0000ff size=2></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff
size=2>ib1 Link encap:UNSPEC HWaddr
80-00-00-49-FE-80-00-00-00-00-00-00-00-00-00-00
<BR> inet6 addr:
fe80::21e:bff:ff84:58fe/64
Scope:Link<BR> UP
BROADCAST RUNNING MULTICAST MTU:65520
Metric:1<BR> RX packets:0
errors:0 dropped:0 overruns:0
frame:0<BR> TX packets:1
errors:0 dropped:5 overruns:0
carrier:0<BR> collisions:0
txqueuelen:256 <BR> RX
bytes:0 (0.0 b) TX bytes:68 (68.0 b)</FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff
size=2></FONT> </DIV>
<DIV dir=ltr align=left>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=338425404-15082008>local interface</SPAN></FONT></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff size=2><SPAN
class=338425404-15082008>--------------------</SPAN></FONT></DIV></DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff
size=2></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial><FONT color=#0000ff><FONT size=2><SPAN
class=338425404-15082008>#</SPAN>ibv_devinfo<BR>hca_id:
mlx4_0<BR>
fw_ver:
2.2.000<BR>
node_guid:
001b:78ff:ff34:4280<BR>
sys_image_guid:
001b:78ff:ff34:4283<BR>
vendor_id:
0x02c9<BR>
vendor_part_id:
25418<BR>
hw_ver:
0xA0<BR>
board_id:
HP_08B0000001<BR>
phys_port_cnt:
2<BR>
port:
1<BR>
state:
PORT_DOWN
(1)<BR>
max_mtu:
2048
(4)<BR>
active_mtu:
2048
(4)<BR>
sm_lid:
0<BR>
port_lid:
0<BR>
port_lmc:
0x00</FONT></FONT></FONT></DIV>
<DIV><FONT face=Arial color=#0000ff size=2></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff
size=2>
port:
2<BR>
state:
PORT_ACTIVE
(4)<BR>
max_mtu:
2048
(4)<BR>
active_mtu:
2048
(4)<BR>
sm_lid:
1<BR>
port_lid:
1<BR>
port_lmc:
0x00<BR></FONT></DIV>
<DIV><FONT face=Arial color=#0000ff size=2># ping 11.4.8.36<BR>PING 11.4.8.36
(11.4.8.36) 56(84) bytes of data.<BR>From 11.4.8.35: icmp_seq=2 Destination Host
Unreachable</FONT></DIV>
<DIV><FONT face=Arial color=#0000ff size=2></FONT> </DIV>
<DIV><SPAN class=338425404-15082008><FONT face=Arial color=#0000ff size=2>Do you
know why port 1 is down? </FONT></SPAN></DIV>
<DIV><BR><BR></DIV>
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> Robert Cummins [mailto:rcummins@sgi.com]
<BR><B>Sent:</B> 15 August 2008 12:53<BR><B>To:</B> Majumder, Rajib;
general@lists.openfabrics.org<BR><B>Subject:</B> RE: [ofa-general] IB
Setup<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV dir=ltr align=left><SPAN class=457145204-15082008><FONT face=Arial
size=2>What does the local hca look like? What are the ip addresses of the
local ib interface and remote ib interface?</FONT></SPAN></DIV><BR>
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> Majumder, Rajib
[mailto:rajib.majumder@credit-suisse.com] <BR><B>Sent:</B> Thursday, August 14,
2008 10:47 PM<BR><B>To:</B> Robert Cummins;
general@lists.openfabrics.org<BR><B>Subject:</B> RE: [ofa-general] IB
Setup<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV dir=ltr align=left><FONT face=Arial><FONT color=#0000ff><FONT size=2><SPAN
class=815154504-15082008>#</SPAN>ibv_devinfo<BR>hca_id:
mlx4_0<BR>
fw_ver:
2.3.000<BR>
node_guid:
001e:0bff:ff84:58fc<BR>
sys_image_guid:
001e:0bff:ff84:58ff<BR>
vendor_id:
0x02c9<BR>
vendor_part_id:
25418<BR>
hw_ver:
0xA0<BR>
board_id:
HP_08B0000001<BR>
phys_port_cnt:
2<BR>
port:
1<BR>
state:
PORT_DOWN
(1)<BR>
max_mtu:
2048
(4)<BR>
active_mtu:
2048
(4)<BR>
sm_lid:
0<BR>
port_lid:
0<BR>
port_lmc:
0x00</FONT></FONT></FONT></DIV>
<DIV><FONT face=Arial color=#0000ff size=2></FONT> </DIV>
<DIV dir=ltr align=left><FONT face=Arial color=#0000ff
size=2>
port:
2<BR>
state:
PORT_ACTIVE
(4)<BR>
max_mtu:
2048
(4)<BR>
active_mtu:
2048
(4)<BR>
sm_lid:
1<BR>
port_lid:
3<BR>
port_lmc:
0x00<SPAN class=815154504-15082008> </SPAN></FONT></DIV>
<DIV><FONT face=Arial color=#0000ff size=2><SPAN
class=815154504-15082008></SPAN></FONT> </DIV>
<DIV><FONT face=Arial color=#0000ff size=2><SPAN class=815154504-15082008>This
is the info for the remote HCA ports. </SPAN></DIV>
<DIV dir=ltr align=left><BR></DIV></FONT><BR>
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> Robert Cummins [mailto:rcummins@sgi.com]
<BR><B>Sent:</B> 15 August 2008 12:42<BR><B>To:</B> Majumder, Rajib;
general@lists.openfabrics.org<BR><B>Subject:</B> RE: [ofa-general] IB
Setup<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV dir=ltr align=left><SPAN class=413524004-15082008><FONT face=Arial
size=2>Have you verified that your sm is up and running? Do you have a
valid lid for the interface? Can you lidtrace between two devices on the
fabric? Does the remote hca have a lid?</FONT></SPAN></DIV><BR>
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> general-bounces@lists.openfabrics.org
[mailto:general-bounces@lists.openfabrics.org] <B>On Behalf Of </B>Majumder,
Rajib<BR><B>Sent:</B> Thursday, August 14, 2008 10:38 PM<BR><B>To:</B>
general@lists.openfabrics.org<BR><B>Subject:</B> [ofa-general] IB
Setup<BR></FONT><BR></DIV>
<DIV></DIV><!-- Converted from text/rtf format -->
<P><SPAN lang=en-us><FONT face=Arial size=2>Hi,</FONT></SPAN> </P>
<P><SPAN lang=en-us><FONT face=Arial size=2>I am running OFED 1.3 in SLERT 10
SP2 on ConnectX device. </FONT></SPAN></P>
<P><SPAN lang=en-us><FONT face=Arial size=2>I am getting a Destination Host
Unreachable error when I ping the remote HCA port. </FONT></SPAN></P>
<P><SPAN lang=en-us><FONT face=Arial size=2>Pinging the local ib0 interface
works fine. </FONT></SPAN></P>
<P><SPAN lang=en-us><FONT face=Arial size=2>Any idea, what's wrong with the
config? </FONT></SPAN></P>
<P><SPAN lang=en-us><FONT face=Arial size=2>Thanks</FONT></SPAN> </P>
<P><SPAN lang=en-us><FONT face=Arial size=2>Rajib</FONT></SPAN><SPAN
lang=en-gb></SPAN> </P>
<P><PRE wrap>==============================================================================
Please access the attached hyperlink for an important electronic communications disclaimer:
http://www.credit-suisse.com/legal/en/disclaimer_email_ib.html
==============================================================================
</PRE>
<P></P>
<P><PRE wrap>==============================================================================
Please access the attached hyperlink for an important electronic communications disclaimer:
http://www.credit-suisse.com/legal/en/disclaimer_email_ib.html
==============================================================================
</PRE>
<P></P>
<P><PRE wrap>==============================================================================
Please access the attached hyperlink for an important electronic communications disclaimer:
http://www.credit-suisse.com/legal/en/disclaimer_email_ib.html
==============================================================================
</PRE>
<P></P></BODY></HTML>