[ofa-general] IB Setup

Robert Cummins rcummins at sgi.com
Thu Aug 14 22:01:34 PDT 2008


Okay, from what you sent before you have ib1 cabled on the remote system
but ib0 is assigned the ip address.  Either move the cable to the other
interface on the remote system or ifconfig ib1 to 11.4.8.36/16
 
 
 

________________________________

From: Majumder, Rajib [mailto:rajib.majumder at credit-suisse.com] 
Sent: Thursday, August 14, 2008 10:59 PM
To: Robert Cummins; general at lists.openfabrics.org
Subject: RE: [ofa-general] IB Setup


local interface
--------------------
 
ib0       Link encap:UNSPEC  HWaddr
80-00-00-48-FE-80-00-00-00-00-00-00-00-00-00-00  
          inet addr:11.4.8.35  Bcast:11.4.255.255  Mask:255.255.0.0
          UP BROADCAST MULTICAST  MTU:65520  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:256 
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)
 
ib1       Link encap:UNSPEC  HWaddr
80-00-00-49-FE-80-00-00-00-00-00-00-00-00-00-00  
          inet6 addr: fe80::21b:78ff:ff34:4282/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:65520  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1 errors:0 dropped:5 overruns:0 carrier:0
          collisions:0 txqueuelen:256 
          RX bytes:0 (0.0 b)  TX bytes:68 (68.0 b)

 
remote interface
-----------------------
 
ib0       Link encap:UNSPEC  HWaddr
80-00-00-48-FE-80-00-00-00-00-00-00-00-00-00-00  
          inet addr:11.4.8.36  Bcast:11.4.255.255  Mask:255.255.0.0
          UP BROADCAST MULTICAST  MTU:65520  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:256 
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)
 
ib1       Link encap:UNSPEC  HWaddr
80-00-00-49-FE-80-00-00-00-00-00-00-00-00-00-00  
          inet6 addr: fe80::21e:bff:ff84:58fe/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:65520  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1 errors:0 dropped:5 overruns:0 carrier:0
          collisions:0 txqueuelen:256 
          RX bytes:0 (0.0 b)  TX bytes:68 (68.0 b)
 
local interface
--------------------
 
#ibv_devinfo
hca_id: mlx4_0
        fw_ver:                         2.2.000
        node_guid:                      001b:78ff:ff34:4280
        sys_image_guid:                 001b:78ff:ff34:4283
        vendor_id:                      0x02c9
        vendor_part_id:                 25418
        hw_ver:                         0xA0
        board_id:                       HP_08B0000001
        phys_port_cnt:                  2
                port:   1
                        state:                  PORT_DOWN (1)
                        max_mtu:                2048 (4)
                        active_mtu:             2048 (4)
                        sm_lid:                 0
                        port_lid:               0
                        port_lmc:               0x00
 
                port:   2
                        state:                  PORT_ACTIVE (4)
                        max_mtu:                2048 (4)
                        active_mtu:             2048 (4)
                        sm_lid:                 1
                        port_lid:               1
                        port_lmc:               0x00

# ping 11.4.8.36
PING 11.4.8.36 (11.4.8.36) 56(84) bytes of data.
>From 11.4.8.35: icmp_seq=2 Destination Host Unreachable
 
Do you know why port 1 is down? 


________________________________

From: Robert Cummins [mailto:rcummins at sgi.com] 
Sent: 15 August 2008 12:53
To: Majumder, Rajib; general at lists.openfabrics.org
Subject: RE: [ofa-general] IB Setup


What does the local hca look like?  What are the ip addresses of the
local ib interface and remote ib interface?

________________________________

From: Majumder, Rajib [mailto:rajib.majumder at credit-suisse.com] 
Sent: Thursday, August 14, 2008 10:47 PM
To: Robert Cummins; general at lists.openfabrics.org
Subject: RE: [ofa-general] IB Setup


#ibv_devinfo
hca_id: mlx4_0
        fw_ver:                         2.3.000
        node_guid:                      001e:0bff:ff84:58fc
        sys_image_guid:                 001e:0bff:ff84:58ff
        vendor_id:                      0x02c9
        vendor_part_id:                 25418
        hw_ver:                         0xA0
        board_id:                       HP_08B0000001
        phys_port_cnt:                  2
                port:   1
                        state:                  PORT_DOWN (1)
                        max_mtu:                2048 (4)
                        active_mtu:             2048 (4)
                        sm_lid:                 0
                        port_lid:               0
                        port_lmc:               0x00
 
                port:   2
                        state:                  PORT_ACTIVE (4)
                        max_mtu:                2048 (4)
                        active_mtu:             2048 (4)
                        sm_lid:                 1
                        port_lid:               3
                        port_lmc:               0x00 
 
This is the info for the remote HCA ports. 


________________________________

From: Robert Cummins [mailto:rcummins at sgi.com] 
Sent: 15 August 2008 12:42
To: Majumder, Rajib; general at lists.openfabrics.org
Subject: RE: [ofa-general] IB Setup


Have you verified that your sm is up and running?  Do you have a valid
lid for the interface?  Can you lidtrace between two devices on the
fabric?   Does the remote hca have a lid?

________________________________

From: general-bounces at lists.openfabrics.org
[mailto:general-bounces at lists.openfabrics.org] On Behalf Of Majumder,
Rajib
Sent: Thursday, August 14, 2008 10:38 PM
To: general at lists.openfabrics.org
Subject: [ofa-general] IB Setup



Hi, 

I am running OFED 1.3 in SLERT 10 SP2 on ConnectX device. 

I am getting a Destination Host Unreachable error when I ping the remote
HCA port. 

Pinging the local ib0 interface works fine. 

Any idea, what's wrong with the config? 

Thanks 

Rajib 

========================================================================
======
Please access the attached hyperlink for an important electronic
communications disclaimer: 

http://www.credit-suisse.com/legal/en/disclaimer_email_ib.html
========================================================================
======

========================================================================
======
Please access the attached hyperlink for an important electronic
communications disclaimer: 

http://www.credit-suisse.com/legal/en/disclaimer_email_ib.html
========================================================================
======

========================================================================
======
Please access the attached hyperlink for an important electronic
communications disclaimer: 

http://www.credit-suisse.com/legal/en/disclaimer_email_ib.html
========================================================================
======

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20080814/6f355789/attachment.html>


More information about the general mailing list