[ofa-general] Re: Problem in IB network without Switch

[Jack Morgenstein]

On Monday 02 March 2009 16:38, lakshmana swamy wrote:

> 
>  HI Jack
> 
>  I have updated the firmware of  HCA in both the machines, but the status remains same.
>  Please have a look at the following outputs.
> 
>  What may be the problem ? 
> 
Your physical connection is bad.  Check your cables.

Try connecting Port 1 to Port 2 of the same HCA directly, and see if you still get state: Down.
(you should see state: init before running opensm).

- Jack

> [root at locluster ~]# ibstat 
> CA 'mthca0'
>         CA type: MT23108
>         Number of ports: 2
>         Firmware version: 3.5.917
>         Hardware version: a1
>         Node GUID: 0x0002c90108cd13c0
>         System image GUID: 0x0002c90108cd13c0
>         Port 1:
>                 State: Down
>                 Physical state: Polling
>                 Rate: 2
>                 Base lid: 0
>                 LMC: 0
>                 SM lid: 0
>                 Capability mask: 0x02510a6a
>                 Port GUID: 0x0002c90108cd13c1
>         Port 2:
>                 State: Down
>                 Physical state: Polling
>                 Rate: 2
>                 Base lid: 0
>                 LMC: 0
>                 SM lid: 0
>                 Capability mask: 0x02510a68
>                 Port GUID: 0x0002c90108cd13c2
> [root at locluster ~]# 
> 
> [root at locluster1 ~]# ibstat
> CA 'mthca0'
>         CA type: MT23108
>         Number of ports: 2
>         Firmware version: 3.5.917
>         Hardware version: a1
>         Node GUID: 0x0002c9020000114c
>         System image GUID: 0x0002c9020000114f
>         Port 1:
>                 State: Down
>                 Physical state: Polling
>                 Rate: 2
>                 Base lid: 0
>                 LMC: 0
>                 SM lid: 0
>                 Capability mask: 0x02510a68
>                 Port GUID: 0x0002c9020000114d
>         Port 2:
>                 State: Down
>                 Physical state: Polling
>                 Rate: 2
>                 Base lid: 0
>                 LMC: 0
>                 SM lid: 0
>                 Capability mask: 0x02510a68
>                 Port GUID: 0x0002c9020000114e
> [root at locluster1 ~]# 
> 
> 
> 
> ThankQ
> 
> laxman
>  
> 
> From: klakshman03 at hotmail.com
> To: jackm at dev.mellanox.co.il
> CC: keshetti.mahesh at gmail.com; general at lists.openfabrics.org
> Subject: RE: Problem in IB network without Switch
> Date: Fri, 27 Feb 2009 09:56:38 +0530
> 
> 
> 
> 
> 
> 
> 
> 
> ThanQ Jack
> 
>  I will Update the firmware and let you know the status
> 
> laxman
> 
> > From: jackm at dev.mellanox.co.il
> > To: klakshman03 at hotmail.com
> > Subject: Re: Problem in IB network without Switch
> > Date: Thu, 26 Feb 2009 18:49:40 +0200
> > CC: keshetti.mahesh at gmail.com; general at lists.openfabrics.org
> > 
> > You are running VERY old firmware (from 2004), and moreover, on one host
> > you have 3.0.0, and on the other 3.1.0.
> > 
> > You need to upgrade your firmware.
> > Contact your Mellanox FAE (support engineer) for instructions.
> > 
> > - Jack
> > 
> > >  Hi Jack,
> > > 
> > > Please find the output of ibstat on both the nodes, .
> > > 
> > > [root at mattool ~]# /opt/ofed/extras/hca_self_test.ofed 
> > > HCA Firmware Check ..................... FAIL
> > >     REASON: mismatch HCA #0 firmware detected (found v, need v3.5.917)
> > > Host Driver Initialization ............. PASS
> > > 
> > > [root at mattool ~]# 
> > > 
> > > ************ IBSTAT output ******************
> > > 
> > > 
> > > [root at mattool ~]# ibstat
> > > CA 'mthca0'
> > >         CA type: MT23108
> > >         Number of ports: 2
> > >         Firmware version: 3.1.0
> > 
> > > [root at compute-0-0 ~]# ibstat
> > > CA 'mthca0'
> > >         CA type: MT23108
> > >         Number of ports: 2
> > >         Firmware version: 3.0.0
> 
> Get a view of the world through MSN Video. Some things just cannot be left unseen. Try it!
> _________________________________________________________________
> Express your true emotions! Send a virtual kiss! Do all these cool stuff & more with Windows Live Messenger. Download here  
> http://www.windowslive.com/Desktop/Messenger