[ofa-general] Re: Problem in IB network without Switch

[Jack Morgenstein]

You need to get in touch with Mellanox Support (FAE) at this point.

- Jack


On Monday 02 March 2009 17:07, lakshmana swamy wrote:
> 
>  Hi Jack,
> 
> 
>  Yes, I  connected the cable between two ports of same HCA. Without running opensmd.
> 
>  Now the  State is " Initializing"
> 
>  I observed same state in other node also.
> 
> If cable is bad, it should not show this state right...
> 
>  Thanks
>  laxman
> 
> 
> > From: jackm at dev.mellanox.co.il
> > To: klakshman03 at hotmail.com
> > Subject: Re: Problem in IB network without Switch
> > Date: Mon, 2 Mar 2009 16:46:46 +0200
> > CC: keshetti.mahesh at gmail.com; general at lists.openfabrics.org
> > 
> > On Monday 02 March 2009 16:38, lakshmana swamy wrote:
> > 
> > > 
> > >  HI Jack
> > > 
> > >  I have updated the firmware of  HCA in both the machines, but the status remains same.
> > >  Please have a look at the following outputs.
> > > 
> > >  What may be the problem ? 
> > > 
> > Your physical connection is bad.  Check your cables.
> > 
> > Try connecting Port 1 to Port 2 of the same HCA directly, and see if you still get state: Down.
> > (you should see state: init before running opensm).
> > 
> > - Jack
> > 
> > > [root at locluster ~]# ibstat 
> > > CA 'mthca0'
> > >         CA type: MT23108
> > >         Number of ports: 2
> > >         Firmware version: 3.5.917
> > >         Hardware version: a1
> > >         Node GUID: 0x0002c90108cd13c0
> > >         System image GUID: 0x0002c90108cd13c0
> > >         Port 1:
> > >                 State: Down
> > >                 Physical state: Polling
> > >                 Rate: 2
> > >                 Base lid: 0
> > >                 LMC: 0
> > >                 SM lid: 0
> > >                 Capability mask: 0x02510a6a
> > >                 Port GUID: 0x0002c90108cd13c1
> > >         Port 2:
> > >                 State: Down
> > >                 Physical state: Polling
> > >                 Rate: 2
> > >                 Base lid: 0
> > >                 LMC: 0
> > >                 SM lid: 0
> > >                 Capability mask: 0x02510a68
> > >                 Port GUID: 0x0002c90108cd13c2
> > > [root at locluster ~]# 
> > > 
> > > [root at locluster1 ~]# ibstat
> > > CA 'mthca0'
> > >         CA type: MT23108
> > >         Number of ports: 2
> > >         Firmware version: 3.5.917
> > >         Hardware version: a1
> > >         Node GUID: 0x0002c9020000114c
> > >         System image GUID: 0x0002c9020000114f
> > >         Port 1:
> > >                 State: Down
> > >                 Physical state: Polling
> > >                 Rate: 2
> > >                 Base lid: 0
> > >                 LMC: 0
> > >                 SM lid: 0
> > >                 Capability mask: 0x02510a68
> > >                 Port GUID: 0x0002c9020000114d
> > >         Port 2:
> > >                 State: Down
> > >                 Physical state: Polling
> > >                 Rate: 2
> > >                 Base lid: 0
> > >                 LMC: 0
> > >                 SM lid: 0
> > >                 Capability mask: 0x02510a68
> > >                 Port GUID: 0x0002c9020000114e
> > > [root at locluster1 ~]# 
> > > 
> > > 
> > > 
> > > ThankQ
> > > 
> > > laxman
> > >  
> > > 
> > > From: klakshman03 at hotmail.com
> > > To: jackm at dev.mellanox.co.il
> > > CC: keshetti.mahesh at gmail.com; general at lists.openfabrics.org
> > > Subject: RE: Problem in IB network without Switch
> > > Date: Fri, 27 Feb 2009 09:56:38 +0530
> > > 
> > > 
> > > 
> > > 
> > > 
> > > 
> > > 
> > > 
> > > ThanQ Jack
> > > 
> > >  I will Update the firmware and let you know the status
> > > 
> > > laxman
> > > 
> > > > From: jackm at dev.mellanox.co.il
> > > > To: klakshman03 at hotmail.com
> > > > Subject: Re: Problem in IB network without Switch
> > > > Date: Thu, 26 Feb 2009 18:49:40 +0200
> > > > CC: keshetti.mahesh at gmail.com; general at lists.openfabrics.org
> > > > 
> > > > You are running VERY old firmware (from 2004), and moreover, on one host
> > > > you have 3.0.0, and on the other 3.1.0.
> > > > 
> > > > You need to upgrade your firmware.
> > > > Contact your Mellanox FAE (support engineer) for instructions.
> > > > 
> > > > - Jack
> > > > 
> > > > >  Hi Jack,
> > > > > 
> > > > > Please find the output of ibstat on both the nodes, .
> > > > > 
> > > > > [root at mattool ~]# /opt/ofed/extras/hca_self_test.ofed 
> > > > > HCA Firmware Check ..................... FAIL
> > > > >     REASON: mismatch HCA #0 firmware detected (found v, need v3.5.917)
> > > > > Host Driver Initialization ............. PASS
> > > > > 
> > > > > [root at mattool ~]# 
> > > > > 
> > > > > ************ IBSTAT output ******************
> > > > > 
> > > > > 
> > > > > [root at mattool ~]# ibstat
> > > > > CA 'mthca0'
> > > > >         CA type: MT23108
> > > > >         Number of ports: 2
> > > > >         Firmware version: 3.1.0
> > > > 
> > > > > [root at compute-0-0 ~]# ibstat
> > > > > CA 'mthca0'
> > > > >         CA type: MT23108
> > > > >         Number of ports: 2
> > > > >         Firmware version: 3.0.0
> > > 
> > > Get a view of the world through MSN Video. Some things just cannot be left unseen. Try it!
> > > _________________________________________________________________
> > > Express your true emotions! Send a virtual kiss! Do all these cool stuff & more with Windows Live Messenger. Download here  
> > > http://www.windowslive.com/Desktop/Messenger
> 
> _________________________________________________________________
> Express your true emotions! Send a virtual kiss! Do all these cool stuff & more with Windows Live Messenger. Download here  
> http://www.windowslive.com/Desktop/Messenger