[openib-general] Problem running rping on chelsio T3 adapters

[Steve Wise]

The ifconfig stuff looks ok.  thanks for sending it.

What firmware version are you using?  You might need to contact Chelsio
and get the correct firmware for the openib drivers.   ethtool -i will
show us what version you're using.  It should say something like this: 

vic21:~ # ethtool -i eth2
driver: cxgb3
version: 1.0.0
firmware-version: T 2.38
bus-info: 0000:03:01.0
vic21:~ #

Also, ethtool -S will show you statistics to see if packets are flowing.

Please build the iw_cxgb3 driver with debug on and send me
the /var/log/messages snipits after running rping.  That'll help me
figure out what's up...

Steve.



On Thu, 2006-07-20 at 03:05 -0400, Sundeep Narravula wrote:
> Hi,
> 
> > What does your network configuration look like?  IE send ifconfig output
> > on both systems.
> > Send the output of lsmod on both systems.
> 
> I have attached both these for both the systems.
> 
> > Does krping work?
> 
> No. It fails with the same error.
> 
> > Can you ssh between the 2 systems using the T3 ip addresses?
> 
> No.
> 
> > Do the following libs exist in /usr/local/lib:
> > 	libibverbs.*
> > 	librmdacm.*
> 
> These exist.
> 
> > 	libcxgb3.*
> 
> This is not in /usr/local/lib.
> /usr/local/lib/infiniband/cxgb3.* exist though.
> 
> > Do ldconfig -v and make sure libibverbs is only found in /usr/local/lib.
> > If you have OFED or some other rpm package with libibverbs installed,
> > you'll have problems.
> 
> Checked this. Only one exists.
> 
> > For some reason it looks to be trying to load the MTHCA Infiniband
> > library.  Do you have IB cards in the system?
> 
> Yes. We do have IB nics on the system.
> 
>   --Sundeep.
> 
> >
> > Steve.
> >
> >
> > On Wed, 2006-07-19 at 13:28 -0400, Sundeep Narravula wrote:
> > > Hi,
> > >
> > > We are using kernel 2.6.16.3 and installed the latest code/drivers from
> > > the iwarp branch. Currently, we are seeing an address resolution problem
> > > while using rping.
> > >
> > > [narravul at d1-as4 examples]$ ./rping -c -VvC100 -a 150.10.11.200 -p 9999
> > > libibverbs: Warning: couldn't load driver
> > > /usr/local/lib/infiniband/mthca.so: /usr/local/lib/infiniband/mthca.so:
> > > undefined symbol: ibv_cmd_query_pkey
> > > cma event 1, error -110
> > >
> > > The server hangs and cannot be killed.
> > >
> > > Both the nodes are connected to the switch and I am able to ping the local
> > > ip addresses. Is there anything we are missing?
> > >
> > > Thanks,
> > >   --Sundeep.
> > >
> > >
> > >
> > >
> > >
> > > _______________________________________________
> > > openib-general mailing list
> > > openib-general at openib.org
> > > http://openib.org/mailman/listinfo/openib-general
> > >
> > > To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
> > >
> >