[openib-general] Problem running rping on chelsio T3 adapters

Sundeep Narravula narravul at cse.ohio-state.edu
Thu Jul 20 10:42:27 PDT 2006


Hi Steve,

> What firmware version are you using?  You might need to contact Chelsio
> and get the correct firmware for the openib drivers.   ethtool -i will
> show us what version you're using.  It should say something like this:
>
> vic21:~ # ethtool -i eth2
> driver: cxgb3
> version: 1.0.0
> firmware-version: T 2.38
> bus-info: 0000:03:01.0
> vic21:~ #

I will verify this.

>
> Also, ethtool -S will show you statistics to see if packets are flowing.

Looks like no packets are flowing. All the stats are 0.


> Please build the iw_cxgb3 driver with debug on and send me
> the /var/log/messages snipits after running rping.  That'll help me
> figure out what's up...

I will try this and get back.

Thanks,
  --Sundeep.

>
> Steve.
>
>
>
> On Thu, 2006-07-20 at 03:05 -0400, Sundeep Narravula wrote:
> > Hi,
> >
> > > What does your network configuration look like?  IE send ifconfig output
> > > on both systems.
> > > Send the output of lsmod on both systems.
> >
> > I have attached both these for both the systems.
> >
> > > Does krping work?
> >
> > No. It fails with the same error.
> >
> > > Can you ssh between the 2 systems using the T3 ip addresses?
> >
> > No.
> >
> > > Do the following libs exist in /usr/local/lib:
> > > 	libibverbs.*
> > > 	librmdacm.*
> >
> > These exist.
> >
> > > 	libcxgb3.*
> >
> > This is not in /usr/local/lib.
> > /usr/local/lib/infiniband/cxgb3.* exist though.
> >
> > > Do ldconfig -v and make sure libibverbs is only found in /usr/local/lib.
> > > If you have OFED or some other rpm package with libibverbs installed,
> > > you'll have problems.
> >
> > Checked this. Only one exists.
> >
> > > For some reason it looks to be trying to load the MTHCA Infiniband
> > > library.  Do you have IB cards in the system?
> >
> > Yes. We do have IB nics on the system.
> >
> >   --Sundeep.
> >
> > >
> > > Steve.
> > >
> > >
> > > On Wed, 2006-07-19 at 13:28 -0400, Sundeep Narravula wrote:
> > > > Hi,
> > > >
> > > > We are using kernel 2.6.16.3 and installed the latest code/drivers from
> > > > the iwarp branch. Currently, we are seeing an address resolution problem
> > > > while using rping.
> > > >
> > > > [narravul at d1-as4 examples]$ ./rping -c -VvC100 -a 150.10.11.200 -p 9999
> > > > libibverbs: Warning: couldn't load driver
> > > > /usr/local/lib/infiniband/mthca.so: /usr/local/lib/infiniband/mthca.so:
> > > > undefined symbol: ibv_cmd_query_pkey
> > > > cma event 1, error -110
> > > >
> > > > The server hangs and cannot be killed.
> > > >
> > > > Both the nodes are connected to the switch and I am able to ping the local
> > > > ip addresses. Is there anything we are missing?
> > > >
> > > > Thanks,
> > > >   --Sundeep.
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > _______________________________________________
> > > > openib-general mailing list
> > > > openib-general at openib.org
> > > > http://openib.org/mailman/listinfo/openib-general
> > > >
> > > > To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
> > > >
> > >
>





More information about the general mailing list