[openib-general] Problem running rping on chelsio T3 adapters

[Sundeep Narravula]

Steve,

> > Please build the iw_cxgb3 driver with debug on and send me
> > the /var/log/messages snipits after running rping.  That'll help me
> > figure out what's up...

I have attached the logs on the server side and the client side.

Thanks,
  --Sundeep.

>
> I will try this and get back.
>
> Thanks,
>   --Sundeep.
>
> >
> > Steve.
> >
> >
> >
> > On Thu, 2006-07-20 at 03:05 -0400, Sundeep Narravula wrote:
> > > Hi,
> > >
> > > > What does your network configuration look like?  IE send ifconfig output
> > > > on both systems.
> > > > Send the output of lsmod on both systems.
> > >
> > > I have attached both these for both the systems.
> > >
> > > > Does krping work?
> > >
> > > No. It fails with the same error.
> > >
> > > > Can you ssh between the 2 systems using the T3 ip addresses?
> > >
> > > No.
> > >
> > > > Do the following libs exist in /usr/local/lib:
> > > > 	libibverbs.*
> > > > 	librmdacm.*
> > >
> > > These exist.
> > >
> > > > 	libcxgb3.*
> > >
> > > This is not in /usr/local/lib.
> > > /usr/local/lib/infiniband/cxgb3.* exist though.
> > >
> > > > Do ldconfig -v and make sure libibverbs is only found in /usr/local/lib.
> > > > If you have OFED or some other rpm package with libibverbs installed,
> > > > you'll have problems.
> > >
> > > Checked this. Only one exists.
> > >
> > > > For some reason it looks to be trying to load the MTHCA Infiniband
> > > > library.  Do you have IB cards in the system?
> > >
> > > Yes. We do have IB nics on the system.
> > >
> > >   --Sundeep.
> > >
> > > >
> > > > Steve.
> > > >
> > > >
> > > > On Wed, 2006-07-19 at 13:28 -0400, Sundeep Narravula wrote:
> > > > > Hi,
> > > > >
> > > > > We are using kernel 2.6.16.3 and installed the latest code/drivers from
> > > > > the iwarp branch. Currently, we are seeing an address resolution problem
> > > > > while using rping.
> > > > >
> > > > > [narravul at d1-as4 examples]$ ./rping -c -VvC100 -a 150.10.11.200 -p 9999
> > > > > libibverbs: Warning: couldn't load driver
> > > > > /usr/local/lib/infiniband/mthca.so: /usr/local/lib/infiniband/mthca.so:
> > > > > undefined symbol: ibv_cmd_query_pkey
> > > > > cma event 1, error -110
> > > > >
> > > > > The server hangs and cannot be killed.
> > > > >
> > > > > Both the nodes are connected to the switch and I am able to ping the local
> > > > > ip addresses. Is there anything we are missing?
> > > > >
> > > > > Thanks,
> > > > >   --Sundeep.
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > _______________________________________________
> > > > > openib-general mailing list
> > > > > openib-general at openib.org
> > > > > http://openib.org/mailman/listinfo/openib-general
> > > > >
> > > > > To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
> > > > >
> > > >
> >
>
>
> _______________________________________________
> openib-general mailing list
> openib-general at openib.org
> http://openib.org/mailman/listinfo/openib-general
>
> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
>

-------------- next part --------------
iw_ch:open_rnic_toe line 140
cxio: opening rnic dev cxgb3c0
cxio: rnic cxgb3c0 info: tpt_base=0xa000000 tpt_top=0xbffffff pbl_base=0xe000000 pbl_top=0xfffffff rqt_base=0xc000000, rqt_top=0xdffffff
cxio: udbell_len=0x8000000 udbell_physbase=0xf0000000 kdb_addr=f8852004
cxio: CtrlQP dma_addr=0x339a0000 kaddr=f39a0000 size=1024
iw_ch:open_rnic_init line 74
iw_ch:iwch_register_device line 983
iw_ch: dev name = cxgb3_%d
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_port:897
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_port:897
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_port:897
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_pkey:840
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_gid:850
iw_ch:ibdev f682d400, port 1, index 0, gid f3cb4764
iw_ch:dev f682d400 port 1 netdev f7f50000
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_port:897
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_pkey:840
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_gid:850
iw_ch:ibdev f682d400, port 2, index 0, gid f3cb4724
iw_ch:dev f682d400 port 2 netdev f77e4000
iw_ch:iwch_register_device line 1069
iw_ch:iwch_register_device line 1077
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:show_board:961 dev = 0xf682d400
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:show_hca:952
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:show_fw_ver:940
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:show_rev:928
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_device:867
ADDRCONF(NETDEV_UP): eth2: link is not ready
eth2: link up, 10Gbps, full-duplex
ADDRCONF(NETDEV_CHANGE): eth2: link becomes ready
ADDRCONF(NETDEV_UP): eth3: link is not ready
eth2: no IPv6 routers present
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_alloc_ucontext:114
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_device:867
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_dealloc_ucontext:104
-------------- next part --------------
iw_ch:open_rnic_toe line 140
cxio: opening rnic dev cxgb3c0
cxio: rnic cxgb3c0 info: tpt_base=0xa000000 tpt_top=0xbffffff pbl_base=0xe000000 pbl_top=0xfffffff rqt_base=0xc000000, rqt_top=0xdffffff
cxio: udbell_len=0x8000000 udbell_physbase=0xf0000000 kdb_addr=f8852004
cxio: CtrlQP dma_addr=0x339a0000 kaddr=f39a0000 size=1024
iw_ch:open_rnic_init line 74
iw_ch:iwch_register_device line 983
iw_ch: dev name = cxgb3_%d
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_port:897
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_port:897
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_port:897
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_pkey:840
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_gid:850
iw_ch:ibdev c26adc00, port 1, index 0, gid f5e15804
iw_ch:dev c26adc00 port 1 netdev f7f50000
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_port:897
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_pkey:840
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_gid:850
iw_ch:ibdev c26adc00, port 2, index 0, gid f5e157c4
iw_ch:dev c26adc00 port 2 netdev f7011800
iw_ch:iwch_register_device line 1069
iw_ch:iwch_register_device line 1077
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:show_board:961 dev = 0xc26adc00
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:show_hca:952
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:show_fw_ver:940
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:show_rev:928
iw_ch:drivers/infiniband/hw/cxgb3/iwch_provider.c:iwch_query_device:867
ADDRCONF(NETDEV_UP): eth3: link is not ready
ADDRCONF(NETDEV_UP): eth2: link is not ready
eth2: link up, 10Gbps, full-duplex
ADDRCONF(NETDEV_CHANGE): eth2: link becomes ready
eth2: no IPv6 routers present