[openib-general] Problem running rping on chelsio T3 adapters
Sundeep Narravula
narravul at cse.ohio-state.edu
Thu Jul 20 00:05:35 PDT 2006
Hi,
> What does your network configuration look like? IE send ifconfig output
> on both systems.
> Send the output of lsmod on both systems.
I have attached both these for both the systems.
> Does krping work?
No. It fails with the same error.
> Can you ssh between the 2 systems using the T3 ip addresses?
No.
> Do the following libs exist in /usr/local/lib:
> libibverbs.*
> librmdacm.*
These exist.
> libcxgb3.*
This is not in /usr/local/lib.
/usr/local/lib/infiniband/cxgb3.* exist though.
> Do ldconfig -v and make sure libibverbs is only found in /usr/local/lib.
> If you have OFED or some other rpm package with libibverbs installed,
> you'll have problems.
Checked this. Only one exists.
> For some reason it looks to be trying to load the MTHCA Infiniband
> library. Do you have IB cards in the system?
Yes. We do have IB nics on the system.
--Sundeep.
>
> Steve.
>
>
> On Wed, 2006-07-19 at 13:28 -0400, Sundeep Narravula wrote:
> > Hi,
> >
> > We are using kernel 2.6.16.3 and installed the latest code/drivers from
> > the iwarp branch. Currently, we are seeing an address resolution problem
> > while using rping.
> >
> > [narravul at d1-as4 examples]$ ./rping -c -VvC100 -a 150.10.11.200 -p 9999
> > libibverbs: Warning: couldn't load driver
> > /usr/local/lib/infiniband/mthca.so: /usr/local/lib/infiniband/mthca.so:
> > undefined symbol: ibv_cmd_query_pkey
> > cma event 1, error -110
> >
> > The server hangs and cannot be killed.
> >
> > Both the nodes are connected to the switch and I am able to ping the local
> > ip addresses. Is there anything we are missing?
> >
> > Thanks,
> > --Sundeep.
> >
> >
> >
> >
> >
> > _______________________________________________
> > openib-general mailing list
> > openib-general at openib.org
> > http://openib.org/mailman/listinfo/openib-general
> >
> > To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
> >
>
-------------- next part --------------
Module Size Used by
rdma_krping 21512 0
rdma_ucm 16384 0
ib_ucm 19972 0
ib_uverbs 38312 2 rdma_ucm,ib_ucm
ib_umad 18992 0
rdma_cm 28036 2 rdma_krping,rdma_ucm
iw_cm 13316 1 rdma_cm
ib_addr 11524 1 rdma_cm
ib_cm 35844 2 ib_ucm,rdma_cm
ib_local_sa 15880 2 rdma_ucm,rdma_cm
findex 8192 1 ib_local_sa
ib_sa 17060 2 rdma_cm,ib_local_sa
ib_mad 38816 4 ib_umad,ib_cm,ib_local_sa,ib_sa
iw_cxgb3 76244 0
cxgb3c 24112 1 iw_cxgb3
ib_core 49536 11 rdma_krping,ib_ucm,ib_uverbs,ib_umad,rdma_cm,iw_cm,ib_cm,ib_local_sa,ib_sa,ib_mad,iw_cxgb3
nfs 201324 2
lockd 60424 2 nfs
ipv6 248416 16
parport_pc 30148 1
lp 16456 0
parport 38728 2 parport_pc,lp
autofs4 23044 1
sunrpc 142012 3 nfs,lockd
dm_mod 57624 0
button 10896 0
battery 13700 0
ac 9092 0
ohci_hcd 23556 0
i2c_piix4 12816 0
i2c_core 25088 1 i2c_piix4
cxgb3 91664 1 cxgb3c
e1000 104884 0
tg3 98052 0
floppy 61252 0
-------------- next part --------------
Module Size Used by
rdma_krping 21512 0
rdma_ucm 16384 0
ib_ucm 19972 0
ib_uverbs 38312 2 rdma_ucm,ib_ucm
ib_umad 18992 0
rdma_cm 28036 2 rdma_krping,rdma_ucm
iw_cm 13316 1 rdma_cm
ib_addr 11524 1 rdma_cm
ib_cm 35844 2 ib_ucm,rdma_cm
ib_local_sa 15880 2 rdma_ucm,rdma_cm
findex 8192 1 ib_local_sa
ib_sa 17060 2 rdma_cm,ib_local_sa
ib_mad 38816 4 ib_umad,ib_cm,ib_local_sa,ib_sa
iw_cxgb3 76244 0
cxgb3c 24112 1 iw_cxgb3
ib_core 49536 11 rdma_krping,ib_ucm,ib_uverbs,ib_umad,rdma_cm,iw_cm,ib_cm,ib_local_sa,ib_sa,ib_mad,iw_cxgb3
nfs 201324 2
lockd 60424 2 nfs
ipv6 248416 16
parport_pc 30148 1
lp 16456 0
parport 38728 2 parport_pc,lp
autofs4 23044 1
sunrpc 142012 3 nfs,lockd
dm_mod 57624 0
button 10896 0
battery 13700 0
ac 9092 0
ohci_hcd 23556 0
i2c_piix4 12816 0
i2c_core 25088 1 i2c_piix4
cxgb3 91664 1 cxgb3c
e1000 104884 0
tg3 98052 0
floppy 61252 0
-------------- next part --------------
eth0 Link encap:Ethernet HWaddr 00:30:48:52:78:14
inet addr:192.168.103.10 Bcast:192.168.255.255 Mask:255.255.0.0
inet6 addr: fe80::230:48ff:fe52:7814/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:22678 errors:0 dropped:0 overruns:0 frame:0
TX packets:13466 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:2198016 (2.0 MiB) TX bytes:1334264 (1.2 MiB)
Base address:0x8f00 Memory:ee1a0000-ee1c0000
eth2 Link encap:Ethernet HWaddr 00:07:43:01:10:61
inet addr:150.11.11.101 Bcast:150.11.255.255 Mask:255.255.0.0
inet6 addr: fe80::207:43ff:fe01:1061/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)
Interrupt:185 Memory:febff000-febfffff
eth3 Link encap:Ethernet HWaddr 00:07:43:01:10:62
inet addr:150.10.11.101 Bcast:150.10.255.255 Mask:255.255.0.0
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)
Interrupt:185 Memory:febff000-febfffff
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:56 errors:0 dropped:0 overruns:0 frame:0
TX packets:56 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:4252 (4.1 KiB) TX bytes:4252 (4.1 KiB)
-------------- next part --------------
eth0 Link encap:Ethernet HWaddr 00:30:48:52:84:A2
inet addr:192.168.103.9 Bcast:192.168.255.255 Mask:255.255.0.0
inet6 addr: fe80::230:48ff:fe52:84a2/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:11787 errors:0 dropped:0 overruns:0 frame:0
TX packets:2547 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:1093128 (1.0 MiB) TX bytes:228608 (223.2 KiB)
Base address:0x8f00 Memory:ee1a0000-ee1c0000
eth2 Link encap:Ethernet HWaddr 00:07:43:01:10:5F
inet addr:150.11.11.100 Bcast:150.11.255.255 Mask:255.255.0.0
inet6 addr: fe80::207:43ff:fe01:105f/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:1 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 b) TX bytes:94 (94.0 b)
Interrupt:185 Memory:febff000-febfffff
eth3 Link encap:Ethernet HWaddr 00:07:43:01:10:60
inet addr:150.10.11.100 Bcast:150.10.255.255 Mask:255.255.0.0
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)
Interrupt:185 Memory:febff000-febfffff
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:56 errors:0 dropped:0 overruns:0 frame:0
TX packets:56 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:4252 (4.1 KiB) TX bytes:4252 (4.1 KiB)
More information about the general
mailing list