[ewg] RDMA CM question

Kevin Harms harms at alcf.anl.gov
Thu Feb 9 08:32:12 PST 2012


I'm running this test:

[root at host1 ~]# rdma_bw --cma  -n 500
17734: | port=18515 | ib_port=1 | size=65536 | tx_depth=100 | sl=0 | iters=500 | duplex=0 | cma=1 |
17734: Local address:  LID 0000, QPN 000000, PSN 0xa10162 RKey 0xc0003c00 VAddr 0x002af7672fa000
17734: Remote address: LID 0000, QPN 000000, PSN 0x64bc9e00, RKey 0x70270048 VAddr 0x001d9bff0f0000

17734:pp_wait_for_done: bad wc status 5
17734:pp_wait_for_done: bad wc opcode 0
17734:pp_send_done: bad wc status 5

[root at host2 ~]# rdma_bw --cma -n 500 host1
25471: | port=18515 | ib_port=1 | size=65536 | tx_depth=100 | sl=0 | iters=500 | duplex=0 | cma=1 |
25471: Local address:  LID 0000, QPN 000000, PSN 0x9ebc64 RKey 0x48002770 VAddr 0x000fff9b1d0000
25471: Remote address: LID 0000, QPN 000000, PSN 0x6201a100, RKey 0x3c00c0 VAddr 0xa02f67f72a0000

25471:main: Completion with error at client:
25471:main: Failed status 10: wr_id 3
25471:main: scnt=100, ccnt=0

  removing '--cma' results in the test working fine. We are running centos 5.5 on host1 and RHEL6 on host2. They do have different librdmacm pacakges.

[root at host1 ~]# rpm -qa | grep librdmacm
librdmacm-1.0.13-1

[root at host2 ~]# rpm -qa | grep librdmacm
librdmacm-1.0.15-1.ppc64

  is there a known incompatibility between those two? (and or x86_64 and ppc64)

thanks,
kevin

-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 2909 bytes
Desc: not available
URL: <http://lists.openfabrics.org/pipermail/ewg/attachments/20120209/9890cf8b/attachment.bin>


More information about the ewg mailing list