Content of /var/log/messages on openfab2 (server): -------------------------------------------------- Jul 7 06:49:41 openfab2 kernel: krping: proc write |server,port=9999,addr=17.2.2.102,validate,verbose| Jul 7 06:49:41 openfab2 kernel: server Jul 7 06:49:41 openfab2 kernel: port 9999 Jul 7 06:49:41 openfab2 kernel: ipaddr (17.2.2.102) Jul 7 06:49:41 openfab2 kernel: validate data Jul 7 06:49:41 openfab2 kernel: verbose Jul 7 06:49:41 openfab2 kernel: created cm_id dfcc9000 Jul 7 06:49:41 openfab2 kernel: rdma_bind_addr successful Jul 7 06:49:41 openfab2 kernel: rdma_listen Jul 7 06:50:26 openfab2 kernel: cma_event type 4 cma_id f7e1d200 (child) Jul 7 06:50:26 openfab2 kernel: child cma f7e1d200 Jul 7 06:50:26 openfab2 kernel: created pd f7da99c0 Jul 7 06:50:26 openfab2 kernel: created cq f6e45340 Jul 7 06:50:26 openfab2 kernel: created qp f6db4680 Jul 7 06:50:26 openfab2 kernel: krping_setup_buffers called on cb f7e23e00 Jul 7 06:50:26 openfab2 kernel: allocated & registered buffers... Jul 7 06:50:26 openfab2 kernel: accepting client connection request Jul 7 06:50:26 openfab2 kernel: cma_event type 9 cma_id f7e1d200 (child) Jul 7 06:50:26 openfab2 kernel: ESTABLISHED Jul 7 06:50:26 openfab2 kernel: recv completion Jul 7 06:50:26 openfab2 kernel: Received rkey 17c4e00 addr 1981df00 len 64 from peer Jul 7 06:50:26 openfab2 kernel: server received sink adv Jul 7 06:50:26 openfab2 kernel: server posted rdma read req Jul 7 06:50:26 openfab2 kernel: rdma read completion Jul 7 06:50:26 openfab2 kernel: server received read complete Jul 7 06:50:26 openfab2 kernel: server ping data: rdma-ping-0: ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqr Jul 7 06:50:26 openfab2 kernel: server posted go ahead Jul 7 06:50:26 openfab2 kernel: send completion Jul 7 06:50:26 openfab2 kernel: recv completion Jul 7 06:50:26 openfab2 kernel: Received rkey 17c4e00 addr 1071cdc0 len 64 from peer Jul 7 06:50:26 openfab2 kernel: server received sink adv Jul 7 06:50:26 openfab2 kernel: rdma write from lkey 17c4e00 laddr 36e5dfc0 len 64 Jul 7 06:50:26 openfab2 kernel: rdma write completion Jul 7 06:50:26 openfab2 kernel: server rdma write complete Jul 7 06:50:26 openfab2 kernel: server posted go ahead Jul 7 06:50:26 openfab2 kernel: send completion Jul 7 06:50:26 openfab2 kernel: recv completion Jul 7 06:50:26 openfab2 kernel: Received rkey 17c4e00 addr 1981df00 len 64 from peer Jul 7 06:50:26 openfab2 kernel: server received sink adv Jul 7 06:50:26 openfab2 kernel: server posted rdma read req Jul 7 06:50:26 openfab2 kernel: rdma read completion Jul 7 06:50:26 openfab2 kernel: server received read complete Jul 7 06:50:26 openfab2 kernel: server ping data: rdma-ping-1: BCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrs Jul 7 06:50:26 openfab2 kernel: server posted go ahead Jul 7 06:50:26 openfab2 kernel: send completion Jul 7 06:50:26 openfab2 kernel: recv completion Jul 7 06:50:26 openfab2 kernel: Received rkey 17c4e00 addr 1071cdc0 len 64 from peer Jul 7 06:50:26 openfab2 kernel: server received sink adv Jul 7 06:50:26 openfab2 kernel: rdma write from lkey 17c4e00 laddr 36e5dfc0 len 64 Jul 7 06:50:26 openfab2 kernel: rdma write completion Jul 7 06:50:26 openfab2 kernel: server rdma write complete Jul 7 06:50:26 openfab2 kernel: server posted go ahead Jul 7 06:50:26 openfab2 kernel: send completion Jul 7 06:50:26 openfab2 kernel: recv completion Jul 7 06:50:26 openfab2 kernel: Received rkey 17c4e00 addr 1981df00 len 64 from peer Jul 7 06:50:26 openfab2 kernel: server received sink adv Jul 7 06:50:26 openfab2 kernel: server posted rdma read req Jul 7 06:50:26 openfab2 kernel: rdma read completion Jul 7 06:50:26 openfab2 kernel: server received read complete Jul 7 06:50:26 openfab2 kernel: server ping data: rdma-ping-2: CDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrst Jul 7 06:50:26 openfab2 kernel: server posted go ahead Jul 7 06:50:26 openfab2 kernel: send completion Jul 7 06:50:26 openfab2 kernel: recv completion Jul 7 06:50:26 openfab2 kernel: Received rkey 17c4e00 addr 1071cdc0 len 64 from peer Jul 7 06:50:26 openfab2 kernel: server received sink adv Jul 7 06:50:26 openfab2 kernel: rdma write from lkey 17c4e00 laddr 36e5dfc0 len 64 Jul 7 06:50:26 openfab2 kernel: rdma write completion Jul 7 06:50:26 openfab2 kernel: server rdma write complete Jul 7 06:50:26 openfab2 kernel: server posted go ahead Jul 7 06:50:26 openfab2 kernel: send completion Jul 7 06:50:26 openfab2 kernel: recv completion Jul 7 06:50:26 openfab2 kernel: Received rkey 17c4e00 addr 1981df00 len 64 from peer Jul 7 06:50:26 openfab2 kernel: server received sink adv Jul 7 06:50:26 openfab2 kernel: server posted rdma read req Jul 7 06:50:26 openfab2 kernel: rdma read completion Jul 7 06:50:26 openfab2 kernel: server received read complete Jul 7 06:50:26 openfab2 kernel: server ping data: rdma-ping-3: DEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstu Jul 7 06:50:26 openfab2 kernel: server posted go ahead Jul 7 06:50:26 openfab2 kernel: send completion Jul 7 06:50:26 openfab2 kernel: recv completion Jul 7 06:50:26 openfab2 kernel: Received rkey 17c4e00 addr 1071cdc0 len 64 from peer Jul 7 06:50:26 openfab2 kernel: server received sink adv Jul 7 06:50:26 openfab2 kernel: rdma write from lkey 17c4e00 laddr 36e5dfc0 len 64 Jul 7 06:50:26 openfab2 kernel: rdma write completion Jul 7 06:50:26 openfab2 kernel: server rdma write complete Jul 7 06:50:26 openfab2 kernel: server posted go ahead Jul 7 06:50:26 openfab2 kernel: send completion Jul 7 06:50:26 openfab2 kernel: recv completion Jul 7 06:50:26 openfab2 kernel: Received rkey 17c4e00 addr 1981df00 len 64 from peer Jul 7 06:50:26 openfab2 kernel: server received sink adv Jul 7 06:50:26 openfab2 kernel: server posted rdma read req Jul 7 06:50:26 openfab2 kernel: rdma read completion Jul 7 06:50:26 openfab2 kernel: server received read complete Jul 7 06:50:26 openfab2 kernel: server ping data: rdma-ping-4: EFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuv Jul 7 06:50:26 openfab2 kernel: server posted go ahead Jul 7 06:50:26 openfab2 kernel: send completion Jul 7 06:50:26 openfab2 kernel: recv completion Jul 7 06:50:26 openfab2 kernel: Received rkey 17c4e00 addr 1071cdc0 len 64 from peer Jul 7 06:50:26 openfab2 kernel: server received sink adv Jul 7 06:50:26 openfab2 kernel: rdma write from lkey 17c4e00 laddr 36e5dfc0 len 64 Jul 7 06:50:26 openfab2 kernel: rdma write completion Jul 7 06:50:26 openfab2 kernel: server rdma write complete Jul 7 06:50:26 openfab2 kernel: server posted go ahead Jul 7 06:50:26 openfab2 kernel: send completion Jul 7 06:50:26 openfab2 kernel: recv completion Jul 7 06:50:26 openfab2 kernel: Received rkey 17c4e00 addr 1981df00 len 64 from peer Jul 7 06:50:26 openfab2 kernel: server received sink adv Jul 7 06:50:26 openfab2 kernel: server posted rdma read req Jul 7 06:50:26 openfab2 kernel: rdma read completion Jul 7 06:50:26 openfab2 kernel: server received read complete Jul 7 06:50:26 openfab2 kernel: server ping data: rdma-ping-5: FGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvw Jul 7 06:50:26 openfab2 kernel: server posted go ahead Jul 7 06:50:26 openfab2 kernel: send completion Jul 7 06:50:26 openfab2 kernel: recv completion Jul 7 06:50:26 openfab2 kernel: Received rkey 17c4e00 addr 1071cdc0 len 64 from peer Jul 7 06:50:26 openfab2 kernel: server received sink adv Jul 7 06:50:26 openfab2 kernel: rdma write from lkey 17c4e00 laddr 36e5dfc0 len 64 Jul 7 06:50:26 openfab2 kernel: rdma write completion Jul 7 06:50:26 openfab2 kernel: server rdma write complete Jul 7 06:50:26 openfab2 kernel: server posted go ahead Jul 7 06:50:26 openfab2 kernel: send completion Jul 7 06:50:26 openfab2 kernel: recv completion Jul 7 06:50:26 openfab2 kernel: Received rkey 17c4e00 addr 1981df00 len 64 from peer Jul 7 06:50:26 openfab2 kernel: server received sink adv Jul 7 06:50:26 openfab2 kernel: server posted rdma read req Jul 7 06:50:26 openfab2 kernel: rdma read completion Jul 7 06:50:26 openfab2 kernel: server received read complete Jul 7 06:50:26 openfab2 kernel: server ping data: rdma-ping-6: GHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwx Jul 7 06:50:26 openfab2 kernel: server posted go ahead Jul 7 06:50:26 openfab2 kernel: send completion Jul 7 06:50:26 openfab2 kernel: recv completion Jul 7 06:50:26 openfab2 kernel: Received rkey 17c4e00 addr 1071cdc0 len 64 from peer Jul 7 06:50:26 openfab2 kernel: server received sink adv Jul 7 06:50:26 openfab2 kernel: rdma write from lkey 17c4e00 laddr 36e5dfc0 len 64 Jul 7 06:50:26 openfab2 kernel: rdma write completion Jul 7 06:50:26 openfab2 kernel: server rdma write complete Jul 7 06:50:26 openfab2 kernel: server posted go ahead Jul 7 06:50:26 openfab2 kernel: send completion Jul 7 06:50:26 openfab2 kernel: recv completion Jul 7 06:50:26 openfab2 kernel: Received rkey 17c4e00 addr 1981df00 len 64 from peer Jul 7 06:50:26 openfab2 kernel: server received sink adv Jul 7 06:50:26 openfab2 kernel: server posted rdma read req Jul 7 06:50:26 openfab2 kernel: rdma read completion Jul 7 06:50:26 openfab2 kernel: server received read complete Jul 7 06:50:26 openfab2 kernel: server ping data: rdma-ping-7: HIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxy Jul 7 06:50:26 openfab2 kernel: server posted go ahead Jul 7 06:50:26 openfab2 kernel: send completion Jul 7 06:50:26 openfab2 kernel: recv completion Jul 7 06:50:26 openfab2 kernel: Received rkey 17c4e00 addr 1071cdc0 len 64 from peer Jul 7 06:50:26 openfab2 kernel: server received sink adv Jul 7 06:50:26 openfab2 kernel: rdma write from lkey 17c4e00 laddr 36e5dfc0 len 64 Jul 7 06:50:26 openfab2 kernel: rdma write completion Jul 7 06:50:26 openfab2 kernel: server rdma write complete Jul 7 06:50:26 openfab2 kernel: server posted go ahead Jul 7 06:50:26 openfab2 kernel: send completion Jul 7 06:50:26 openfab2 kernel: recv completion Jul 7 06:50:27 openfab2 kernel: Received rkey 17c4e00 addr 1981df00 len 64 from peer Jul 7 06:50:27 openfab2 kernel: server received sink adv Jul 7 06:50:27 openfab2 kernel: server posted rdma read req Jul 7 06:50:27 openfab2 kernel: rdma read completion Jul 7 06:50:27 openfab2 kernel: server received read complete Jul 7 06:50:27 openfab2 kernel: server ping data: rdma-ping-8: IJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz Jul 7 06:50:27 openfab2 kernel: server posted go ahead Jul 7 06:50:27 openfab2 kernel: send completion Jul 7 06:50:27 openfab2 kernel: recv completion Jul 7 06:50:27 openfab2 kernel: Received rkey 17c4e00 addr 1071cdc0 len 64 from peer Jul 7 06:50:27 openfab2 kernel: server received sink adv Jul 7 06:50:27 openfab2 kernel: rdma write from lkey 17c4e00 laddr 36e5dfc0 len 64 Jul 7 06:50:27 openfab2 kernel: rdma write completion Jul 7 06:50:27 openfab2 kernel: server rdma write complete Jul 7 06:50:27 openfab2 kernel: server posted go ahead Jul 7 06:50:27 openfab2 kernel: send completion Jul 7 06:50:27 openfab2 kernel: recv completion Jul 7 06:50:27 openfab2 kernel: Received rkey 17c4e00 addr 1981df00 len 64 from peer Jul 7 06:50:27 openfab2 kernel: server received sink adv Jul 7 06:50:27 openfab2 kernel: server posted rdma read req Jul 7 06:50:27 openfab2 kernel: rdma read completion Jul 7 06:50:27 openfab2 kernel: server received read complete Jul 7 06:50:27 openfab2 kernel: server ping data: rdma-ping-9: JKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyzA Jul 7 06:50:27 openfab2 kernel: server posted go ahead Jul 7 06:50:27 openfab2 kernel: send completion Jul 7 06:50:27 openfab2 kernel: recv completion Jul 7 06:50:27 openfab2 kernel: Received rkey 17c4e00 addr 1071cdc0 len 64 from peer Jul 7 06:50:27 openfab2 kernel: server received sink adv Jul 7 06:50:27 openfab2 kernel: rdma write from lkey 17c4e00 laddr 36e5dfc0 len 64 Jul 7 06:50:27 openfab2 kernel: rdma write completion Jul 7 06:50:27 openfab2 kernel: server rdma write complete Jul 7 06:50:27 openfab2 kernel: server posted go ahead Jul 7 06:50:27 openfab2 kernel: send completion Jul 7 06:50:27 openfab2 kernel: recv completion Jul 7 06:50:27 openfab2 kernel: Received rkey 17c4e00 addr 1981df00 len 64 from peer Jul 7 06:50:27 openfab2 kernel: r received sink adv Jul 7 06:50:27 openfab2 kernel: rdma write from lkey 17c4e00 laddr 36e5dfc0 len 64 Jul 7 06:50:27 openfab2 kernel: rdma write completion Jul 7 06:50:27 openfab2 kernel: server rdma write complete Jul 7 06:50:27 openfab2 kernel: server posted go ahead Jul 7 06:50:27 openfab2 kernel: send completion Jul 7 06:50:27 openfab2 kernel: recv completion Jul 7 06:50:27 openfab2 kernel: Received rkey 17c4e00 addr 1981df00 len 64 from peer Jul 7 06:50:27 openfab2 kernel: server received sink adv Jul 7 06:50:27 openfab2 kernel: server posted rdma read req Jul 7 06:50:27 openfab2 kernel: rdma read completion Jul 7 06:50:27 openfab2 kernel: server received read complete Jul 7 06:50:27 openfab2 kernel: server ping data: rdma-ping-1935: VWXYZ[\]^_`abcdefghijklmnopqrstuvwxyzABCDEFGHIJ Jul 7 06:50:27 openfab2 kernel: server posted go ahead Jul 7 06:50:27 openfab2 kernel: send completion Jul 7 06:50:27 openfab2 kernel: recv completion Jul 7 06:50:27 openfab2 kernel: Received rkey 17c4e00 addr 1071cdc0 len 64 from peer < Output continues for several thousand lines > Jul 7 06:52:06 openfab2 kernel: krping: cq completion failed status 5 Jul 7 06:52:06 openfab2 kernel: krping: wait for RDMA_READ_ADV state 10 Jul 7 06:52:06 openfab2 kernel: cm_close_handler:658 cm_id_priv=f6e453c0, state=6 Jul 7 06:52:06 openfab2 kernel: krping_free_buffers called on cb f7e23e00 Jul 7 06:52:06 openfab2 kernel: destroy cm_id dfcc9000 Jul 7 06:52:06 openfab2 kernel: krping: proc read called... Content of /var/log/messages on openfab (client): -------------------------------------------------- Jul 7 09:04:18 openfab kernel: krping: proc write |client,port=9999,addr=17.2.2.102,validate,verbose| Jul 7 09:04:18 openfab kernel: client Jul 7 09:04:18 openfab kernel: port 9999 Jul 7 09:04:18 openfab kernel: ipaddr (17.2.2.102) Jul 7 09:04:18 openfab kernel: validate data Jul 7 09:04:18 openfab kernel: verbose Jul 7 09:04:18 openfab kernel: created cm_id ffff81001ff76a00 Jul 7 09:04:18 openfab kernel: cma_event type 0 cma_id ffff81001ff76a00 (parent) Jul 7 09:04:18 openfab kernel: cma_event type 2 cma_id ffff81001ff76a00 (parent) Jul 7 09:04:18 openfab kernel: rdma_resolve_addr - rdma_resolve_route successful Jul 7 09:04:18 openfab kernel: created pd ffff810018060800 Jul 7 09:04:18 openfab kernel: created cq ffff81001f86e380 Jul 7 09:04:18 openfab kernel: created qp ffff81001f86e280 Jul 7 09:04:18 openfab kernel: krping_setup_buffers called on cb ffff810010589c00 Jul 7 09:04:18 openfab kernel: allocated & registered buffers... Jul 7 09:04:18 openfab kernel: cma_event type 9 cma_id ffff81001ff76a00 (parent) Jul 7 09:04:18 openfab kernel: ESTABLISHED Jul 7 09:04:18 openfab kernel: rdma_connect successful Jul 7 09:04:18 openfab kernel: RDMA addr 1981df00 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: RDMA addr 1071cdc0 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: ping data: rdma-ping-0: ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqr Jul 7 09:04:18 openfab kernel: RDMA addr 1981df00 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: RDMA addr 1071cdc0 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: ping data: rdma-ping-1: BCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrs Jul 7 09:04:18 openfab kernel: RDMA addr 1981df00 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: RDMA addr 1071cdc0 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: ping data: rdma-ping-2: CDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrst Jul 7 09:04:18 openfab kernel: RDMA addr 1981df00 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: RDMA addr 1071cdc0 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: ping data: rdma-ping-3: DEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstu Jul 7 09:04:18 openfab kernel: RDMA addr 1981df00 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: RDMA addr 1071cdc0 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: ping data: rdma-ping-4: EFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuv Jul 7 09:04:18 openfab kernel: RDMA addr 1981df00 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: RDMA addr 1071cdc0 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: ping data: rdma-ping-5: FGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvw Jul 7 09:04:18 openfab kernel: RDMA addr 1981df00 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: RDMA addr 1071cdc0 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: ping data: rdma-ping-6: GHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwx Jul 7 09:04:18 openfab kernel: RDMA addr 1981df00 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: RDMA addr 1071cdc0 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: ping data: rdma-ping-7: HIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxy Jul 7 09:04:18 openfab kernel: RDMA addr 1981df00 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: RDMA addr 1071cdc0 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: ping data: rdma-ping-8: IJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz Jul 7 09:04:18 openfab kernel: RDMA addr 1981df00 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: RDMA addr 1071cdc0 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: ping data: rdma-ping-9: JKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyzA Jul 7 09:04:18 openfab kernel: RDMA addr 1981df00 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: RDMA addr 1071cdc0 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: ping data: rdma-ping-10: KLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyzA Jul 7 09:04:18 openfab kernel: RDMA addr 1981df00 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: RDMA addr 1071cdc0 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: ping data: rdma-ping-11: LMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyzAB Jul 7 09:04:18 openfab kernel: RDMA addr 1981df00 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion Jul 7 09:04:18 openfab kernel: RDMA addr 1071cdc0 rkey 17c4e00 len 64 Jul 7 09:04:18 openfab kernel: send completion Jul 7 09:04:18 openfab kernel: recv completion < Continues for several thousand lines > Jul 7 09:05:18 openfab kernel: krping_free_buffers called on cb ffff810010589c00 Jul 7 09:05:18 openfab kernel: krping: cq completion failed status 5 Jul 7 09:05:18 openfab kernel: cm_close_handler:658 cm_id_priv=ffff81001f86e180, state=5 Jul 7 09:05:18 openfab kernel: cma_event type 10 cma_id ffff81001ff76a00 (parent) Jul 7 09:05:18 openfab kernel: krping: DISCONNECT EVENT... Jul 7 09:05:18 openfab kernel: destroy cm_id ffff81001ff76a00