openfab:~ # echo client,port=9999,addr=17.2.2.102,validate >/proc/krping
openfab:~ # cat /proc/krping
1-amso0 2918224 182389 2918208 182388 0 0 0 0

Content of /var/log/messages on openfab:
----------------------------------------
Jul  7 06:56:01 openfab kernel: krping: proc write |client,port=9999,addr=17.2.2.102,validate|
Jul  7 06:56:01 openfab kernel: client
Jul  7 06:56:01 openfab kernel: port 9999
Jul  7 06:56:01 openfab kernel: ipaddr (17.2.2.102)
Jul  7 06:56:01 openfab kernel: validate data
Jul  7 06:56:01 openfab kernel: created cm_id ffff81000d207a00
Jul  7 06:56:01 openfab kernel: cma_event type 0 cma_id ffff81000d207a00 (parent)
Jul  7 06:56:01 openfab kernel: cma_event type 2 cma_id ffff81000d207a00 (parent)
Jul  7 06:56:01 openfab kernel: rdma_resolve_addr - rdma_resolve_route successful
Jul  7 06:56:01 openfab kernel: created pd ffff81000cdbf600
Jul  7 06:56:01 openfab kernel: created cq ffff81000c33b9c0
Jul  7 06:56:01 openfab kernel: created qp ffff81001fa099c0
Jul  7 06:56:01 openfab kernel: krping_setup_buffers called on cb ffff81000d8eb800
Jul  7 06:56:01 openfab kernel: allocated & registered buffers...
Jul  7 06:56:01 openfab kernel: cma_event type 9 cma_id ffff81000d207a00 (parent)
Jul  7 06:56:01 openfab kernel: ESTABLISHED
Jul  7 06:56:01 openfab kernel: rdma_connect successful
Jul  7 06:56:01 openfab kernel: RDMA addr cfa4f40 rkey 17c5c00 len 64
Jul  7 06:56:01 openfab kernel: send completion
Jul  7 06:56:01 openfab kernel: recv completion
Jul  7 06:56:01 openfab kernel: RDMA addr cfa4d40 rkey 17c5c00 len 64
Jul  7 06:56:01 openfab kernel: send completion
Jul  7 06:56:01 openfab kernel: recv completion
Jul  7 06:56:01 openfab kernel: RDMA addr cfa4f40 rkey 17c5c00 len 64
Jul  7 06:56:01 openfab kernel: send completion
Jul  7 06:56:01 openfab kernel: recv completion
Jul  7 06:56:01 openfab kernel: RDMA addr cfa4d40 rkey 17c5c00 len 64
Jul  7 06:56:01 openfab kernel: send completion
Jul  7 06:56:01 openfab kernel: recv completion
Jul  7 06:56:01 openfab kernel: RDMA addr cfa4f40 rkey 17c5c00 len 64
Jul  7 06:56:01 openfab kernel: send completion
Jul  7 06:56:01 openfab kernel: recv completion
Jul  7 06:56:01 openfab kernel: RDMA addr cfa4d40 rkey 17c5c00 len 64
Jul  7 06:56:01 openfab kernel: send completion
Jul  7 06:56:01 openfab kernel: recv completion
Jul  7 06:56:01 openfab kernel: RDMA addr cfa4f40 rkey 17c5c00 len 64
Jul  7 06:56:01 openfab kernel: send completion
Jul  7 06:56:01 openfab kernel: recv completion

< Above messages repeated thousands of times >

Jul  7 06:57:32 openfab kernel: krping: cq completion failed status 5
Jul  7 06:57:32 openfab kernel: krping: wait for RDMA_WRITE_ADV state 10
Jul  7 06:57:32 openfab kernel: cm_close_handler:658 cm_id_priv=ffff81000c33b8c0, state=5
Jul  7 06:57:32 openfab kernel: cma_event type 10 cma_id ffff81000d207a00 (parent)
Jul  7 06:57:32 openfab kernel: krping: DISCONNECT EVENT...
Jul  7 06:57:32 openfab kernel: krping_free_buffers called on cb ffff81000d8eb800
Jul  7 06:57:32 openfab kernel: destroy cm_id ffff81000d207a00
Jul  7 07:00:28 openfab kernel: krping: proc read called...











openfab2:~ # echo server,port=9999,addr=17.2.2.102,validate >/proc/krping
openfab2:~ # cat /proc/krping
1-amso0 5523312 345207 5523328 345208 11046656 172604 11046656 172604

Content of /var/log/messages on openfab2:
-----------------------------------------
Jul  7 04:41:44 openfab2 kernel: krping: proc write |server,port=9999,addr=17.2.2.102,validate|
Jul  7 04:41:44 openfab2 kernel: server
Jul  7 04:41:44 openfab2 kernel: port 9999
Jul  7 04:41:44 openfab2 kernel: ipaddr (17.2.2.102)
Jul  7 04:41:44 openfab2 kernel: validate data
Jul  7 04:41:44 openfab2 kernel: created cm_id f7e59200
Jul  7 04:41:44 openfab2 kernel: rdma_bind_addr successful
Jul  7 04:41:44 openfab2 kernel: rdma_listen
Jul  7 04:42:08 openfab2 kernel: cma_event type 4 cma_id f7e6a200 (child)
Jul  7 04:42:08 openfab2 kernel: child cma f7e6a200
Jul  7 04:42:08 openfab2 kernel: created pd f7267480
Jul  7 04:42:08 openfab2 kernel: created cq f6e88740
Jul  7 04:42:08 openfab2 kernel: created qp f6e14880
Jul  7 04:42:08 openfab2 kernel: krping_setup_buffers called on cb f7e59800
Jul  7 04:42:08 openfab2 kernel: allocated & registered buffers...
Jul  7 04:42:08 openfab2 kernel: accepting client connection request
Jul  7 04:42:08 openfab2 kernel: cma_event type 9 cma_id f7e6a200 (child)
Jul  7 04:42:08 openfab2 kernel: ESTABLISHED
Jul  7 04:42:08 openfab2 kernel: recv completion
Jul  7 04:42:08 openfab2 kernel: Received rkey 17c5c00 addr cfa4f40 len 64 from peer
Jul  7 04:42:08 openfab2 kernel: server received sink adv
Jul  7 04:42:08 openfab2 kernel: server posted rdma read req
Jul  7 04:42:08 openfab2 kernel: rdma read completion
Jul  7 04:42:08 openfab2 kernel: server received read complete
Jul  7 04:42:08 openfab2 kernel: server posted go ahead
Jul  7 04:42:08 openfab2 kernel: send completion
Jul  7 04:42:08 openfab2 kernel: recv completion
Jul  7 04:42:08 openfab2 kernel: Received rkey 17c5c00 addr cfa4d40 len 64 from peer
Jul  7 04:42:08 openfab2 kernel: server received sink adv
Jul  7 04:42:08 openfab2 kernel: rdma write from lkey 17c4e00 laddr 36de8340 len 64
Jul  7 04:42:08 openfab2 kernel: rdma write completion
Jul  7 04:42:08 openfab2 kernel: server rdma write complete
Jul  7 04:42:08 openfab2 kernel: server posted go ahead
Jul  7 04:42:08 openfab2 kernel: send completion
Jul  7 04:42:08 openfab2 kernel: recv completion
Jul  7 04:42:08 openfab2 kernel: Received rkey 17c5c00 addr cfa4f40 len 64 from peer
Jul  7 04:42:08 openfab2 kernel: server received sink adv
Jul  7 04:42:08 openfab2 kernel: server posted rdma read req
Jul  7 04:42:08 openfab2 kernel: rdma read completion
Jul  7 04:42:08 openfab2 kernel: server received read complete
Jul  7 04:42:08 openfab2 kernel: server posted go ahead
Jul  7 04:42:08 openfab2 kernel: send completion
Jul  7 04:42:08 openfab2 kernel: recv completion
Jul  7 04:42:08 openfab2 kernel: Received rkey 17c5c00 addr cfa4d40 len 64 from peer
Jul  7 04:42:08 openfab2 kernel: server received sink adv
Jul  7 04:42:08 openfab2 kernel: rdma write from lkey 17c4e00 laddr 36de8340 len 64
Jul  7 04:42:08 openfab2 kernel: rdma write completion
Jul  7 04:42:08 openfab2 kernel: server rdma write complete
Jul  7 04:42:08 openfab2 kernel: server posted go ahead
Jul  7 04:42:08 openfab2 kernel: send completion
Jul  7 04:42:08 openfab2 kernel: recv completion
Jul  7 04:42:08 openfab2 kernel: Received rkey 17c5c00 addr cfa4f40 len 64 from peer
Jul  7 04:42:08 openfab2 kernel: server received sink adv
Jul  7 04:42:08 openfab2 kernel: server posted rdma read req
Jul  7 04:42:08 openfab2 kernel: rdma read completion
Jul  7 04:42:08 openfab2 kernel: server received read complete
Jul  7 04:42:08 openfab2 kernel: server posted go ahead
Jul  7 04:42:08 openfab2 kernel: send completion
Jul  7 04:42:08 openfab2 kernel: recv completion

<Above messages repeated thousands of times >

Jul  7 04:44:25 openfab2 kernel: krping: wait for RDMA_READ_COMPLETE state 6
Jul  7 04:44:25 openfab2 kernel: rdma read completion
Jul  7 04:44:25 openfab2 kernel: krping: cq completion failed status 5
Jul  7 04:44:25 openfab2 kernel: cm_close_handler:658 cm_id_priv=f6e887c0, state=6
Jul  7 04:44:25 openfab2 kernel: krping_free_buffers called on cb f7e59800
Jul  7 04:44:25 openfab2 kernel: destroy cm_id f7e59200
Jul  7 04:46:32 openfab2 zmd: ShutdownManager (WARN): Preparing to sleep...
Jul  7 04:46:32 openfab2 zmd: ShutdownManager (WARN): Going to sleep, waking up at 07/08/2006 04:06:32