[ewg] RE: [ofa-general] how do I use uDAPL with iWARP?

[Steve Wise]

I can reproduce this.  Lemme dig into it...

Steve.


Scott Weitzenkamp (sweitzen) wrote:
> Steve,
> 
> Thanks, that gets further, but dtest still fails.
> 
> Client side:
> 
> [releng at svbu-qa2950-2 ~]$ DAPL_MAX_INLINE=64 dtest -h 192.168.0.198
> 13926 Running as client - OpenIB-cma
> 13926 Server Name: 192.168.0.198
> 13926 Server Net Address: 192.168.0.198
> 13926 Waiting for connect response
> 13926 Error unexpected conn event : DAT_CONNECTION_EVENT_UNREACHABLE
> 13926 Error connect_ep: DAT_ABORT
> 
> 13926: DAPL Test Complete.
> 
> 13926: Message RTT: Total=      0.00 usec, 10 bursts, itime=      0.00
> usec, pc=
> 0
> 13926: RDMA write:  Total=      0.00 usec, 10 bursts, itime=      0.00
> usec, pc=
> 0
> 13926: RDMA read:   Total=      0.00 usec,   4 bursts, itime=      0.00
> usec, pc
> =0
> 13926: RDMA read:   Total=      0.00 usec,   4 bursts, itime=      0.00
> usec, pc
> =0
> 13926: RDMA read:   Total=      0.00 usec,   4 bursts, itime=      0.00
> usec, pc
> =0
> 13926: RDMA read:   Total=      0.00 usec,   4 bursts, itime=      0.00
> usec, pc
> =0
> 13926: open:        36619.19 usec
> 13926: close:       32500.98 usec
> 13926: PZ create:       7.87 usec
> 13926: PZ free:         4.05 usec
> 13926: LMR create:     58.89 usec
> 13926: LMR free:       11.92 usec
> 13926: EVD create:      9.78 usec
> 13926: EVD free:       14.07 usec
> 13926: EP create:      78.92 usec
> 13926: EP free:        26.23 usec
> 13926: TOTAL:         199.79 usec
> 
> Server side:
> 
> [releng at svbu-qa2950-1 ~]$ DAPL_MAX_INLINE=64 dtest
> 11461 Running as server - OpenIB-cma
> 11461 Server waiting for connect request..
> 11461 Waiting for connect response
> 
> 11461 CONNECTED!
> 
> 11461 Send RMR to remote: snd_msg:
> r_key_ctx=bff,pad=0,va=146db580,len=0x40
> 11461 Waiting for remote to send RMR data
> 11461 Error waiting on h_dto_rcv_evd: DAT_TIMEOUT_EXPIRED
> 11461 Error connect_ep: DAT_TIMEOUT_EXPIRED
> 
> 11461: DAPL Test Complete.
> 
> 11461: Message RTT: Total=      0.00 usec, 10 bursts, itime=      0.00
> usec, pc=
> 0
> 11461: RDMA write:  Total=      0.00 usec, 10 bursts, itime=      0.00
> usec, pc=
> 0
> 11461: RDMA read:   Total=      0.00 usec,   4 bursts, itime=      0.00
> usec, pc
> =0
> 11461: RDMA read:   Total=      0.00 usec,   4 bursts, itime=      0.00
> usec, pc
> =0
> 11461: RDMA read:   Total=      0.00 usec,   4 bursts, itime=      0.00
> usec, pc
> =0
> 11461: RDMA read:   Total=      0.00 usec,   4 bursts, itime=      0.00
> usec, pc
> =0
> 11461: open:       900676.01 usec
> 11461: close:       31543.97 usec
> 11461: PZ create:       7.87 usec
> 11461: PZ free:         5.01 usec
> 11461: LMR create:     51.98 usec
> 11461: LMR free:       12.16 usec
> 11461: EVD create:     10.97 usec
> 11461: EVD free:       12.87 usec
> 11461: EP create:      77.01 usec
> 11461: EP free:        30.04 usec
> 11461: TOTAL:         195.03 usec
> 
> Scott
> 
>  
> 
>> -----Original Message-----
>> From: Steve Wise [mailto:swise at opengridcomputing.com] 
>> Sent: Thursday, April 03, 2008 9:19 AM
>> To: Scott Weitzenkamp (sweitzen)
>> Cc: Joshua Bernstein; OpenFabrics EWG; [ofa_general]
>> Subject: Re: [ewg] RE: [ofa-general] how do I use uDAPL with iWARP?
>>
>>
>>
>> Scott Weitzenkamp (sweitzen) wrote:
>>> I tried that, and it didn't work:
>>>
>>> [root at svbu-qa2950-1 ~]# grep eth /etc/dat.conf
>>> OpenIB-cma u1.2 nonthreadsafe default libdaplcma.so.1 
>> dapl.1.2 "eth2 0"
>>> ""
>>> [root at svbu-qa2950-1 ~]# dtest
>>> 10194 Running as server - OpenIB-cma
>>> 10194 Error dat_ep_create: DAT_INVALID_HANDLE
>>> 10194 Error freeing EP: DAT_INVALID_HANDLE DAT_INVALID_HANDLE_EP
>>>
>> try setting DAPL_MAX_INLINE=64
>>
>>