[openib-general] Heads up on SDP RDMA support for synchronous socket operations
Michael S. Tsirkin
mst at mellanox.co.il
Thu Aug 25 02:56:49 PDT 2005
Quoting r. Steve Wooding <steve_wooding at keysounds.co.uk>:
> I look forward to trying it out when its ready.
You can now download preliminary patches that add zero-copy RDMA (zcopy)
support for synchronous send operations. The receive side still performs
a copy at this stage.
These patches are not yet intended for trunk inclusion.
Todo:
- implement zero-copy RDMA on the receive side
- bugfixes
- cleanup
Since the receive side does not do zcopy at this stage, for a single connection
this results in a lower bandwidth than without zcopy, but also much lower CPU
utilization on the send size.
Here's an example run:
# ( export SIMPLE_LIBSDP=1; export LD_PRELOAD=libsdp.so; /usr/local/bin/netperf -H 11.4.8.155 -f M -C -c -- -m 6553600 -M 6553600 )
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 11.4.8.155 (11.4.8.155) port 0 AF_INET
Recv Send Send Utilization Service Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local remote
bytes bytes bytes secs. MBytes /s % S % S us/KB us/KB
124928 124928 6553600 10.00 414.91 2.62 51.36 0.123 2.418
How to use:
svn co https://openib.org/svn/gen2/branches/zcopy/patches
apply patches/send_zcopy.patch and then patches/zcopy1.patch
Thanks,
--
MST
More information about the general
mailing list