[Openib-windows] IPoIB RQ/SQ depth
Yossi Leybovich
sleybo at mellanox.co.il
Mon Dec 5 00:24:16 PST 2005
Hi
I tested the IPoIB with netperf, from my tests it shows that increasing
the RQ/SQ depth from 128 to 512 add 10% in the bandwidth.
With 128 I got 190 MB/s and with 512 I got 210 MB/s.(the test use 32k
msg and 56k buffer in the socket)
Is there any reason we not move the default depth to be 512 ?
Do you think that there is resource problem here ?
Yossi
Program Files (x86)\Mellanox\WinIB\bin>netperf.exe -H 11.4.10.15 -p 3333
-f M -l 10 -C -c -v 2 -- -M 32000 -S 56000 -
6000
STREAM TEST to 11.4.10.15
ualDuation (ms): 9991
PU _Total CPU 0 CPU 1 CPU 2 CPU 3
y 42.81 83.75 85.31 1.56 0.62
nel 42.73 83.75 85.00 1.56 0.63
r 0.08 0.00 0.31 0.00 0.00
16.13 64.53 0.00 0.00 0.00
errupt 3.59 14.38 0.00 0.00 0.00
errupt/Sec. 40145.9 36450.2 3438.3 151.8 105.6
v Send Send Utilization Service
Demand
ket Socket Message Elapsed Send Recv Send Recv
e Size Size Time Throughput local remote local
remote
es bytes bytes secs. MBytes /s % N % N us/KB
us/KB
000 56000 56000 10.00 210.85 42.81 26.17 7.932
4.849
gnment Offset Bytes Bytes Sends Bytes Recvs
al Remote Local Remote Xfered Per Per
d Recv Send Recv Send (avg) Recv (avg)
8 8 0 0 2.211e+009 56000.00 39480 18820.97
117469
imum
ment
e (bytes)
-1
More information about the ofw
mailing list