[Openib-windows] IPoIB RQ/SQ depth

Yossi Leybovich sleybo at mellanox.co.il
Mon Dec 5 00:24:16 PST 2005


Hi
 
I tested the IPoIB with netperf, from my tests it shows that increasing
the RQ/SQ depth from 128 to 512 add 10% in the bandwidth.
With 128 I got 190 MB/s and with 512 I got 210 MB/s.(the test use 32k
msg and 56k buffer in the socket)
Is there any reason we not move the default depth to be 512 ?
Do you think that there is resource problem here ?
 
Yossi 
 
 
 
Program Files (x86)\Mellanox\WinIB\bin>netperf.exe -H 11.4.10.15 -p 3333
-f M -l 10 -C -c -v 2 -- -M 32000 -S 56000 -
6000
 STREAM TEST to 11.4.10.15
ualDuation (ms): 9991
PU    _Total  CPU 0   CPU 1   CPU 2   CPU 3
y      42.81  83.75   85.31    1.56    0.62
nel    42.73  83.75   85.00    1.56    0.63
r       0.08   0.00    0.31    0.00    0.00
       16.13  64.53    0.00    0.00    0.00
errupt  3.59  14.38    0.00    0.00    0.00
 
errupt/Sec. 40145.9   36450.2         3438.3  151.8   105.6
 
v   Send    Send                          Utilization       Service
Demand
ket Socket  Message  Elapsed              Send     Recv     Send    Recv
e   Size    Size     Time     Throughput  local    remote   local
remote
es  bytes   bytes    secs.    MBytes  /s  % N      % N      us/KB
us/KB
 
000  56000  56000    10.00       210.85   42.81    26.17    7.932
4.849
 
gnment      Offset         Bytes    Bytes       Sends   Bytes    Recvs
al  Remote  Local  Remote  Xfered   Per                 Per
d   Recv    Send   Recv             Send (avg)          Recv (avg)
 8       8      0       0 2.211e+009  56000.00     39480   18820.97
117469
 
imum
ment
e (bytes)
 -1



More information about the ofw mailing list