[openib-general] ip over ib throughtput

[Hassan M. Jafri]

I cant crank out more than 150 MB/sec with my 2.0 GHz xeons. verbs level 
benchmarks, however give decent numbers for bandwidth. With netperf, the 
server side CPU usage is 99% which is much higher than other posted 
bandwidth results on this thread. Any suggestions?

Here is the complete configuration for my bandwidth tests

Kernel-2.6.15.4
netperf-2.3-3
OpenIB rev 6552
MTLP23108-CF128
Firmware 3.4.0
MSI-X is enabled for the HCA


------------------------------
Here is the netperf output



TCP STREAM TEST to 192.168.2.2
Recv   Send    Send                          Utilization       Service 
Demand
Socket Socket  Message  Elapsed              Send     Recv     Send    Recv
Size   Size    Size     Time     Throughput  local    remote   local 
remote
bytes  bytes   bytes    secs.    MBytes  /s  % T      % T      us/KB   us/KB

262142 262142  32768    10.01       151.32   59.66    99.84    7.700 
12.886
-------------------------------

Here is ib0 config for one of the nodes

ib0       Link encap:UNSPEC  HWaddr 
00-02-04-04-FE-80-00-00-00-00-00-00-00-00-00-00
           inet addr:192.168.2.1  Bcast:192.168.2.255  Mask:255.255.255.0
           inet6 addr: fe80::202:c902:0:3ce9/64 Scope:Link
           UP BROADCAST RUNNING MULTICAST  MTU:2044  Metric:1
           RX packets:1724527 errors:0 dropped:0 overruns:0 frame:0
           TX packets:9685456 errors:0 dropped:2 overruns:0 carrier:0
           collisions:0 txqueuelen:128
           RX bytes:89830114 (85.6 MiB)  TX bytes:2213308646 (2.0 GiB)








Michael S. Tsirkin wrote:
> Hi!
> What kind of performance do people see with ip over ib on gen2?
> I see about 100Mbyte/sec at 99% CPU utilisation on send,
> on an express card, Xeon 2.8GHz, SSE doorbells enabled.
> 
> MST
> _______________________________________________
> openib-general mailing list
> openib-general at openib.org
> http://openib.org/mailman/listinfo/openib-general
> 
> To unsubscribe, please visit 
> http://openib.org/mailman/listinfo/openib-general
>