<br><font size=2 face="sans-serif">I am testing most of my patches. Under</font>
<br>
<br><font size=2 face="sans-serif">1.Intel(R) Xeon(TM) CPU 2.80GHz, one
cpu, </font>
<br><font size=2 face="sans-serif">2. fw-23108-3_4_000-MHXL-CF128-T.bin</font>
<br><font size=2 face="sans-serif">3. pci-x without msi_x enabled</font>
<br><font size=2 face="sans-serif">4. kernel 2.6.16</font>
<br><font size=2 face="sans-serif">5. netperf-2.4.0</font>
<br><font size=2 face="sans-serif">6. SVN 68XX+several IPoIB patches</font>
<br>
<br><font size=2 face="sans-serif">The best result I got so far:</font>
<br>
<br><font size=2 face="sans-serif">Testing with the following command line:</font>
<br><font size=2 face="sans-serif">netperf -l 60 -H 10.1.1.100 -t TCP_STREAM
-i 10,2 -I 95,5 -- -m 16384 -s 349520 -S 349520</font>
<br>
<br><font size=2 face="sans-serif">TCP STREAM TEST from 0.0.0.0 (0.0.0.0)
port 0 AF_INET to 10.1.1.100 (10.1.1.100) port 0 AF_INET : +/-2.5% @ 95%
conf.</font>
<br><font size=2 face="sans-serif">Recv Send Send</font>
<br><font size=2 face="sans-serif">Socket Socket Message Elapsed</font>
<br><font size=2 face="sans-serif">Size Size Size
Time Throughput</font>
<br><font size=2 face="sans-serif">bytes bytes bytes
secs. 10^6bits/sec</font>
<br>
<br><font size=2 face="sans-serif">699040 699040 16384 60.00
3668.07 (458MB/s)</font>
<br>
<br><font size=2 face="sans-serif">cpu utilization was around 95%.</font>
<br>
<br><font size=2 face="sans-serif">Thanks<br>
Shirley Ma<br>
IBM Linux Technology Center<br>
15300 SW Koll Parkway<br>
Beaverton, OR 97006-6063<br>
Phone(Fax): (503) 578-7638<br>
<br>
</font>
<br>
<br>
<br>
<table width=100%>
<tr valign=top>
<td width=40%><font size=1 face="sans-serif"><b>"Hassan M. Jafri"
<hjafri@ncsa.uiuc.edu></b> </font>
<br><font size=1 face="sans-serif">Sent by: openib-general-bounces@openib.org</font>
<p><font size=1 face="sans-serif">05/08/2006 03:52 PM</font>
<td width=59%>
<table width=100%>
<tr>
<td>
<div align=right><font size=1 face="sans-serif">To</font></div>
<td valign=top><font size=1 face="sans-serif">openib-general@openib.org</font>
<tr>
<td>
<div align=right><font size=1 face="sans-serif">cc</font></div>
<td valign=top>
<tr>
<td>
<div align=right><font size=1 face="sans-serif">Subject</font></div>
<td valign=top><font size=1 face="sans-serif">Re: [openib-general] ip over
ib throughtput</font></table>
<br>
<table>
<tr valign=top>
<td>
<td></table>
<br></table>
<br>
<br>
<br><font size=2><tt>I cant crank out more than 150 MB/sec with my 2.0
GHz xeons. verbs level <br>
benchmarks, however give decent numbers for bandwidth. With netperf, the
<br>
server side CPU usage is 99% which is much higher than other posted <br>
bandwidth results on this thread. Any suggestions?<br>
<br>
Here is the complete configuration for my bandwidth tests<br>
<br>
Kernel-2.6.15.4<br>
netperf-2.3-3<br>
OpenIB rev 6552<br>
MTLP23108-CF128<br>
Firmware 3.4.0<br>
MSI-X is enabled for the HCA<br>
<br>
<br>
------------------------------<br>
Here is the netperf output<br>
<br>
<br>
<br>
TCP STREAM TEST to 192.168.2.2<br>
Recv Send Send
Utilization
Service <br>
Demand<br>
Socket Socket Message Elapsed
Send Recv Send Recv<br>
Size Size Size Time Throughput
local remote local <br>
remote<br>
bytes bytes bytes secs. MBytes /s
% T % T us/KB us/KB<br>
<br>
262142 262142 32768 10.01 151.32
59.66 99.84 7.700 <br>
12.886<br>
-------------------------------<br>
<br>
Here is ib0 config for one of the nodes<br>
<br>
ib0 Link encap:UNSPEC HWaddr <br>
00-02-04-04-FE-80-00-00-00-00-00-00-00-00-00-00<br>
inet addr:192.168.2.1 Bcast:192.168.2.255
Mask:255.255.255.0<br>
inet6 addr: fe80::202:c902:0:3ce9/64
Scope:Link<br>
UP BROADCAST RUNNING MULTICAST MTU:2044
Metric:1<br>
RX packets:1724527 errors:0 dropped:0
overruns:0 frame:0<br>
TX packets:9685456 errors:0 dropped:2
overruns:0 carrier:0<br>
collisions:0 txqueuelen:128<br>
RX bytes:89830114 (85.6 MiB) TX
bytes:2213308646 (2.0 GiB)<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
Michael S. Tsirkin wrote:<br>
> Hi!<br>
> What kind of performance do people see with ip over ib on gen2?<br>
> I see about 100Mbyte/sec at 99% CPU utilisation on send,<br>
> on an express card, Xeon 2.8GHz, SSE doorbells enabled.<br>
> <br>
> MST<br>
> _______________________________________________<br>
> openib-general mailing list<br>
> openib-general@openib.org<br>
> http://openib.org/mailman/listinfo/openib-general<br>
> <br>
> To unsubscribe, please visit <br>
> http://openib.org/mailman/listinfo/openib-general<br>
> <br>
_______________________________________________<br>
openib-general mailing list<br>
openib-general@openib.org<br>
http://openib.org/mailman/listinfo/openib-general<br>
<br>
To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general<br>
</tt></font>
<br>