[openib-general] Re: Re: TSO and IPoIB performance degradation

Matt Leininger mlleinin at hpcn.ca.sandia.gov
Wed Mar 29 16:42:07 PST 2006


On Mon, 2006-03-20 at 12:31 -0800, Matt Leininger wrote:
> On Mon, 2006-03-20 at 11:02 +0200, Michael S. Tsirkin wrote:
> > 
> > BTW, Matt, it might be interesting to compare
> > 2.6.13-rc3 patch 1 against -rc1 and -rc2 with patch 1, to try and track
> > down the last bit of performance degradation in IPoIB.
> > 
> > Could you look into this?
> 
 Here are the latest IPoIB performance numbers.  I added the two kernels
you requested and some 2.6.16 results.


All benchmarks are with RHEL4 x86_64 with HCA FW v4.7.0
dual EM64T 3.2 GHz PCIe IB HCA (memfull)
ipath results RHE4 x86_64 with HTX HCA dual socket dual core 2.4 GHz
 
patch 1 - remove changeset 314324121f9b94b2ca657a494cf2b9cb0e4a28cc
patch 2 - remove changeset b8259d9ad1d0f8d0c5ea0e37bb15080b0bd395b5
msi_x=1 for all PCIe tests

netperf -f -M -c -C -H IP_ADDRESS

Kernel                OpenIB     netperf (MB/s)  
2.6.16               svn 6083     371 (mthca ipoib)
2.6.16               svn 6083     304 (ipath ipoib)
2.6.16               svn 5938     300 (ipath ipoib)
2.6.16               svn 5938     380 (mthca ipoib)
2.6.16               in-kernel    364
2.6.16-rc5           in-kernel    367      
2.6.15               in-kernel    382
2.6.14-rc4 patch 12  in-kernel    436 
2.6.14-rc4 patch 1   in-kernel    434 
2.6.14-rc4           in-kernel    385 
2.6.14-rc3           in-kernel    374 
2.6.13.2             svn3627      386 
2.6.13.2 patch 1     svn3627      446 
2.6.13.2             in-kernel    394 
2.6.13-rc3 patch 12  in-kernel    442 
2.6.13-rc3 patch 1   in-kernel    450 
2.6.13-rc3           in-kernel    395
2.6.13-rc2 patch 1   in-kernel    409
2.6.13-rc1 patch 1   in-kernel    408
2.6.12.5-lustre      in-kernel    399  
2.6.12.5 patch 1     in-kernel    464
2.6.12.5             in-kernel    402 
2.6.12               in-kernel    406 
2.6.12-rc6 patch 1   in-kernel    470 
2.6.12-rc6           in-kernel    407
2.6.12-rc5           in-kernel    405 
2.6.12-rc5 patch 1   in-kernel    474
2.6.12-rc4           in-kernel    470 
2.6.12-rc3           in-kernel    466 
2.6.12-rc2           in-kernel    469 
2.6.12-rc1           in-kernel    466
2.6.11               in-kernel    464 
2.6.11               svn3687      464 
2.6.9-11.ELsmp       svn3513      425  (Woody's results, 3.6Ghz EM64T) 


 - Matt





More information about the general mailing list