[openib-general] Re: [PATCH] IPoIB splitting CQ, increase both send/recv poll NUM_WC & interval

[Shirley Ma]

Hello Roland,

Finally I finished some of my tests over UP<->UP, UP<->SMP. One of mthca 
driver couldn't up on SMP after I updated firmware to 3.4.0. I got below 
error while loading ib_mthca module:

May  4 13:42:09 elm3b100 kernel: ib_mthca: Mellanox InfiniBand HCA driver 
v0.08 (February 14, 2006)
May  4 13:42:09 elm3b100 kernel: ib_mthca: Initializing ?????<8e>,?
May  4 13:42:09 elm3b100 kernel: ACPI: PCI Interrupt 0000:05:00.0[A] -> 
GSI 96 (level, low) -> IRQ 19
May  4 13:42:09 elm3b100 kernel:  ?????<8e>,?: Missing DCS, aborting.

It has no problem to bring it up on UP kernel. Any clue?

UP<->UP results are good. The one netperf performance could tune up to 
around 80% throughput improvement with 4-5% latency increase on linux 
2.6.16 UP kernel.

UP<->SMP has the similar result as SMP with one stream, increase CPU 
doesn't help the performance since the driver is the bottleneck.

I will submit these patches for review soon. In the meanwhile I will 
continue to test them on different configuration.  It would be helpful if 
anyone can test on large node cluster with different adapters. (multiple 
streams? two ports? multiple links?)

Thanks
Shirley Ma
IBM Linux Technology Center
15300 SW Koll Parkway
Beaverton, OR 97006-6063
Phone(Fax): (503) 578-7638
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20060504/1ad2835d/attachment.html>