[openfabrics-ewg] Cisco SQA results so far for OFED 1.0 rc5
Pavel Shamis (Pasha)
pasha at mellanox.co.il
Mon Jun 5 05:03:35 PDT 2006
Hi,
We decided to change the default MTU back to 2048.
So by default the mvapich will be tunned for PCI_EX hcas. And in
documentation we will include "how-to tune" for PCI_X hca.
Regards,
Pasha.
Pavel Shamis (Pasha) wrote:
> Hi,
> The default mtu size in mvapich-RC5 was changed to MTU1024 (it solves bw
> issue on PCI_X). You can try VIADEV_DEFAULT_MTU=MTU2048 parameter on
> your platforms (PCI_EX) and I believe that you will get the rc4 latency
> numbers.
> Also in RC6 we added mvapich.conf file that include all configuration
> options and description for best tunings on different platforms.
>
> Regards
> Pasha
>
> Scott Weitzenkamp (sweitzen) wrote:
>> I forgot to mention that Open MPI and Intel MPI small message latency
>> are slightly worse as well in rc5 compared to rc4.
>>
>> Scott Weitzenkamp
>> SQA and Release Manager
>> Server Virtualization Business Unit
>> Cisco Systems
>>
>>
>>
>> ------------------------------------------------------------------------
>> *From:* openfabrics-ewg-bounces at openib.org
>> [mailto:openfabrics-ewg-bounces at openib.org] *On Behalf Of *Scott
>> Weitzenkamp (sweitzen)
>> *Sent:* Monday, June 05, 2006 12:51 AM
>> *To:* openfabrics-ewg at openib.org
>> *Subject:* [openfabrics-ewg] Cisco SQA results so far for OFED 1.0
>> rc5
>>
>> We've focused on SDP and MPI performance so far on RHEL4 U3
>> x86_64. Some bad news:
>>
>> * MVAPICH MPI small message latency is slightly worse across the
>> board, as measured by OSU latency benchmarks. For example:
>> o Lion Mini SDR: small message latency up from 3.43 usec
>> to 3.53 usec
>> o Cheetah SDR: small message latency up from 3.57 usec to
>> 3.73 usec
>> * SDP throughput worse and small message latency worse than
>> rc4. For example
>> o SDP small message latency */worse/* than IPoIB now
>> o Lion Mini SDR: throughput dropped from 7.24 Gb/sec to
>> 6.45 Gb/sec
>> o Lion Mini SDR: latency grew from 17.5 usec to 30.0 usec
>>
>> Scott Weitzenkamp
>> SQA and Release Manager
>> Server Virtualization Business Unit
>> Cisco Systems
>>
>>
>> ------------------------------------------------------------------------
>>
>> _______________________________________________
>> openfabrics-ewg mailing list
>> openfabrics-ewg at openib.org
>> http://openib.org/mailman/listinfo/openfabrics-ewg
>
> _______________________________________________
> openfabrics-ewg mailing list
> openfabrics-ewg at openib.org
> http://openib.org/mailman/listinfo/openfabrics-ewg
>
More information about the ewg
mailing list