[Users] MXM/FCA results

[Russell Dekema]

Susan,

Did you have to do anything 'special' (beyond what is in the FCA
documentation) to get FCA to work on your cluster? Are you running FCA with
Mellanox UFM, or OFA OpenSM?

I ask because we are having trouble getting FCA to work on our (UFM)
cluster. We are working with Mellanox on it, but I'd be curious to hear
more about your environment.

Cheers,
Rusty Dekema
CAEN High Performance Computing


On Mon, May 6, 2013 at 7:09 PM, Susan Coulter <markus at lanl.gov> wrote:

>
> Many moons ago there was a brief discussion on this list about MXM/FCA
> testing.
> I promised to send the results of my testing once I got things working.
> It's been working for quite a while on a ~600 node QDR cluster and the
> results are pretty remarkable.
> Attached are several graphs of 2 different MPI synthetics I use to test IB
> performance - ring and scatter.
>
> Scatter shows pretty good performance gains with smaller message sizes -
> larger message sizes pretty much stink.
> Ring shows significant performance increases across the board, with a
> couple odd results that may need more analysis/testing.
>
>
> ====================================
>
> Susan Coulter
> HPC-3 Network/Infrastructure
> 505-667-8425
> Increase the Peace...
> An eye for an eye leaves the whole world blind
> ====================================
>
>
> _______________________________________________
> Users mailing list
> Users at lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/users
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/users/attachments/20130506/55c232a7/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ring4096.png
Type: image/png
Size: 5329 bytes
Desc: not available
URL: <http://lists.openfabrics.org/pipermail/users/attachments/20130506/55c232a7/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: scatter1024.png
Type: image/png
Size: 5368 bytes
Desc: not available
URL: <http://lists.openfabrics.org/pipermail/users/attachments/20130506/55c232a7/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ring2048.png
Type: image/png
Size: 5320 bytes
Desc: not available
URL: <http://lists.openfabrics.org/pipermail/users/attachments/20130506/55c232a7/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ring512.png
Type: image/png
Size: 5294 bytes
Desc: not available
URL: <http://lists.openfabrics.org/pipermail/users/attachments/20130506/55c232a7/attachment-0003.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ring1024.png
Type: image/png
Size: 5340 bytes
Desc: not available
URL: <http://lists.openfabrics.org/pipermail/users/attachments/20130506/55c232a7/attachment-0004.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: scatter2048.png
Type: image/png
Size: 5350 bytes
Desc: not available
URL: <http://lists.openfabrics.org/pipermail/users/attachments/20130506/55c232a7/attachment-0005.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: scatter512.png
Type: image/png
Size: 5267 bytes
Desc: not available
URL: <http://lists.openfabrics.org/pipermail/users/attachments/20130506/55c232a7/attachment-0006.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ring_inc.png
Type: image/png
Size: 5910 bytes
Desc: not available
URL: <http://lists.openfabrics.org/pipermail/users/attachments/20130506/55c232a7/attachment-0007.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: scatter_inc.png
Type: image/png
Size: 6232 bytes
Desc: not available
URL: <http://lists.openfabrics.org/pipermail/users/attachments/20130506/55c232a7/attachment-0008.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: scatter4096.png
Type: image/png
Size: 5367 bytes
Desc: not available
URL: <http://lists.openfabrics.org/pipermail/users/attachments/20130506/55c232a7/attachment-0009.png>