[ofa-general] sun x4100 with IB

[Michael Di Domenico]

The cards are MT23108.

ibdiagnet -lw 4x -ls 2.5 shows no fabric errors also confirmed on my
silverstorm switch.

The rack contains X4100 and X4100 M2 servers.  The M2 servers do not
exhibit this behavior, they're showing 750MB/sec local loopback on an
IMB pingpong run.

Errata 56CLK is enabled in the bios and mostly all other PCI-X or HT
Bridge settings are set at they're defaults (ie auto)

I fiddled with a few of the settings, but they neither made it worse
or better.  So i'm really not sure what option got changed when i
reset the bios to optimal defaults, but i wish i did...


On Sat, Aug 8, 2009 at 10:22 AM, Michael Di
Domenico<mdidomenico4 at gmail.com> wrote:
> Yes, its an infinihost III, i believe its MT23208, but dont quote me
> on that, i'm not at the machine currently
>
> Is there something specific you want to see in lspci -vvv, i can't
> easily cut and paste from the machine
>
> On Fri, Aug 7, 2009 at 6:37 PM, Robert Cummins<robertacummins at gmail.com> wrote:
>> Can you send the output from lspci -vvv?   What card are you using?  Is
>> it an Infinihost III SDR card?  What does ibdiagnet -lw 4x -ls 5 return?
>>
>> On Fri, 2009-08-07 at 17:37 -0400, Michael Di Domenico wrote:
>>> I have several Sun x4100 with Infiniband servers which appear to be
>>> running at 400MB/sec instead of 800MB/sec.  It's a freshly reformatted
>>> cluster converting from solaris to linux.  We also reset the bios
>>> settings with "load optimal defaults". Does anyone know which bios
>>> setting I changed to dump the BW?
>>>
>>> x4100
>>> mellanox ib
>>> ofed-1.4.1-rc6 w/ openmpi
>>> _______________________________________________
>>> general mailing list
>>> general at lists.openfabrics.org
>>> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
>>>
>>> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
>>
>> _______________________________________________
>> general mailing list
>> general at lists.openfabrics.org
>> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
>>
>> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
>>
>