[Users] HP BLc QLogic 4X QDR IB Switch oddness

[Hal Rosenstock]

On Fri, May 24, 2013 at 9:19 PM, John Valdes <valdes at anl.gov> wrote:

> Andrei Mikhailovsky wrote:
> > John Valdes wrote:
> > > What's the physical topology of the IB network between the blade
> > > servers and the switch?
> >
> > AM: I am not really sure. The servers do have the IB mezzanine card and
> from what i've read it is a pci-e card. I am unsure how the blade servers
> are connected to the switch. I guess it's an internal HP/QLogic
> interconnect.
>
> Found some docs on Intel's website at:
> http://www.intel.com/p/en_US/support/highlights/network/ts-fbs12100
> From that, it looks like the topology is very simple; the switch
> installs in a slot in the blade chassis, and it looks like it has 16
> internal (through the backplane of the chassis) IB connections, one
> to each blade server in the chassis, plus 16 external QSFP ports.
>
> I was thinking maybe there was something odd in the topology that
> was causing the subnet manager to fail to negotiate link properly w/
> the blade servers.  It doesn't sound like that's the case.
>
>
Physical link negotiation has nothing to do with SM.


> Does "perfquery" report errors on the blade servers' HCA port?  How
> about on the (internal) ports on the switch that connect to the blade
> servers?  To check, give perfquery the lid of the device you want to
> check (either the server's lid or the switch's lid) and the port
> number to check (that should always be 1 for the servers, and the
> corresponding switch port number for the switch, 1 through 16 or 17
> through 32 depending on which are the internal ports and which are the
> external.  "ibnetdiscover" should tell you what servers are connected
> to what ports on the switch.
>
> John
> _______________________________________________
> Users mailing list
> Users at lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/users
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/users/attachments/20130524/f1cba237/attachment.html>