[Users] HP BLc QLogic 4X QDR IB Switch oddness

[Hal Rosenstock]

On Sun, May 26, 2013 at 9:09 AM, Andrei Mikhailovsky <andrei at arhont.com>wrote:

>
>
> ------------------------------
> *From: *"John Valdes" <valdes at anl.gov>
> *To: *"Andrei Mikhailovsky" <andrei at arhont.com>
> *Cc: *users at lists.openfabrics.org
> *Sent: *Saturday, 25 May, 2013 2:19:40 AM
>
> *Subject: *Re: [Users] HP BLc QLogic 4X QDR IB Switch oddness
>
> Andrei Mikhailovsky wrote:
> > John Valdes wrote:
> > > What's the physical topology of the IB network between the blade
> > > servers and the switch?
> >
> > AM: I am not really sure. The servers do have the IB mezzanine card and
> from what i've read it is a pci-e card. I am unsure how the blade servers
> are connected to the switch. I guess it's an internal HP/QLogic
> interconnect.
>
> Found some docs on Intel's website at:
> http://www.intel.com/p/en_US/support/highlights/network/ts-fbs12100
> From that, it looks like the topology is very simple; the switch
> installs in a slot in the blade chassis, and it looks like it has 16
> internal (through the backplane of the chassis) IB connections, one
> to each blade server in the chassis, plus 16 external QSFP ports.
>
>
> AM: yeah, that pretty much sums up the switch
>
>
>
>
> I was thinking maybe there was something odd in the topology that
> was causing the subnet manager to fail to negotiate link properly w/
> the blade servers.  It doesn't sound like that's the case.
>
>
> AM: I do not see any logs on the SM side when the port state changes. The
> only logs I see is when the port becomes Active, I see that in the logs and
> no errors before or prior to that
>
>

By port state, do you mean port state or port physical state ? Note that
there's some relationship between the two but port physical state can
change without port state changing. In the opensm log, you should see trap
128 when link (port) state changes. If the port/link is constantly
(re)negotiating and doesn't get to LinkUp (port physical state)/Init (port
state), you won't see this in the log. If port state is truly changing, you
should see this trap in the opensm log.

-- Hal


>
>
>
> _______________________________________________
> Users mailing list
> Users at lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/users
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/users/attachments/20130526/708f25ae/attachment.html>