[openib-general] Cray XD1 and OpenSM.. (ignoreing certain guids?)
Hal Rosenstock
halr at voltaire.com
Fri Oct 14 18:48:24 PDT 2005
On Fri, 2005-10-14 at 19:19, Troy Benjegerdes wrote:
> In the interest of plugging absolutely everything I have with infiniband
> ports together and seeing what falls over, I connected a Cray XD1 to a
> small (2 machine) infiniband network running OpenSM.
>
> Ideally, I'd like to find out what sort of minimal emulation code needs
> to be running on the XD1 nodes to answer standards compliant SM
> requests.
You need an SMA on the Cray node.
> Failing that, Is there a way we can tell OpenSM to ignore parts
> of the IB network? I am seeing a lot of stuff in the osm.log like this:
>
> (port 16 is on the internal mellanox chip in the XD1)
>
> ct 14 18:07:22 646959 [43005960] -> umad_receiver: ERR 5409: send
> completed with error (method=1 attr=15) -- dropping.
> Oct 14 18:07:22 646972 [43005960] -> umad_receiver: ERR 5411: DR SMP hop
> ptr 0 hop count 3 DR SLID 0x0 DR DLID 0x0
> Oct 14 18:07:22 646983 [43005960] -> __osm_sm_mad_ctrl_send_err_cb: ERR
> 3113: MAD completed in error (IB_TIMEOUT).
> Oct 14 18:07:22 647020 [43005960] -> SMP dump:
> base_ver................0x1
> mgmt_class..............0x81
> class_ver...............0x1
> method..................0x1 (SubnGet)
> D bit...................0x0
> status..................0x0
> hop_ptr.................0x0
> hop_count...............0x3
> trans_id................0x1420
> attr_id.................0x15 (PortInfo)
> resv....................0x0
> attr_mod................0x0
> m_key...................0x0000000000000000
> dr_slid.................0xFFFF
> dr_dlid.................0xFFFF
>
> Initial path: [0][1][4][16]
> Return path: [0][0][0][0]
> Reserved: [0][0][0][0][0][0][0]
>
> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
>
> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
>
> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
>
> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
I'm unaware of such an option. Not sure how you would specify which
nodes to ignore. Why would you want them on the net if they are to be
ignored ?
Nodes are supposed to be IB compliant: SMA is a required component of
all nodes.
-- Hal
More information about the general
mailing list