[openib-general] [BUG] Byte swapped Pkeys

[Roland Dreier]

    Tom> So, I am trying to use the Sun subnet manager on my IB
    Tom> network (to test compatibility with openib).  Our SM uses a
    Tom> pkey of 7FFF.  This runs on Solaris on sparc64 (BE system).
    Tom> What I have noticed is that since switching to mthca (from
    Tom> the old ib_tavor), openib is (not) byte swapping the pkey
    Tom> properly on LE systems.

    Tom> We have hooked up an IB analyzer to indeed verify that openib
    Tom> is sending FF7F over the wire for the pkey.

Clearly there's a bug in mthca.  Which packets have the wrong byte
order?  MAD packets?  Is it working well enough to be able to send
other traffic?

    Tom> I am still investigating why this is happening, but I would
    Tom> like to suggest that we change all the pkeys in openib to use
    Tom> 0x0BB0 other than 0xFFFF from now on so that we can be sure
    Tom> to see clearly when things are not going out network endian

It's a good idea... but it's really up to the SM to assign P_Keys.
I'll try to update my test network config to do this.

 - R.