[ofw] [RFC] Remove path query from IPoIB

[Hefty, Sean]

><soapbox>
>I think this is perhaps both an implementation issue (with SMs/OpenSM)
>as they need to scale better in SA performance with the number of
>cores and also perhaps an architectural one for the IBTA. I don't
>think it's a good thing to keep subverting the architecture (for
>possibly valid reasons) as new issues are introduced by doing this.
></soapbox>

There's not a single MPI implementation that I'm aware of that doesn't bypass the SA when establishing connections for larger subnets.  Most exchange QP information over sockets.  They have to if they want to work.

The only reason IPoIB works on Linux is that it permanently caches path records.

- Sean