[ewg] [PATCH] pkey fix for ipoib - resubmission

[Jason Gunthorpe]

On Fri, Jun 18, 2010 at 12:32:52PM -0500, Todd Rimmer wrote:

> For IB, the centralized tool is the SM and a "VLAN" is an IB
> Partition.  The present capability of using the 1st PKey table entry
> is a nice simple and powerful way to mimic the ease of use of
> Ethernet VLANs.  Only when a user wants IPoIB to run on two
> different partitions (which is rare) is a server specific
> configuration needed.

I agree that automatic configuration is desirable, but this isn't how
the Linux ipoib implementation is designed.

You cannot easily change the broadcast GID after starting. It gets
into places, and this patch does not address that. I suspect that
un-doing all the places the GID gets into is fairly hard..

Certainly, changing the pkey once the interface has been running for
awhile is involved, and 'auto configuration' that works once at boot
is, IMHO, evil.

So.. to go down this path, I think the first patch should be: 'here
is a patch that lets us change the pkey on a running interface, and
here is a detailed discussion of why it is correct and race
free'.

With the current code the simplest approach to this would be to
destroy the entire interface and make a new one with the pkey you
want. Since doing this requires preserving a lot of net state this is
best done from user space using the existing APIs.

Jason