[ofa-general] Any easy way to specify to the SM to route/zone?

[Hal Rosenstock]

On Mon, Apr 13, 2009 at 7:39 PM, Chris Worley <worleys at gmail.com> wrote:

>>>>> Partition "part2" with P_Key=2 should connect this client's port 0 to
>>>>> the sever on port 1 of mlx4_1
>>>>
>>>> Do you really mean port 0 ?
>>>
>>> Nope... in this case I have 0x0002c903000292b0 in part2 in my
>>> partitions file, which is port 1, the second port of the adapter.  I'm
>>> hoping to use both ports of all adapters on the server.
>>
>> So you're talking about physical marking on the card rather than
>> actual (logical) port number.
>
> I'm not sure about board markings... both ports are attached to the
> switch, for all IB adapters, so all should work.  I'm using the
> numbers provided by ibstat.

OK but you did mention port 0 on the HCA.

>>> So, on one client... the one corresponding to "part2" in the
>>> partitions file, I put the P_Key into the "create child":
>>>
>>> echo 0x2 > /sys/class/net/ib0/create_child
>>>
>>> ... and did likewise on the host, for ib3 (the second port on the
>>> second adapter):
>>>
>>> echo 0x2 > /sys/class/net/ib3/create_child
>>
>> I'm not 100% sure but I think you may need the full member PKey on at
>> least one of them (0x800x).
>
> I've changed the P_Keys to 0x800x, and set the "create_child" files
> appropriately.
>
>>
>>> Still, no ping (the interfaces are setup correctly).
>>
>> Are there still join failure messages on the client and/or server ?
>> What do they say now ?
>
> Lot's of "bad P_Key" notices:

Yes, that's why I said to change it all to full membership (on
separate partitions) with the default partition having everything but
SM as limited.

-- Hal

<snip...>