***SPAM*** Re: [ofa-general] Any easy way to specify to the SM to route/zone?

[Hal Rosenstock]

On Mon, Apr 13, 2009 at 12:02 PM, Chris Worley <worleys at gmail.com> wrote:
> On Mon, Apr 13, 2009 at 7:43 AM, Hal Rosenstock
> <hal.rosenstock at gmail.com> wrote:
>> On Mon, Apr 13, 2009 at 9:37 AM, Chris Worley <worleys at gmail.com> wrote:
>>> On Mon, Apr 13, 2009 at 5:39 AM, Hal Rosenstock
>>> <hal.rosenstock at gmail.com> wrote:
>>>> On Sun, Apr 12, 2009 at 11:01 PM, Chris Worley <worleys at gmail.com> wrote:
>>>>>
>>>>> So I need to tell the SM to route specific ports on the server/target
>>>>> to specific clients/initiators.
>>>>>
>>>>> Is there any way to do this?
>>>>
>>>> Do you mean restrict access between certain clients/servers ?
>>>
>>> One server w/ 4QDR boards, 16 clients with one QDR board.  I want each
>>> port on the server routed/zoned to two clients.
>>>
>>>> If so,
>>>> you can do this with partitioning
>>>
>>> What is partitioning?
>>
>> A partition is a collection of ports which are allowed to communicate
>> together. There are two forms of members: full members which can talk
>> to any other member (useful for servers) and limited members which can
>> only talk to full members (useful for clients). See the opensm man
>> page or partition-config.txt on setting this up for OpenSM.
>>
>
> Let me see if I understand this with a simple example... my port GUIDs
> (as reported by ibstat) are for one server (4 QDR ports) and four
> clients (one QDR port each):
>
>
> Server A:           Port GUID: 0x0024717124000029
> Server B:           Port GUID: 0x002471712400002a
> Server C:           Port GUID: 0x0024717127000035
> Server D:           Port GUID: 0x0024717127000036
>
> Client 1:                Port GUID: 0x0002c90300028c01
> Client 2:                Port GUID: 0x0002c90300026047
> Client 3:                Port GUID: 0x0002c90300026053
> Client 4:                Port GUID: 0x0002c9030002603b
>
> Assuming I want a 1:1 (one server port to one client) partitioning, I
> would put the following in /etc/ofed/partitions.conf:
>
> part1=0x1, ipoib, defmember=full : 0x0024717124000029, 0x0002c90300028c01;
> part2=0x2, ipoib, defmember=full : 0x002471712400002a, 0x0002c90300026047;
> part3=0x3, ipoib, defmember=full : 0x0024717127000035, 0x0002c90300026053;
> part4=0x4, ipoib, defmember=full : 0x0024717127000036, 0x0002c9030002603b;

So you want IPoIB.

> ... and run w/:
>
> opensm -r -B -P/etc/ofed/partitions.conf
>
> Does that sound correct?  It doesn't work

What application(s) aren't working ? Any SM error messages ? Any end
node messages pertaining to IB ?

> (I restarted ib on the
> clients), although ibstat shows the links up.  What am I getting
> wrong?  The opensmd is running on the server.

Which server ?

You still need the default partition with the SM node being full and
the others being limited there (so it's also best to run SM on
separate node if possible otherwise you have the potential of any
client connecting to it on default partition).

-- Hal

> Thanks,
>
> Chris
>