[ofa-general] question about partitioning IB networks

Hal Rosenstock hal.rosenstock at gmail.com
Thu Sep 3 10:31:25 PDT 2009


Don,

On Thu, Sep 3, 2009 at 1:12 PM, Meyer, Donald J <donald.j.meyer at intel.com>wrote:

>  Hal,
>
>
>
> If you would like to use my example configuration in the man page (the one
> with realistic GUID’s) please feel free to do so.  The GUID’s are all
> imaginary but realistic.
>
>
>
> Are you sure the default partition should be
> “Default=0x7fff,ipoib,rate=7:ALL,SELF=full;” and not
> “Default=0x7fff:SELF=full,ALL=limited;”?
>
   The second version forces both known and unknown CA’s to be unable to
> reach any CA but the sm except via their own partition.
>
I thought that was what you wanted. I thought you only wanted the CAs to be
able to talk with each other on the designated non default partitions.


>    It also seems to me that the first version bypasses partitioning by
> allowing CA’s to use the default partition to reach other CA’s not in the
> same partition.
>
You mean the since they are all full members of the default partition they
can talk to each other on that partition despite that not being allowed on
some other partition. If so, yes.

>
>
> Also, if you would like, I would be happy to work on a version of the man
> page where I would try to possibly explain a bit more and have more complete
> examples.
>
Sure; if you want you are welcome to post patches to the list for review,
comment, etc.

-- Hal

>
>
> *Thanks,*
>
> *Don Meyer*
>
> *Senior Network/System Engineer/Programmer*
>
> US+ (253) 371-9532 iNet 8-371-9532
>
> **Other names and brands may be claimed as the property of others*
>  ------------------------------
>
> *From:* Hal Rosenstock [mailto:hal.rosenstock at gmail.com]
> *Sent:* Thursday, September 03, 2009 6:46 AM
> *To:* kliteyn at dev.mellanox.co.il
> *Cc:* Meyer, Donald J; general at lists.openfabrics.org
> *Subject:* Re: [ofa-general] question about partitioning IB networks
>
>
>
>
>
> On Thu, Sep 3, 2009 at 9:43 AM, Yevgeny Kliteynik <
> kliteyn at dev.mellanox.co.il> wrote:
>
> Hal Rosenstock wrote:
>
>
>  On Mon, Aug 31, 2009 at 3:29 PM, Meyer, Donald J <
> donald.j.meyer at intel.com <mailto:donald.j.meyer at intel.com>> wrote:
> ...
> ...
>
>
>    Just as a sanity check, my interpretation so far is that my network
>    should have a partition configuration file similar to the following.
>     Can anyone tell me if I have this correct?  In this example
>    configuration, I am trying to create two partitions.  One with rack
>    one and two, the other with rack three and four:
>
>
>    #Default partition (for SM control of the CA’s)
>
>    Default=0x7fff,ipoib,rate=7:ALL=limited;
>
> Default=0x7fff,ipoib,rate=7:ALL,SELF=full;
>
>    #rack1
>
>    rack1=0x111,ipoib,rate=7,defmember=full:<GUID_list>;
>
>    #rack2
>
>    rack2=0x111,ipoib,rate=7,defmember=full:<GUID_list>;
>
>    #rack3
>
>    rack3=0x112,ipoib,rate=7,defmember=full:<GUID_list>;
>
>    #rack4
>
>    rack4=0x112,ipoib,rate=7,defmember=full:<GUID_list>;
>
> I've never done it this way but it does look like the partition create code
> will detect the duplicated partitions (0x111 and 0x112) and merge ports from
> rack2 with rack1 and rack4 with rack3.
>
>
> It will.
> Note that partition names are meaningless in terms of IB management.
> Basically they are used just for logging. The only real partition ID
> is its pkey.
>
>
>
> The low 7 bits (without membership bit) of pkey denotes partition.
>
>
>
> -- Hal
>
>
>
>
> -- Yevgeny
>
> -- Hal
>
>
>    *Thanks,*
>
>    *Don Meyer*
>
>    /Senior Network/System Engineer/Programmer/
>
>    US+ (253) 371-9532 iNet 8-371-9532
>
>    /*Other names and brands may be claimed as the property of others/
>
>
>
>    _______________________________________________
>    general mailing list
>
>    general at lists.openfabrics.org <mailto:general at lists.openfabrics.org>
>
>
>    http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
>
>    To unsubscribe, please visit
>    http://openib.org/mailman/listinfo/openib-general
>
>
> ------------------------------------------------------------------------
>
>
>
> _______________________________________________
> general mailing list
> general at lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
>
> To unsubscribe, please visit
> http://openib.org/mailman/listinfo/openib-general
>
>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20090903/5773af86/attachment.html>


More information about the general mailing list