[ewg] [Q] how to setup /etc/opensm/partitions.conf??
Hiroyuki Sato
hiroysato at gmail.com
Thu Oct 27 02:47:19 PDT 2011
Hello Richard
Thank you for your information.
Is this true??,
I read this article pp44 4.4 Subinterfaces.
This step create subinterface by hand.
http://www.mellanox.com/related-docs/prod_software/Mellanox_OFED_Linux_user_manual_1_5_1.pdf
Do you know any other documents about subinterfaces.??
I removed subinterface by hand and restart opensm.
But subinterfaces not created automatically.
Thank you for your help.
2011/10/27 richard at informatix-sol.com <richard at informatix-sol.com>:
> You do not have to manually create any sub-interfaces. You have to leave
> this to the ipoib on your server. This will happen automatically providing
> you have previously created the partition in the subnet manager and assigned
> membership of this to your ib ports.
>
> Richard
>
> ----- Reply message -----
> From: "Hal Rosenstock" <hal.rosenstock at gmail.com>
> Date: Wed, Oct 26, 2011 16:58
> Subject: [ewg] [Q] how to setup /etc/opensm/partitions.conf??
> To: "Hiroyuki Sato" <hiroysato at gmail.com>
> Cc: "ewg" <ewg at lists.openfabrics.org>
>
>
> On Wed, Oct 26, 2011 at 10:03 AM, Hiroyuki Sato <hiroysato at gmail.com> wrote:
>
>> Dear members.
>>
>> I have some question about Infiniband Partitions.
>>
>> I would like to build Linux box with IPoIB Router.
>>
>> * Questions
>>
>> My Question is the following.
>>
>> a) Can I create the following IPoIB network ??
>>
>> b) If so, how to setup /etc/opensm/partitions.conf??
>>
>> * Problem.
>>
>> Ping IB Client to Router : I got the followig error.
>>
>> Network is unreachable.
>>
>> * Environment
>>
>> OFED: OFED-1.5.3.2
>> OS: Scientific Linux 6.1
>>
>> * Linux box (Router)
>>
>> 1 ethernet interface (eth0)
>> 1 Infiniband interfae (ib0)
>> Run subnet manager.
>>
>> * Ethernet setup
>>
>> a) add VLAN ID 120 eth0.120 (192.168.120.0/24)
>> b) add VLAN ID 130 eth0.130 (192.168.130.0/24)
>>
>> * Infiniband Setup
>> a) add subinterface 0 ib0.8000 (192.168.0.0/24)
>> b) add subinterface 1 ib0.8001 (192.168.1.0/24)
>> c) Run opensm
>>
>>
>> I crated subinterface with the following command.
>>
>> echo 0 > /sys/class/net/ib0/create_child
>> echo 1 > /sys/class/net/ib0/create_child
>>
>
> echo 0x8001 > /sys/class/net/ib0/create_child
> echo 0x8002 > /sys/class/net/ib0/create_child
>
>
>> and assign ip address with ifconfig
>>
>> * Logical Diagram
>>
>> +----------- 192.168.120.0/24 ---
>> |
>> | +---- 192.168.130.0/24
>> eth0.120| | eth0.130
>> +----------+
>> | Router |
>> +----------+
>> ib0.8000| |ib0.8001
>> 192.168.0.1 | +---- 192.168.1.0/24
>> |
>> +----------- 192.168.0.0/24 --- IB Cllient. (ib0.8000)
>> (192.168.0.2)
>>
>> * /etc/opensm/partitions.conf
>>
>> Default=0x7fff : ALL=full
>> Net0=0x00, ipoib : ALL=full
>> Net1=0x01, ipoib : ALL=full
>>
>
> Default=0x7fff: ALL=full
> Net0=0x0001, ipoib: ALL=full
> Net1=0x0002, ipoib: ALL=full
>
>
>
>>
>> Coule you please tell me what is wrong??
>>
>
> The one thing in the above I'm not sure of is whether the default partition
> also needs the ipoib flag above so you might need to add that too if the
> above doesn't work.
>
> -- Hal
>
>
>>
>> Sincerely.
>>
>> --
>> Hiroyuki Sato.
>> _______________________________________________
>> ewg mailing list
>> ewg at lists.openfabrics.org
>> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
>>
>
>
>
--
Hiroyuki Sato
More information about the ewg
mailing list