[ewg] [Q] Does IPoIB bonding support VLAN??

[Hiroyuki Sato]

Hello Ricard.

Thank you for your information.

I want to build no SPOF network on IPoIB networks.
I thought bond network works with multiple partition.
But you explained me it works only default partition.
I'll plan alternative way.

Thanks again.

2011/10/24 richard.croucher at informatix-sol.com <richard at informatix-sol.com>:
>
> I'm not sure about your requirement, but the simplest way to achieve
> resiliency, with no SPOF, is to create a fabric from a pair of
> interconnected switches. Then attach a port on each server to each switch.
> Bond your /dev/ib so that active ports go to the same switch. This works
> with only the default parititon. It will survive a failure of any port or
> either switch.
>
>
> Richard
>
>
> Hiroyuki Sato <hiroysato at gmail.com> wrote:
>
>
> Hello Richard
> Thank you for your information.
>
> I would like to biuld robust IB network like the following diagram.
> * IP over Infiniband network
> * Server and Client connect different network.(different subnet)
> * Normal Case: Client -> Router -> Server (IBport1)
> * IBSwtich1 Broken: Client -> Router -> Server (IBport2)
>
> My plan. (Router)
> * bond ib port1 and port2 active-backup mode.
> * add VLANs(sub interfaces) (client and server netowrk) on bond interface.
>
>
> I read this document pp 45.
> http://www.mellanox.com/related-docs/prod_software/Mellanox_OFED_Linux_user_manual_1_5_1.pdf
>
> * I succeed to create subinterface on ib0.
> * I succeed to create bond interface ib0 and ib1
> * But I don't know how to add subinterface on bond
> Do you know how to config it or do you have any alternative solutions??
>
>              +-----------------+
>              |   IPoIB Router  |
>              +-----------------+
>         ib port1|            |ibport2
>                 |            |
> +-----------------+       +-----------------+
> | IB Switch1      |-------| IB Switch 2     |
> +-----------------+       +-----------------+
>     |   ib port1|            |ibport2   |
>     |           |            |          |
>     |        +-----------------+        |
>     |        |     Client      |        |
>     |        +-----------------+        |
>     |                                   |
>     |        +-----------------+        |
>     +--------|     Server      |--------+
>   ibport1    +-----------------+  ibpoort2
>
> Sincerely.
>
> 2011/10/22 richard Croucher <Richard.croucher at informatix-sol.com>
>>
>> VLANS as such don't exist in InfiniBand so the  Linux VLAN support i.e.
>> vcontrol is not applicable.
>>
>> Instead, you should use InfiniBand partitions.  Like VLANs these create
>> separated broadcast domains which you then typically use for different IP
>> subnets.
>>
>> You are already using these,  your /dev/ib0  and /dev/ib1 just happen to
>> be in the default partition.
>>
>> As you create additional partitions, then the server ports you then add as
>> members will have new /dev/ib0_part# instances created.  ie a server with a
>> dual port card, added to three partitions will have six /dev/ib instances
>>
>> Bear in mind if you want to bond these logical ports  that they need to
>> be  within the same broadcast domain
>>
>> --
>>
>> Richard Croucher
>> www.informatix-sol.com
>> +44-7802-213901
>>
>> On Fri, 2011-10-21 at 11:39 +0900, Hiroyuki Sato wrote:
>>
>> Dear members.
>>
>> I would like ask the following question.
>>
>> Does IPoIB bonding support VLAN??
>> If so, how to configure it?
>>
>> Environment
>> OFED: OFED-1.5.3.2
>> OS: Scientific Linux 6.1
>>
>> Sincerely.
>>
>
>
>
> --
> Hiroyuki Sato
>



-- 
Hiroyuki Sato