[ewg] [Q] Does IPoIB bonding support VLAN??

[Hiroyuki Sato]

Hello Richard
Thank you for your information.

I would like to biuld robust IB network like the following diagram.
* IP over Infiniband network
* Server and Client connect different network.(different subnet)
* Normal Case: Client -> Router -> Server (IBport1)
* IBSwtich1 Broken: Client -> Router -> Server (IBport2)

My plan. (Router)
* bond ib port1 and port2 active-backup mode.
* add VLANs(sub interfaces) (client and server netowrk) on bond interface.


I read this document pp 45.
http://www.mellanox.com/related-docs/prod_software/Mellanox_OFED_Linux_user_manual_1_5_1.pdf

* I succeed to create subinterface on ib0.
* I succeed to create bond interface ib0 and ib1
* But I don't know how to add subinterface on bond
Do you know how to config it or do you have any alternative solutions??

             +-----------------+
             |   IPoIB Router  |
             +-----------------+
        ib port1|            |ibport2
                |            |
+-----------------+       +-----------------+
| IB Switch1      |-------| IB Switch 2     |
+-----------------+       +-----------------+
    |   ib port1|            |ibport2   |
    |           |            |          |
    |        +-----------------+        |
    |        |     Client      |        |
    |        +-----------------+        |
    |                                   |
    |        +-----------------+        |
    +--------|     Server      |--------+
  ibport1    +-----------------+  ibpoort2

Sincerely.

2011/10/22 richard Croucher <Richard.croucher at informatix-sol.com>
>
> VLANS as such don't exist in InfiniBand so the  Linux VLAN support i.e. vcontrol is not applicable.
>
> Instead, you should use InfiniBand partitions.  Like VLANs these create separated broadcast domains which you then typically use for different IP subnets.
>
> You are already using these,  your /dev/ib0  and /dev/ib1 just happen to be in the default partition.
>
> As you create additional partitions, then the server ports you then add as members will have new /dev/ib0_part# instances created.  ie a server with a dual port card, added to three partitions will have six /dev/ib instances
>
> Bear in mind if you want to bond these logical ports  that they need to be  within the same broadcast domain
>
> --
>
> Richard Croucher
> www.informatix-sol.com
> +44-7802-213901
>
> On Fri, 2011-10-21 at 11:39 +0900, Hiroyuki Sato wrote:
>
> Dear members.
>
> I would like ask the following question.
>
> Does IPoIB bonding support VLAN??
> If so, how to configure it?
>
> Environment
> OFED: OFED-1.5.3.2
> OS: Scientific Linux 6.1
>
> Sincerely.
>



--
Hiroyuki Sato