[ofa-general] Re: ipoib / bonding and OFED

[Or Gerlitz]

Bob Kossey wrote:
> Just to follow up on this, using RHEL5 and OFED 1.2 rc4, I was able
> to do enough rudimentary testing to convince myself that IB
> bonding was working.  I was able to use ib-bond, as well
> as the use of the openib.conf file to enable bonding on startup,
> including both(separately) IPOIBBOND_ENABLE and IPOIBHA_ENABLE.

Thanks for the feedback. OFED 1.2 supports both options, however, I am 
don't think that two HA solutions should be deployed at commercial 
distributions. What is your take (bonding vs ha daemon) on the correct 
way to move fwd?

> One thing I was not able to do however, was to start IB bonding
> using the standard bonding modifications to /etc/modprobe.conf
> and /etc/sysconfig/network-scripts/ifcfg* files.  Should this be possible,
> and are there perhaps some required settings I am missing?  I'll
> include my file modifications and some output below.

On some distributions (eg RH4 and SLES10) /sbin/ifenslave is used to 
configure bonding through the distro /sbin/ifup scheme. The ifenslave 
program is somehow obsoleted and is not supported under the bonding 
modifications to work with ipoib devices.

Moving forward, the way to go is using the bonding sysfs api, see the 
files under /sys/class/net/$BOND/bonding/ and the bonding documentation.

This is how the ib-bond script works and also /sbin/ifup-eth on RH5! on 
however for OFED 1.2 we did not make it to fully examine the RH5 scripts 
to the extent i can say if you can just work with the OS bonding 
configuration scheme not i can debug for you now why its not working.

Its definitely on our plan, but its P2 relative to the bonding changes 
upstream push, let me know if you this different.

Or.

> modprobe.conf:
> alias bond0 bonding
> options bond0 mode=active-backup miimon=100
> 
> ifcfg-bond0:
> DEVICE=bond0
> IPADDR="172.22.0.23"
> NETMASK="255.255.0.0"
> NETWORK="172.22.0.0"
> BROADCAST="172.22.255.255"
> ONBOOT=yes
> BOOTPROTO=none
> USERCTL=no
> BONDING_SLAVE0=ib0
> BONDING_SLAVE0=ib1
> 
> ifcfg-ib0:
> DEVICE=ib0
> USERCTL=no
> ONBOOT=yes
> MASTER=bond0
> SLAVE=yes
> BOOTPROTO=none
> 
> ifcfg-ib1:
> DEVICE=ib1
> USERCTL=no
> ONBOOT=yes
> MASTER=bond0
> SLAVE=yes
> BOOTPROTO=none