[ofa-general] ***SPAM*** Re: IB Bonding errors with recent kernel

[Moni Shoua]

Dennis Portello wrote:
> Hi Moni,
> 
> Thank you for looking into this. The discovery of multicast not working
> with bonding caused a major course correction in my project, I haven't
> checked emails from the list in a few days. I expect to verify if
> bonding works as you described later this week.
>
Please let me know how it  goes
> Unfortunately, bonding as you described will not work in my situation
> since we use Ethernet bonding as well.
I'm not sure I understand why bonding won't work. The only limitation for bonding
is that you can't enslave slaves of different types under the same master. However,
you can have several masters, each with a different types. 
The issue of multicast that isn't working for you has has an easy workaround.
> 
> I hope to revisit IPoIB at a later time.
> 
> Thanks again,
> Dennis P.
> 




> On Tue, Apr 21, 2009 at 8:04 AM, Moni Shoua <monis at voltaire.com
> <mailto:monis at voltaire.com>> wrote:
> 
>     Dennis Portello wrote:
>     > I can confirm that this issue exists beyond Redhat 4, I'm using Ubuntu
>     > 8.10 (2.6.27).
>     >
>     > I'm using ib-bond and I've also tried adding he bonds directly with
>     >
>     > echo +bond0 > /sys/class/net/bonding_masters
>     > echo 1 > /sys/class/net/bond0/bonding/mode
>     > echo 100 > /sys/class/net/bond0/bonding/miimon
>     > echo +ib0 > /sys/class/net/bond0/bonding/slaves
>     > echo +ib1 > /sys/class/net/bond0/bonding/slaves
>     > ifconfig bond0 192.168.47.102/24 <http://192.168.47.102/24>
>     <http://192.168.47.102/24>
>     > route add -net 224.0.0.0/3 <http://224.0.0.0/3>
>     <http://224.0.0.0/3> gw 192.168.47.100
>     >
>     I guess that what you see is a result of 2 issues.
>     First, a garbage multicast addresses that is passed to ib0 by bond0
>     The second, a garbage mulicast address in the list of mcast
>     addresses of interface ib0 prevents other legal addresses from
>     joining the mcast group.
> 
>     To avoid this (at least as a workaround) you should make sure that
>     interface bond0 won't be up before it  has ib slaves
>     or in other words, bond0 was never up between 'modprobe bonding' and
>     'echo +ib0 > /sys/class/net/bond0/bonding/slaves'
> 
>     Let me know if this  helps
> 
> 
> 
> ------------------------------------------------------------------------
> 
> _______________________________________________
> general mailing list
> general at lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
> 
> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general