[ofa-general] Re: [ewg] questions about OFED 1.2 IPoIB bonding

[Moni Shoua]

Scott Weitzenkamp (sweitzen) wrote:
> Moni,
>  
> I've been testing IPoIB bonding on RHEL4 x86_64 and RHEL5 x86_64, and
> have some questions.  This feature looks like it has a lot of potential,
> thanks for adding it to OFED 1.2.
>  
Thanks for the inputs....

> 1) IPoIB bonding and IPoIB CM do seem to work together, but after
> running ib-bond --bond-ip, I have to manually reconfigure IPoIB CM (both
> mode and mtu) again, then increase the bond0 mtu.  It would be nice if
> ib-bond took care of this for me.
I haven't had a chance yet to test bonding with IPoIB-CM. I'll look into it and try to
fix what's needed.
>  
> 2) I tried a port failover stress test overnight (flipping a port every
> 10 seconds) and got an HCA catastrophic error, how much failover stress
> testing have you done while traffic is running?
I ran the same tests more or less but never had such errors.
>  
> 3) Can I configure IPoIB bonding to start at boot time as part of the
> standard /etc/sysconfig network scripts?
We are thinking how to make the bond interface act as "normal" network interface.
>  
> 4) Do you have any plans to support load balancing in addition to failover?
We have thoughts how to add support for more bonding policies but it is not something we plan to implement immediately.
>  
> 5) I've seen some erratic throughput with netperf using bond0 (no
> failover happening), have you seen this?  For example:
Can you add please more details about the test environment? OS, ARCH, HW, etc...
>  
> Interim result: 2731.18 10^6bits/s over 1.00 seconds
> Interim result: 2732.57 10^6bits/s over 1.00 seconds
> Interim result: 2717.93 10^6bits/s over 1.01 seconds
> Interim result: 1609.63 10^6bits/s over 1.69 seconds
> Interim result:  487.73 10^6bits/s over 3.30 seconds
> Interim result:  394.51 10^6bits/s over 1.24 seconds
> Interim result:  380.00 10^6bits/s over 1.04 seconds
> Interim result:  621.87 10^6bits/s over 1.08 seconds
> Interim result:  372.02 10^6bits/s over 1.67 seconds
> Interim result:  388.15 10^6bits/s over 1.00 seconds
> Interim result:  419.81 10^6bits/s over 1.00 seconds
> Interim result:  369.75 10^6bits/s over 1.14 seconds
> Interim result:  858.04 10^6bits/s over 1.00 seconds
> Interim result: 2285.79 10^6bits/s over 1.15 seconds
> Interim result:  501.81 10^6bits/s over 4.56 seconds
> Interim result:  465.64 10^6bits/s over 1.08 seconds
> Interim result:  499.98 10^6bits/s over 1.00 seconds
> Interim result:  478.41 10^6bits/s over 1.05 seconds
> Interim result:  482.03 10^6bits/s over 1.00 seconds
> Interim result:  494.85 10^6bits/s over 1.01 seconds
>  
> Scott Weitzenkamp
> SQA and Release Manager
> Server Virtualization Business Unit
> Cisco Systems
>  
> 
> 
> ------------------------------------------------------------------------
> 
> _______________________________________________
> ewg mailing list
> ewg at lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg