<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD><TITLE>infiniband bonding/merging/aggregation with SDP and/or VERBS</TITLE>
<META http-equiv=Content-Type content="text/html; charset=us-ascii">
<META content="MSHTML 6.00.2900.3059" name=GENERATOR></HEAD>
<BODY>
<DIV><SPAN class=626474022-09032007></SPAN><FONT face=Arial><FONT
color=#0000ff><FONT size=2>F<SPAN class=626474022-09032007>or SDP, there is no
transparent redundancy (I can't speak to
VERBS).</SPAN></FONT></FONT></FONT><BR></DIV>
<DIV><SPAN class=626474022-09032007><FONT face=Arial color=#0000ff
size=2>Scott</FONT></SPAN></DIV>
<BLOCKQUOTE
style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff 2px solid; MARGIN-RIGHT: 0px">
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> SEGERS Koen [mailto:Koen.SEGERS@VRT.BE]
<BR><B>Sent:</B> Friday, March 09, 2007 1:52 AM<BR><B>To:</B> Scott
Weitzenkamp (sweitzen); general@lists.openfabrics.org<BR><B>Subject:</B> RE:
[ofa-general] infiniband bonding/merging/aggregation with SDP
and/orVERBS<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV id=idOWAReplyText17650 dir=ltr>
<DIV dir=ltr><FONT face=Arial color=#000000 size=2>If I understand your
information correct, there is no way of creating a fully redundant setup (2
servers connected with 2 paths to eachother end-to-end) with infiniband using
VERBS or SDP.</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>Koen</FONT></DIV></DIV>
<DIV dir=ltr> </DIV>
<DIV dir=ltr>
<HR tabIndex=-1>
</DIV>
<DIV dir=ltr><FONT face=Tahoma size=2><B>Van:</B> Scott Weitzenkamp (sweitzen)
[mailto:sweitzen@cisco.com]<BR><B>Verzonden:</B> do 8/03/2007
17:55<BR><B>Aan:</B> SEGERS Koen;
general@lists.openfabrics.org<BR><B>Onderwerp:</B> RE: [ofa-general]
infiniband bonding/merging/aggregation with SDP
and/orVERBS<BR></FONT><BR></DIV>
<DIV>
<DIV><SPAN class=208445416-08032007><FONT face=Arial color=#0000ff
size=2>"ipoibcfg merge" only handles IPoIB, not SDP, and it's
active/passive.</FONT></SPAN></DIV><BR>
<BLOCKQUOTE
style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff 2px solid; MARGIN-RIGHT: 0px">
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> SEGERS Koen
[mailto:Koen.SEGERS@VRT.BE] <BR><B>Sent:</B> Thursday, March 08, 2007 1:03
AM<BR><B>To:</B> Scott Weitzenkamp (sweitzen);
general@lists.openfabrics.org<BR><B>Subject:</B> RE: [ofa-general]
infiniband bonding/merging/aggregation with SDP
and/orVERBS<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV id=idOWAReplyText12549 dir=ltr>
<DIV dir=ltr><FONT face=Arial color=#000000 size=2>Are you talking about a
kernel patch when you refer to the "bonding kernel driver"? I can't
find a specific bonding command that allows bonding two or more
ports.</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial color=#000000 size=2>So if I understand it
correct, with SDP you can't have redundancy (active/passive) or
aggregation (active/active) with the current OFED-1.2 driver.</FONT></DIV>
<DIV dir=ltr><FONT face=Arial color=#000000 size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial color=#000000 size=2>Renaud Larsen of Cisco
told us that bonding is possible in the Topspin driver with the "ipoibcfg
merge" command. We are wondering if this also applies for SDP. That is why
we are </FONT><FONT face=Arial color=#000000 size=2>very interested in
the beta drivers of Topspin! We are supposed to get them (from
Renaud) within a few days, but if you can send it to me earlier, it is
always better :)</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>Greetings,</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>Koen</FONT></DIV></DIV>
<DIV dir=ltr><BR>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>Van:</B> Scott Weitzenkamp (sweitzen)
[mailto:sweitzen@cisco.com]<BR><B>Verzonden:</B> do 8/03/2007
0:01<BR><B>Aan:</B> SEGERS Koen;
general@lists.openfabrics.org<BR><B>Onderwerp:</B> RE: [ofa-general]
infiniband bonding/merging/aggregation with SDP
and/orVERBS<BR></FONT><BR></DIV>
<DIV>
<DIV dir=ltr align=left><SPAN class=984301017-07032007><FONT face=Arial
color=#0000ff size=2>I have not tried the OFED 1.2 IPoIB bonding kernel
driver, and can only speak for the userspace IPoIB HA ipoib_ha.pl
script.</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=984301017-07032007><FONT face=Arial
color=#0000ff size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=984301017-07032007><FONT face=Arial
color=#0000ff size=2>Both Topspin IPoIB and OFED IPoIB have active/passive
IPoIB high availability, neither can aggregate IPoIB throughput, and neither
has SDP high availability.</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=984301017-07032007><FONT face=Arial
color=#0000ff size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=984301017-07032007><FONT face=Arial
color=#0000ff size=2>We will have Tosppin driver SLES10 drivers in beta
soon, let me know if you are interested.</FONT></SPAN></DIV>
<DIV><FONT color=#0000ff></FONT> </DIV>
<DIV align=left><FONT face=Arial color=#0000ff size=2>Scott
Weitzenkamp</FONT></DIV>
<DIV align=left><FONT face=Arial color=#0000ff size=2>SQA and Release
Manager</FONT></DIV>
<DIV align=left><FONT face=Arial color=#0000ff size=2>Server Virtualization
Business Unit</FONT></DIV>
<DIV align=left><FONT face=Arial color=#0000ff size=2>Cisco
Systems</FONT></DIV>
<DIV> </DIV><BR>
<BLOCKQUOTE
style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff 2px solid; MARGIN-RIGHT: 0px">
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B>
general-bounces@lists.openfabrics.org
[mailto:general-bounces@lists.openfabrics.org] <B>On Behalf Of </B>SEGERS
Koen<BR><B>Sent:</B> Wednesday, March 07, 2007 6:59 AM<BR><B>To:</B>
general@lists.openfabrics.org<BR><B>Subject:</B> [ofa-general] infiniband
bonding/merging/aggregation with SDP and/orVERBS<BR></FONT><BR></DIV>
<DIV></DIV><BR>
<P><FONT size=2>Hi all!<BR><BR>We are trying to bond two ports on 1 HCA so
that we are able aggregate the throughput. We are also interested in
bonding ports of different HCA's.<BR><BR>Is this possible with the OFED
driver? If so, can you give the command?<BR>We know TopSpin has support
for this feature. Sadly, Topspin has no driver that runs on our system
(SLES 10).<BR><BR>We currently installed OFED-1.2 of 20070306 and the
stable OFED-1.1 driver, but we can't figure out how this bonding is
started in either versions. It is important that we offload the bonding.
We don't want to use the standard linux bonding. That is why we think that
bonding over different HCA's is not going to work. Is this assumption
correct?<BR><BR>Is bonding possible when running SDP? And
VERBS?<BR><BR>Greetings<BR><BR>Koen<BR></FONT></P>*** Disclaimer
***<BR><BR>Vlaamse Radio- en Televisieomroep<BR>Auguste Reyerslaan 52,
1043 Brussel<BR><BR>nv van publiek recht<BR>BTW BE 0244.142.664<BR>RPR
Brussel<BR>http://www.vrt.be/disclaimer<BR><BR></BLOCKQUOTE></DIV>***
Disclaimer ***<BR><BR>Vlaamse Radio- en Televisieomroep<BR>Auguste
Reyerslaan 52, 1043 Brussel<BR><BR>nv van publiek recht<BR>BTW BE
0244.142.664<BR>RPR
Brussel<BR>http://www.vrt.be/disclaimer<BR><BR></BLOCKQUOTE></DIV>***
Disclaimer ***<BR><BR>Vlaamse Radio- en Televisieomroep<BR>Auguste Reyerslaan
52, 1043 Brussel<BR><BR>nv van publiek recht<BR>BTW BE 0244.142.664<BR>RPR
Brussel<BR>http://www.vrt.be/disclaimer<BR><BR></BLOCKQUOTE></BODY></HTML>