<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=iso-8859-1">
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD><TITLE>infiniband bonding/merging/aggregation with SDP and/or VERBS</TITLE>
<META content="MSHTML 6.00.2900.3059" name=GENERATOR></HEAD>
<BODY>
<DIV id=idOWAReplyText17650 dir=ltr>
<DIV dir=ltr><FONT face=Arial color=#000000 size=2>If I understand your
information correct, there is no way of creating a fully redundant setup (2
servers connected with 2 paths to eachother end-to-end) with infiniband using
VERBS or SDP.</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>Koen</FONT></DIV></DIV>
<DIV dir=ltr> </DIV>
<DIV dir=ltr>
<HR tabIndex=-1>
</DIV>
<DIV dir=ltr><FONT face=Tahoma size=2><B>Van:</B> Scott Weitzenkamp (sweitzen)
[mailto:sweitzen@cisco.com]<BR><B>Verzonden:</B> do 8/03/2007
17:55<BR><B>Aan:</B> SEGERS Koen;
general@lists.openfabrics.org<BR><B>Onderwerp:</B> RE: [ofa-general] infiniband
bonding/merging/aggregation with SDP and/orVERBS<BR></FONT><BR></DIV>
<DIV>
<DIV><SPAN class=208445416-08032007><FONT face=Arial color=#0000ff
size=2>"ipoibcfg merge" only handles IPoIB, not SDP, and it's
active/passive.</FONT></SPAN></DIV><BR>
<BLOCKQUOTE
style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff 2px solid; MARGIN-RIGHT: 0px">
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> SEGERS Koen [mailto:Koen.SEGERS@VRT.BE]
<BR><B>Sent:</B> Thursday, March 08, 2007 1:03 AM<BR><B>To:</B> Scott
Weitzenkamp (sweitzen); general@lists.openfabrics.org<BR><B>Subject:</B> RE:
[ofa-general] infiniband bonding/merging/aggregation with SDP
and/orVERBS<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV id=idOWAReplyText12549 dir=ltr>
<DIV dir=ltr><FONT face=Arial color=#000000 size=2>Are you talking about a
kernel patch when you refer to the "bonding kernel driver"? I can't find
a specific bonding command that allows bonding two or more ports.</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial color=#000000 size=2>So if I understand it
correct, with SDP you can't have redundancy (active/passive) or
aggregation (active/active) with the current OFED-1.2 driver.</FONT></DIV>
<DIV dir=ltr><FONT face=Arial color=#000000 size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial color=#000000 size=2>Renaud Larsen of Cisco told
us that bonding is possible in the Topspin driver with the "ipoibcfg merge"
command. We are wondering if this also applies for SDP. That is why we
are </FONT><FONT face=Arial color=#000000 size=2>very interested in the
beta drivers of Topspin! We are supposed to get them (from Renaud)
within a few days, but if you can send it to me earlier, it is always
better :)</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>Greetings,</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>Koen</FONT></DIV></DIV>
<DIV dir=ltr><BR>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>Van:</B> Scott Weitzenkamp (sweitzen)
[mailto:sweitzen@cisco.com]<BR><B>Verzonden:</B> do 8/03/2007
0:01<BR><B>Aan:</B> SEGERS Koen;
general@lists.openfabrics.org<BR><B>Onderwerp:</B> RE: [ofa-general]
infiniband bonding/merging/aggregation with SDP
and/orVERBS<BR></FONT><BR></DIV>
<DIV>
<DIV dir=ltr align=left><SPAN class=984301017-07032007><FONT face=Arial
color=#0000ff size=2>I have not tried the OFED 1.2 IPoIB bonding kernel
driver, and can only speak for the userspace IPoIB HA ipoib_ha.pl
script.</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=984301017-07032007><FONT face=Arial
color=#0000ff size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=984301017-07032007><FONT face=Arial
color=#0000ff size=2>Both Topspin IPoIB and OFED IPoIB have active/passive
IPoIB high availability, neither can aggregate IPoIB throughput, and neither
has SDP high availability.</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=984301017-07032007><FONT face=Arial
color=#0000ff size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=984301017-07032007><FONT face=Arial
color=#0000ff size=2>We will have Tosppin driver SLES10 drivers in beta soon,
let me know if you are interested.</FONT></SPAN></DIV>
<DIV><FONT color=#0000ff></FONT> </DIV>
<DIV align=left><FONT face=Arial color=#0000ff size=2>Scott
Weitzenkamp</FONT></DIV>
<DIV align=left><FONT face=Arial color=#0000ff size=2>SQA and Release
Manager</FONT></DIV>
<DIV align=left><FONT face=Arial color=#0000ff size=2>Server Virtualization
Business Unit</FONT></DIV>
<DIV align=left><FONT face=Arial color=#0000ff size=2>Cisco
Systems</FONT></DIV>
<DIV> </DIV><BR>
<BLOCKQUOTE
style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff 2px solid; MARGIN-RIGHT: 0px">
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> general-bounces@lists.openfabrics.org
[mailto:general-bounces@lists.openfabrics.org] <B>On Behalf Of </B>SEGERS
Koen<BR><B>Sent:</B> Wednesday, March 07, 2007 6:59 AM<BR><B>To:</B>
general@lists.openfabrics.org<BR><B>Subject:</B> [ofa-general] infiniband
bonding/merging/aggregation with SDP and/orVERBS<BR></FONT><BR></DIV>
<DIV></DIV><BR>
<P><FONT size=2>Hi all!<BR><BR>We are trying to bond two ports on 1 HCA so
that we are able aggregate the throughput. We are also interested in bonding
ports of different HCA's.<BR><BR>Is this possible with the OFED driver? If
so, can you give the command?<BR>We know TopSpin has support for this
feature. Sadly, Topspin has no driver that runs on our system (SLES
10).<BR><BR>We currently installed OFED-1.2 of 20070306 and the stable
OFED-1.1 driver, but we can't figure out how this bonding is started in
either versions. It is important that we offload the bonding. We don't want
to use the standard linux bonding. That is why we think that bonding over
different HCA's is not going to work. Is this assumption correct?<BR><BR>Is
bonding possible when running SDP? And
VERBS?<BR><BR>Greetings<BR><BR>Koen<BR></FONT></P>*** Disclaimer
***<BR><BR>Vlaamse Radio- en Televisieomroep<BR>Auguste Reyerslaan 52, 1043
Brussel<BR><BR>nv van publiek recht<BR>BTW BE 0244.142.664<BR>RPR
Brussel<BR>http://www.vrt.be/disclaimer<BR><BR></BLOCKQUOTE></DIV>***
Disclaimer ***<BR><BR>Vlaamse Radio- en Televisieomroep<BR>Auguste Reyerslaan
52, 1043 Brussel<BR><BR>nv van publiek recht<BR>BTW BE 0244.142.664<BR>RPR
Brussel<BR>http://www.vrt.be/disclaimer<BR><BR></BLOCKQUOTE></DIV>*** Disclaimer ***<br><br>Vlaamse Radio- en Televisieomroep<br>Auguste Reyerslaan 52, 1043 Brussel<br><br>nv van publiek recht<br>BTW BE 0244.142.664<br>RPR Brussel<br>http://www.vrt.be/disclaimer<br> <br></BODY></HTML>