<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META http-equiv=Content-Type content="text/html; charset=us-ascii">
<META content="MSHTML 6.00.6000.16441" name=GENERATOR></HEAD>
<BODY>
<DIV><SPAN class=186021015-11102007><FONT face=Arial color=#0000ff size=2>Let me
try and introduce another option to connect between windows and Linux:
SDP</FONT></SPAN></DIV>
<DIV><SPAN class=186021015-11102007><FONT face=Arial color=#0000ff
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=186021015-11102007><FONT face=Arial color=#0000ff
size=2>Mellanox has an SDP implementation for windows that can be used to
connect between windows and Linux.</FONT></SPAN></DIV>
<DIV><SPAN class=186021015-11102007><FONT face=Arial color=#0000ff size=2>It has
the following advantages:</FONT></SPAN></DIV>
<DIV><SPAN class=186021015-11102007> <FONT face=Arial
color=#0000ff size=2>1) Reaches the wire speed with one connection and small
packets. (Much better then ipoib-cm that is not written
yet).</FONT></SPAN></DIV>
<DIV><SPAN class=186021015-11102007> <FONT face=Arial
color=#0000ff size=2>2) Very low latency (~7us).</FONT></SPAN></DIV>
<DIV><SPAN class=186021015-11102007> <FONT face=Arial
color=#0000ff size=2>3) You can write your program as a normal socket program.
Please note that the socket API is much better documented than the DAPL
one.</FONT></SPAN></DIV>
<DIV><SPAN class=186021015-11102007><FONT face=Arial color=#0000ff
size=2></FONT></SPAN> </DIV>
<DIV><SPAN class=186021015-11102007><FONT face=Arial color=#0000ff
size=2>Thanks</FONT></SPAN></DIV>
<DIV><SPAN class=186021015-11102007><FONT face=Arial color=#0000ff
size=2>Tzachi</FONT></SPAN></DIV><BR>
<BLOCKQUOTE
style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff 2px solid; MARGIN-RIGHT: 0px">
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> ofw-bounces@lists.openfabrics.org
[mailto:ofw-bounces@lists.openfabrics.org] <B>On Behalf Of </B>Smith,
Stan<BR><B>Sent:</B> Thursday, October 11, 2007 5:00 PM<BR><B>To:</B> Greg
Rodgers; ofw@lists.openfabrics.org<BR><B>Subject:</B> RE: [ofw] WinOF
interoperable with Linux OpenIB<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV dir=ltr align=left><SPAN class=594184714-11102007><FONT face=Arial
color=#0000ff size=2>Hello,</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=594184714-11102007><FONT face=Arial
color=#0000ff size=2> As Sean pointed out, the IB connection manager is
the issue; different CM connection protocols between Linux and Windows. The
DAT/DAPL sides, if they could get connected, would have no problems exchanging
messages. Once upon a time, in a land, far, far away....an early MPI/DAPL
kludge was setup such that a TCP/IP socket connection was used to exchange IB
Queue Pair (QP) information then used to link remote QPs; not recommended or
supported in Windows.</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=594184714-11102007><FONT face=Arial
color=#0000ff size=2>About 9 months ago Voltaire was slated to start work on a
connected mode IPoIB for Windows (64K MTU); no telemetry since
then.</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=594184714-11102007><FONT face=Arial
color=#0000ff size=2>So sadly 2K MTU IPoIB is about the best there is at this
juncture.</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=594184714-11102007><FONT face=Arial
color=#0000ff size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=594184714-11102007><FONT face=Arial
color=#0000ff size=2>stan.</FONT></SPAN></DIV><BR>
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> ofw-bounces@lists.openfabrics.org
[mailto:ofw-bounces@lists.openfabrics.org] <B>On Behalf Of </B>Greg
Rodgers<BR><B>Sent:</B> Wednesday, October 10, 2007 6:42 PM<BR><B>To:</B>
ofw@lists.openfabrics.org<BR><B>Subject:</B> [ofw] WinOF interoperable with
Linux OpenIB<BR></FONT><BR></DIV>
<DIV></DIV><BR><BR><FONT face=sans-serif size=2>We would like to link a
Windows machine to a Linux machine with InfiniBand and use DAPL. IPoIB
is not fast enough. On the Linux side we have OFED 1.2 with RHEL 5.1.
I am new to OpenIB but I hear that Windows would have a problem
with RDMA cm. Can anyone give me some high level advice before I get
the hardware? The Windows machine will be Windows 2003 R2 with Mellonox
SDR card. </FONT><BR><BR><FONT face=sans-serif size=2>Thank you.
</FONT><BR><BR><FONT face=sans-serif size=2>Greg Rodgers</FONT>
</BLOCKQUOTE></BODY></HTML>