<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
p.emailquote, li.emailquote, div.emailquote
{mso-style-name:emailquote;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:1.0pt;
border:none;
padding:0in;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">When you set the Local Area Connection (IPoIB) DHCP or static IPv4 address, this IP address is bound to the HCA/port pair.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">See ncpa.cpl->LAC(IPoIB) properties along with ipconfig.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Stan.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Christoph Müller [mailto:christoph.mueller@visus.uni-stuttgart.de]
<br>
<b>Sent:</b> Wednesday, January 25, 2012 1:24 PM<br>
<b>To:</b> Hefty, Sean; ofw_list<br>
<b>Cc:</b> Smith, Stan<br>
<b>Subject:</b> AW: Name resolution in WinVerbs/Multiple cards in one machine<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Hi Sean,<br>
<br>
thanks for your explanations. I already thought of some kind of DNS-related problem and will try to fix that tomorrow. In the meantime, I have another question: Is it sufficient if the name server returns the IPoIB address at any position in the host entry?
It would be a problem for me if it had to be the first. And can the machines be in different sub domains and nets? I do still not understand how the IP/GID mapping of a remote port is done in WV - I would expect the need for some kind of out of band mechanism
here, too.<br>
<br>
Best regards,<br>
Christoph <br>
<br>
Gesendet von meinem Windows Phone<o:p></o:p></span></p>
</div>
</div>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="3" width="100%" align="center">
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">Von:
</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">Hefty, Sean</span><br>
<b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">Gesendet: </span>
</b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">25.01.2012 20:27</span><br>
<b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">An: </span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">Christoph Müller; ofw_list</span><br>
<b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">Cc: </span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">Smith, Stan</span><br>
<b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">Betreff: </span>
</b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">RE: Name resolution in WinVerbs/Multiple cards in one machine</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt">This message was forwarded to me, since it apparently never made it to the mail list.<br>
<br>
> I have some problems understanding how the name resolution for IB devices<br>
> works. My primary problem is that my WinVerbs-based application ceased<br>
> functioning because OpenDevice() fails - it has worked before though, and I am<br>
> not aware of any configuration changes so far. The problem seems to be that<br>
> the device GUID that I use is invalid. I obtain this GUID from a Query() on<br>
> the connect endpoint after this end point was bound, but the GUID is all null.<br>
> I am pretty sure that it has not been before...<br>
<br>
Name resolution depends on converting the hostname into an IP address using DNS. There's nothing special that the IB stack provides to make this happen. IP resolution requires mapping the IP address to an IB address (typically GID). For this to work, ipoib
is required. A lookup is done to see what IB GID the IP address is associated with.<br>
<br>
Note that native IB devices do not know of or use IP addresses. The IP to IB address mapping is simply a convenience provided by the IB stack. So, to map from a hostname to an IB address, DNS is used to convert the hostname into an IP address, and then ipoib
is used to map that IP address into a GID.<br>
<br>
> I assume that the subnet manager holds mapping from machine names to GUIDs, is<br>
> that correct?<br>
<br>
No - the IB subnet manager only knows of GIDs, LIDs, and GUIDs.<br>
<br>
> I further assume that the subnet manager uses TCP/IP, DNS,<br>
> whatever to obtain this information, and that might be the problem.<br>
<br>
The local host software will handle this mapping.<br>
<br>
> A further question would be: If I know the port GUID, is there any possibility<br>
> to use it directly with WinVerbs? I can only see a Connect() accepting a<br>
> socket address...<br>
<br>
You can, but you would need to establish the connection using some sort of out of band mechanism (such as sockets) and manually configure the QPs. If you have the source code, you may want to look at libibverbs and those samples. libibverbs sits over winverbs
and the samples will establish connections out of band.<br>
<br>
> And is there any documentation on how to use multiple IB devices (dual port)<br>
> in one machine? I have not found any way to address the ports separately so<br>
> far, because I do not understand how the mapping of the socket address to the<br>
> port GUID works.<br>
<br>
Assuming that you get name resolution working again, as long as each port is assigned a different IP address you should be able to address each port separately. You may need to use the IP address for your resolution rather than the host name.<br>
<br>
- Sean<o:p></o:p></span></p>
</div>
</div>
</div>
</body>
</html>