<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:DengXian;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Aptos;}
@font-face
{font-family:"\@DengXian";
panose-1:2 1 6 0 3 1 1 1 1 1;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
span.gmail-apple-converted-space
{mso-style-name:gmail-apple-converted-space;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Aptos",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:566837941;
mso-list-type:hybrid;
mso-list-template-ids:-1436894912 -907134876 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l0:level1
{mso-level-text:"\(%1\)";
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#467886" vlink="#96607D" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt">Hi Anders,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">The FI_ADDR_IB_UD address format has a provider defined layout that you may not be able to construct unless you dig info the provider source which is not recommended. There are two ways to get the address
to be used for fi_av_insert:<o:p></o:p></span></p>
<ol style="margin-top:0in" start="1" type="1">
<li class="MsoListParagraph" style="margin-left:0in;mso-list:l0 level1 lfo1"><span style="font-size:11.0pt">Create endpoint and use fi_getname() to get the local address (endpoint name is the address) and then use an out-of-band mechanism (e.g. a socket connection,
or PMI) to exchange the address. This method doesn’t use the name server.<o:p></o:p></span></li><li class="MsoListParagraph" style="margin-left:0in;mso-list:l0 level1 lfo1"><span style="font-size:11.0pt">Pass non-NULL “node” and “service” of the remote side to the fi_getinfo() call and the resulting “info” structure should have the destination address
set in “info->dest_addr”. This method requires the use of the name server.<o:p></o:p></span></li></ol>
<p class="MsoNormal"><span style="font-size:11.0pt">The name server is used to resolve “node + service” into an address of format FI_ADDR_IB_UD, where “node” can be a host name or a host IP address (the string, not the binary format) and “service” is usually
the port number (also the string). It is only used by fi_getinfo(). IP address can’t be used as input for fi_av_insert().<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Best regards,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Jianxin <o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Libfabric-users <libfabric-users-bounces@lists.openfabrics.org>
<b>On Behalf Of </b>Anders Dam Jensen<br>
<b>Sent:</b> Sunday, August 11, 2024 2:22 AM<br>
<b>To:</b> libfabric-users@lists.openfabrics.org<br>
<b>Subject:</b> [libfabric-users] FI_EP_DGRAM using fi_verbs provider<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal"><span lang="DA" style="font-size:11.0pt;color:#212121">Hi Libfabric community,</span><span style="font-size:11.0pt;color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="DA" style="font-size:11.0pt;color:#212121"> </span><span style="font-size:11.0pt;color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#212121">Can anyone point me to an example of how to use DGRAM with the fi_verbs provider?<span class="gmail-apple-converted-space"> </span><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#212121"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#212121">I have no problem getting DGRAM to work with the fi_udp provider, but when I move the code to verbs, the address resolution fails.<span class="gmail-apple-converted-space"> </span><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#212121"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#212121">I can see that DGRAM supports/needs FI_ADDR_IB_UD, but I am unable to add such addresses to the AV.<span class="gmail-apple-converted-space"> </span><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#212121"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#212121">Furthermore, the verbs provider doc refers to variables specific to DGRAM endpoints:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#212121"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#212121">FI_VERBS_DGRAM_USE_NAME_SERVER: The option that enables/disables OFI Name Server thread. The NS thread is used to resolve IP-addresses to provider specific addresses (default: 1, if “OMPI_COMM_WORLD_RANK”
and “PMI_RANK” environment variables aren’t defined)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#212121">FI_VERBS_NAME_SERVER_PORT:<span class="gmail-apple-converted-space"> </span>The port on which Name Server thread listens incoming connections and requests (default: 5678)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="DA" style="font-size:11.0pt;color:#212121"> </span><span style="font-size:11.0pt;color:#212121"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#212121">This makes it sound like ip address resolution should work, but I cannot find any documentation on this.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#212121"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#212121">Thanks Anders<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#212121"> <o:p></o:p></span></p>
</div>
</div>
</div>
</body>
</html>