<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:595.0pt 842.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body bgcolor="white" lang="EN-GB" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D">To answer Q1 : I discover that you have to put the dest address into the info->dest_addr fields before calling getinfo - which is a bit annoying, but after stepping though the libfabric code,
I see it is using the rdma_cm functions under the hood and the rdma_get_peer_addr fails if it hasn’t been set.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D">(Note to self: find out how these address vectors work cos they look like they will be much easier to work with)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D">Q2 : I just wasn’t looking at the api properly, I can post an address and a descriptor in the fi_recv call and that’s fine.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D">JB<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif";mso-fareast-language:EN-GB">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif";mso-fareast-language:EN-GB"> Libfabric-users
[mailto:libfabric-users-bounces@lists.openfabrics.org] <b>On Behalf Of </b>Biddiscombe, John A.<br>
<b>Sent:</b> 20 February 2017 18:23<br>
<b>To:</b> libfabric-users@lists.openfabrics.org<br>
<b>Subject:</b> [libfabric-users] 2 questions<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-size:14.0pt">Question 1: I’ve created a passive endpoint (on both of two nodes) for listening, exchanged name details and created an active endpoint (on one node) that I call connect on, giving the address details of the
other node where the passive endpoint is listening.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt">I’m getting “ret=-22 (Invalid argument)” on my call to connect – since there are only 2 arguments set in the call I’m using<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt"> ret = <u>fi_connect</u>(ct.ep, name_data,
<u>NULL</u>, 0);<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt">dumping out the 16 bytes of buffer used for name (ip address is 192.168.3.36:
<o:p></o:p></span></p>
<p class="MsoNormal" style="text-indent:36.0pt"><span style="font-size:14.0pt">2:0:227:27:192:168:3:38:0:0:0:0:0:0:0:0:<o:p></o:p></span></p>
<p class="MsoNormal" style="text-indent:36.0pt"><span style="font-size:14.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt">enabling logging shows <o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt">libfabric:verbs:core:fi_ibv_msg_ep_connect():151<info> src_addr: 192.168.3.36:36996<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt">libfabric:verbs:core:fi_ibv_msg_ep_connect():158<info> dst_addr: 0.0.0.0:0<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt">fi_connect(): /users/biddisco/src/hvtkm/hpx/plugins/parcelport/libfabric/libfabric_controller.hpp:667 , ret=-22 (Invalid argument)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt">What might be wrong? (the ping pong example is just the same, the only difference is I have a passive endpoint and an active one on the same node – I’m using the same fi_fabric/fi_domain for both –could that
be what’s wrong?)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt">Question 2 : If I register a buffer for send/recv/read/write/etc and split it into N smaller buffers, in the post_ send/recv calls, there does not seem to be a way of using an offset into the buffer so that
I can post N of them each with a different offset (c.f. verbs equivalent, which uses the same local key, but a different offset for each).<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt">Can I do that, or do I have to register the buffer as a vetor of smaller buffers and ive each one a descriptor individually?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt">Thanks<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt">JB<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Times New Roman","serif";mso-fareast-language:EN-GB">--</span><span style="font-family:"Times New Roman","serif";mso-fareast-language:EN-GB"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Times New Roman","serif";mso-fareast-language:EN-GB">John Biddiscombe, email:biddisco @.at.@ cscs.ch</span><span style="font-family:"Times New Roman","serif";mso-fareast-language:EN-GB"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Times New Roman","serif";mso-fareast-language:EN-GB"><a href="http://www.cscs.ch/">http://www.cscs.ch/</a></span><span style="font-family:"Times New Roman","serif";mso-fareast-language:EN-GB"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Times New Roman","serif";mso-fareast-language:EN-GB">CSCS, Swiss National Supercomputing Centre | Tel: +41 (91) 610.82.07</span><span style="font-family:"Times New Roman","serif";mso-fareast-language:EN-GB"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="IT-CH" style="font-family:"Times New Roman","serif";mso-fareast-language:EN-GB">Via Trevano 131, 6900 Lugano, Switzerland | Fax: +41 (91) 610.82.82</span><span style="font-family:"Times New Roman","serif";mso-fareast-language:EN-GB"><o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>