<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<meta name="Generator" content="Microsoft Exchange Server">
<!-- converted from text --><style><!-- .EmailQuote { margin-left: 1pt; padding-left: 4pt; border-left: #800000 2px solid; } --></style>
</head>
<body>
<meta content="text/html; charset=UTF-8">
<style type="text/css" style="">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
</style>
<div dir="ltr">
<div id="x_divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Helvetica,sans-serif">
<p>Thanks. This is very useful information. I will experiment with the collectives and see if I can get any tentative results in our HPX backend.</p>
<p><br>
</p>
<p>I'm also interested in GPUDirect support and interfacing via libfabric - or at least having a simple async interface of the same style that allows me to coordinate transfers from GPU->GPU/CPU etc - I see that this has been discussed at ofiwg meetings , so
I'll keep my ear to the ground for more news. <br>
</p>
<p><br>
</p>
<p>Cheers</p>
<p><br>
</p>
<p>JB</p>
<p><br>
</p>
</div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="x_divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> Hefty, Sean <sean.hefty@intel.com><br>
<b>Sent:</b> 27 November 2019 18:38:47<br>
<b>To:</b> Biddiscombe, John A.; 'ofiwg@lists.openfabrics.org'; libfabric-users@lists.openfabrics.org<br>
<b>Subject:</b> RE: libfabric release v1.9.0 is now available</font>
<div> </div>
</div>
</div>
<font size="2"><span style="font-size:10pt;">
<div class="PlainText">> Where can I find further information on collectives? - I have been waiting for these<br>
> for a while and was considering switching from libfabric to UCX as they have a lot of<br>
> activity on their mailing list and I saw progress on collectives. I am willing to make<br>
> contributions to libfabric collectives if there is work to be done. For now, I'd<br>
> welcome any info on how to start testing experimenting with them.<br>
<br>
See:<br>
<br>
<a href="https://ofiwg.github.io/libfabric/master/man/fi_collective.3.html">https://ofiwg.github.io/libfabric/master/man/fi_collective.3.html</a><br>
<br>
Collective support was discussed a few times in the OFIWG. These target switch based collectives. The rxm provider has implemented 2-3 of the collectives, but that is actively being expanded. I would guess that most or all collectives that have been defined
will likely be available in a 1.10 release (target is March).<br>
<br>
Since the collectives target offloaded support, there will likely be limitations on the software implementation. The primary goal of the software implementation is to verify the API and allow application development. Real collective optimizations would still
be the responsibility of MPI.<br>
<br>
- Sean <br>
</div>
</span></font>
</body>
</html>