<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:dt="uuid:C2F41010-65B3-11d1-A29F-00AA00C14882" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:"Yu Gothic";
panose-1:2 11 4 0 0 0 0 0 0 0;}
@font-face
{font-family:Aptos;}
@font-face
{font-family:"\@Yu Gothic";
panose-1:2 11 4 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif;
mso-ligatures:standardcontextual;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#467886;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Aptos",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:955526073;
mso-list-template-ids:31335494;}
@list l0:level1
{mso-level-tab-stop:.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:1.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level3
{mso-level-tab-stop:1.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level4
{mso-level-tab-stop:2.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level5
{mso-level-tab-stop:2.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level6
{mso-level-tab-stop:3.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level7
{mso-level-tab-stop:3.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level8
{mso-level-tab-stop:4.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level9
{mso-level-tab-stop:4.5in;
mso-level-number-position:left;
text-indent:-.25in;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#467886" vlink="#96607D" style="word-wrap:break-word">
<div class="WordSection1">
<ol style="margin-top:0in" start="1" type="1">
<li class="MsoNormal" style="mso-list:l0 level1 lfo1">H3 CXLand CXL Agent work<o:p></o:p></li><ol style="margin-top:0in" start="1" type="a">
<li class="MsoNormal" style="mso-list:l0 level2 lfo1">No change in status since last week.<o:p></o:p></li><li class="MsoNormal" style="mso-list:l0 level2 lfo1">Welly will share remote access information with Russ.<o:p></o:p></li></ol>
<li class="MsoNormal" style="mso-list:l0 level1 lfo1">Sunfish documentation<o:p></o:p></li><ol style="margin-top:0in" start="1" type="a">
<li class="MsoNormal" style="mso-list:l0 level2 lfo1">Need to have an official update since it has been a while since an official update.<o:p></o:p></li><li class="MsoNormal" style="mso-list:l0 level2 lfo1">Will figure out the new sections and assign out the work to do.<o:p></o:p></li><li class="MsoNormal" style="mso-list:l0 level2 lfo1">Documentation is at <span lang="X-NONE">
<a href="https://github.com/OpenFabrics/sunfish_docs">https://github.com/OpenFabrics/sunfish_docs</a></span>. If there is anything that does not look right, please add comments.<span lang="X-NONE"><o:p></o:p></span></li><li class="MsoNormal" style="mso-list:l0 level2 lfo1">Next version will be done in another branch.<o:p></o:p></li></ol>
<li class="MsoNormal" style="mso-list:l0 level1 lfo1">Update to Sunfish Server Reference code<o:p></o:p></li><ol style="margin-top:0in" start="1" type="a">
<li class="MsoNormal" style="mso-list:l0 level2 lfo1">No changes to the repo.<o:p></o:p></li><li class="MsoNormal" style="mso-list:l0 level2 lfo1">Main core library changes have been pulled to the main branch.<o:p></o:p></li><li class="MsoNormal" style="mso-list:l0 level2 lfo1">Need to use rherrell_fix_8_9_10 branch to have Sunfish reference function as an API frontend for either Sunfish service or agent service. Still need to develop a readme to explain how to use this code as
a frontend for Sunfish or agent and how to tie them all together. The OFMF server has a working set up under the Russ playpen. Ask Russ or Phil for help if you want to try.<o:p></o:p></li></ol>
<li class="MsoNormal" style="mso-list:l0 level1 lfo1">Quick report on using Containers as endpoints for our JBODs----lack of information on RDMA builds, we can table it, for now<o:p></o:p></li><ol style="margin-top:0in" start="1" type="a">
<li class="MsoNormal" style="mso-list:l0 level2 lfo1">Found lots of information from NVIDIA. Will continue to pursue this at Sandia, with help from a container expert.<o:p></o:p></li></ol>
<li class="MsoNormal" style="mso-list:l0 level1 lfo1">Sunfish NVMeoF Agent deep-dive for requirements and specs<o:p></o:p></li></ol>
<ol style="margin-top:0in" start="5" type="1">
<ol style="margin-top:0in" start="1" type="a">
<li class="MsoNormal" style="mso-list:l0 level2 lfo2">Continue timing diagram for gathering NVMeoF endpoints for Sunfish CDI (diagrams attached in the PDF)<o:p></o:p></li><ol style="margin-top:0in" start="1" type="1">
<li class="MsoNormal" style="mso-list:l0 level3 lfo2">Discussion of how NVMeoF works.
<o:p></o:p></li><ol style="margin-top:0in" start="1" type="1">
<li class="MsoNormal" style="mso-list:l0 level4 lfo2">Each NVMe server, which contains devices, has at least one DDC to expose resources on each subsystem, whether it is appliance, JBOD or JBOF. CDC is a rack solution that looks at each entity that exposes
NVMeoF and acts as a one stop shop for hosts to get these NVMe resources.<o:p></o:p></li><li class="MsoNormal" style="mso-list:l0 level4 lfo2">Each target has at least one DDC. When you go to the DDC, it will return a discovery log page. The discover log page lists subsystems that is available and their associated data.<o:p></o:p></li><li class="MsoNormal" style="mso-list:l0 level4 lfo2">CDC can be informed of a list of addresses to connect to DDCs and there is also a way to find those addresses automatically (using a similar protocol for printers). The diagram shows DDCs contacting the
CDC to say here I am. But this is implementation specific.<o:p></o:p></li></ol>
<li class="MsoNormal" style="mso-list:l0 level3 lfo2">Whether or not a CDC is part of the NVMe agent is implementation specific. For this diagram, CDC is part of the NVMe agent.<o:p></o:p></li><li class="MsoNormal" style="mso-list:l0 level3 lfo2">In the diagram, only the admin communicates with Sunfish. Communications between the admin and the Flux brokers are outside of Sunfish. Admin assign resources to broker 0. Broker 0 then assigns resources
to the other brokers, based on their job requirements. If want to make dynamic changes to what resources are available to broker 0, that is between the admin and broker 0.<o:p></o:p></li><ol style="margin-top:0in" start="1" type="1">
<li class="MsoNormal" style="mso-list:l0 level4 lfo2">Admin can be dumb (just a series of scripts) or smart.<o:p></o:p></li></ol>
<li class="MsoNormal" style="mso-list:l0 level3 lfo2">Mike will attempt to put this into code this weekend. Once we have the code, we can better see how things work.<o:p></o:p></li></ol>
</ol>
<li class="MsoNormal" style="mso-list:l0 level1 lfo2">Flux Prolog/Epilog final requirements and specs<o:p></o:p></li></ol>
<ol style="margin-top:0in" start="6" type="1">
<ol style="margin-top:0in" start="1" type="a">
<li class="MsoNormal" style="mso-list:l0 level2 lfo1">Initial implementation of Flux Broker Prolog/Epilog will need to just request an address to connect and disconnect from<o:p></o:p></li><ol style="margin-top:0in" start="1" type="1">
<li class="MsoNormal" style="mso-list:l0 level3 lfo1">We know the connect and disconnect scheme. Do the connection, build the burst buffer, tear it down with epilog and then disconnect.<o:p></o:p></li><li class="MsoNormal" style="mso-list:l0 level3 lfo1">Should have this available by the end of the month,
<o:p></o:p></li></ol>
</ol>
<li class="MsoNormal" style="mso-list:l0 level1 lfo1">V1.0 target<o:p></o:p></li><ol style="margin-top:0in" start="1" type="a">
<li class="MsoNormal" style="mso-list:l0 level2 lfo1">Goal is to have v1.0 by the end of the year.<o:p></o:p></li><li class="MsoNormal" style="mso-list:l0 level2 lfo1">With a target application and use case (Flux with NVMeoF), we can move quickly and learn from it so we can apply it to CXL agent.<o:p></o:p></li></ol>
</ol>
</div>
</body>
</html>