<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Aptos;
panose-1:2 11 0 4 2 2 2 2 2 4;}
@font-face
{font-family:"Apple Color Emoji";
panose-1:0 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
@font-face
{font-family:Menlo;
panose-1:2 11 6 9 3 8 4 2 2 4;}
@font-face
{font-family:"Arial Narrow";
panose-1:2 11 6 6 2 2 2 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:10.0pt;
font-family:"Aptos",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#467886;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
font-size:10.0pt;
font-family:"Courier New";}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;
mso-ligatures:none;}
p.p1, li.p1, div.p1
{mso-style-name:p1;
margin:0in;
font-size:8.5pt;
font-family:Menlo;
color:black;}
span.s1
{mso-style-name:s1;
color:#39C026;}
span.s3
{mso-style-name:s3;
color:#5620F4;}
span.s4
{mso-style-name:s4;
color:#38B9C7;}
span.s2
{mso-style-name:s2;}
span.apple-converted-space
{mso-style-name:apple-converted-space;}
span.EmailStyle31
{mso-style-type:personal-reply;
font-family:"Aptos",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
mso-ligatures:none;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#467886" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt">Is it mandatory to install “</span>Ethernet Fabric Suite FS Package” to use PSM3 provider ? If yes. What is it providing ?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<div id="mail-editor-reference-message-container">
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" style="margin-bottom:12.0pt"><b><span style="font-size:12.0pt;color:black">From:
</span></b><span style="font-size:12.0pt;color:black">Libfabric-users <libfabric-users-bounces@lists.openfabrics.org> on behalf of Niyaz Murshed <Niyaz.Murshed@arm.com><br>
<b>Date: </b>Wednesday, July 3, 2024 at 9:51</span><span style="font-size:12.0pt;font-family:"Arial",sans-serif;color:black"> </span><span style="font-size:12.0pt;color:black">AM<br>
<b>To: </b>Łukasz Ślusarczyk <lukasz.slusarczyk@intel.com>, libfabric-users@lists.openfabrics.org <libfabric-users@lists.openfabrics.org><br>
<b>Cc: </b>nd <nd@arm.com><br>
<b>Subject: </b>Re: [libfabric-users] psm3 for Mellanox NIC<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt">I tried the steps.. however, now even the Intel NICS stopped showing PSM3
</span><span style="font-size:11.0pt;font-family:"Apple Color Emoji"">☹</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="p1"><span class="s1"><b>niymur01@spr1</b></span><span class="s2">:</span><span class="s3"><b>/opt/libfabric/bin</b></span><span class="s2">$ ./fi_info -p psm3</span><o:p></o:p></p>
<p class="p1"><span class="s2">provider: psm3</span><o:p></o:p></p>
<p class="p1"><span class="apple-converted-space"> </span><span class="s2">fabric: TCP-10.118.91.0/24</span><o:p></o:p></p>
<p class="p1"><span class="apple-converted-space"> </span><span class="s2">domain: eno1</span><o:p></o:p></p>
<p class="p1"><span class="apple-converted-space"> </span><span class="s2">version: 306.10</span><o:p></o:p></p>
<p class="p1"><span class="apple-converted-space"> </span><span class="s2">type: FI_EP_RDM</span><o:p></o:p></p>
<p class="p1"><span class="apple-converted-space"> </span><span class="s2">protocol: FI_PROTO_PSMX3</span><o:p></o:p></p>
<p class="p1"><span class="s2">provider: psm3</span><o:p></o:p></p>
<p class="p1"><span class="apple-converted-space"> </span><span class="s2">fabric: TCP-10.118.91.0/24</span><o:p></o:p></p>
<p class="p1"><span class="apple-converted-space"> </span><span class="s2">domain: eno1</span><o:p></o:p></p>
<p class="p1"><span class="apple-converted-space"> </span><span class="s2">version: 306.10</span><o:p></o:p></p>
<p class="p1"><span class="apple-converted-space"> </span><span class="s2">type: FI_EP_RDM</span><o:p></o:p></p>
<p class="p1"><span class="apple-converted-space"> </span><span class="s2">protocol: FI_PROTO_PSMX3</span><o:p></o:p></p>
<p class="p1"><span class="s2">provider: psm3</span><o:p></o:p></p>
<p class="p1"><span class="apple-converted-space"> </span><span class="s2">fabric: TCP-10.118.91.0/24</span><o:p></o:p></p>
<p class="p1"><span class="apple-converted-space"> </span><span class="s2">domain: eno1</span><o:p></o:p></p>
<p class="p1"><span class="apple-converted-space"> </span><span class="s2">version: 306.10</span><o:p></o:p></p>
<p class="p1"><span class="apple-converted-space"> </span><span class="s2">type: FI_EP_RDM</span><o:p></o:p></p>
<p class="p1"><span class="apple-converted-space"> </span><span class="s2">protocol: FI_PROTO_PSMX3</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="p1"><span class="s1"><b>niymur01@spr1</b></span><span class="s2">:</span><span class="s3"><b>~</b></span><span class="s2">$ ls /usr/src/ofa_kernel/x86_64/$(uname -r)/</span><o:p></o:p></p>
<p class="p1"><span class="s3"><b>compat</b></span><span class="apple-converted-space">
</span><span class="s2">compat_base</span><span class="apple-converted-space"> </span>
<span class="s2">compat_base_tree</span><span class="apple-converted-space"> </span>
<span class="s2">compat_base_tree_version</span><span class="apple-converted-space">
</span><span class="s2">compat.config</span><span class="apple-converted-space">
</span><span class="s2">compat_version</span><span class="apple-converted-space">
</span><span class="s4"><b>configure</b></span><span class="apple-converted-space">
</span><span class="s2">configure.mk.kernel</span><span class="apple-converted-space">
</span><span class="s3"><b>include</b></span><span class="apple-converted-space">
</span><span class="s2">Module.symvers</span><span class="apple-converted-space">
</span><span class="s3"><b>ofed_scripts</b></span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black"><a href="mailto:root@spr1:/tmp/Intel-Basic-IB.UBUNTU2204-x86_64.11.6.0.0.231">root@spr1:/tmp/Intel-Basic-IB.UBUNTU2204-x86_64.11.6.0.0.231#</a> ./INSTALL -a</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Installing All Intel Software</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Determining what is installed on system...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">dpkg-query: no packages found matching kmod-iefs-kernel-updates</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">dpkg-query: no packages found matching kmod-iefs-kernel-updates</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">-------------------------------------------------------------------------------</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Preparing OFA 11.6.0.0.231 release for Install...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Checking OS Dependencies needed for builds...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">devscripts is required to build Eth Module</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">ERROR - unable to perform builds due to need for additional OS rpms</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Unable to Prepare Kernel Module for Install</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">-------------------------------------------------------------------------------</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Installing Intel...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Enable Adjusts kernel ARP table size for large fabrics. (ARPTABLE_TUNING)? ->y</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">installing [iefsconfig-11.6.0.0-231.all]...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Selecting previously unselected package iefsconfig.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">(Reading database ... 211272 files and directories currently installed.)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Preparing to unpack .../iefsconfig_11.6.0.0-231_all.deb ...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Unpacking iefsconfig (11.6.0.0-231) ...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Setting up iefsconfig (11.6.0.0-231) ...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Created symlink /etc/systemd/system/multi-user.target.wants/iefs.service → /lib/systemd/system/iefs.service.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Processing triggers for man-db (2.10.2-1) ...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">-------------------------------------------------------------------------------</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Installing Basic Tools 11.6.0.0.231 release...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">installing [eth-tools-basic-11.6.0.0-231.amd64]...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Selecting previously unselected package eth-tools-basic.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">(Reading database ... 211293 files and directories currently installed.)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Preparing to unpack .../eth-tools-basic_11.6.0.0-231_amd64.deb ...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Unpacking eth-tools-basic (11.6.0.0-231) ...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">dpkg: eth-tools-basic: dependency problems, but configuring anyway as you requested:</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black"> eth-tools-basic depends on expect; however:</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black"> Package expect is not installed.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black"> eth-tools-basic depends on snmpd; however:</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black"> Package snmpd is not installed.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Setting up eth-tools-basic (11.6.0.0-231) ...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Processing triggers for man-db (2.10.2-1) ...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">-------------------------------------------------------------------------------</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Installing PSM3 11.6.0.0.231 release...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">installing [libpsm3-fi-11.6.0.0-231.amd64]...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Selecting previously unselected package libpsm3-fi.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">(Reading database ... 211314 files and directories currently installed.)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Preparing to unpack .../libpsm3-fi_11.6.0.0-231_amd64.deb ...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Unpacking libpsm3-fi (11.6.0.0-231) ...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Setting up libpsm3-fi (11.6.0.0-231) ...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Processing triggers for libc-bin (2.35-0ubuntu3.8) ...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Processing triggers for man-db (2.10.2-1) ...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">-------------------------------------------------------------------------------</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Installing Kernel Module release...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">get_kernel_rpms_to_install use dkms for eth_module</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Not Found: ./IntelEth-OFA_DELTA.UBUNTU2204-x86_64.11.6.0.0.231/DEBS/ubuntu-UB2204/iefs-kernel-updates-dkms 6.5.0-28-generic</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Not Found: ./IntelEth-OFA_DELTA.UBUNTU2204-x86_64.11.6.0.0.231/DEBS/ubuntu-UB2204/iefs-kernel-updates-devel 6.5.0-28-generic</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">-------------------------------------------------------------------------------</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Installing Eth RoCE 11.6.0.0.231 release...</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Enable RoCE RDMA transport. (ROCE_ON)? ->y</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Resource Limits Selector. (0-7) -> 5</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">dpkg-query: no packages found matching kmod-iefs-kernel-updates</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">Enabling autostart for SNMP</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">-------------------------------------------------------------------------------</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Reinstalled Libfabric.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">After that :</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">root@spr1:/home/niymur01/libfabric# /opt/libfabric/bin/fi_info -p psm3</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.5pt;font-family:Menlo;color:black">fi_getinfo: -61 (No data available)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<div id="mail-editor-reference-message-container">
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" style="margin-bottom:12.0pt"><b><span style="font-size:12.0pt;color:black">From:
</span></b><span style="font-size:12.0pt;color:black">Libfabric-users <libfabric-users-bounces@lists.openfabrics.org> on behalf of Niyaz Murshed <Niyaz.Murshed@arm.com><br>
<b>Date: </b>Thursday, June 20, 2024 at 2:30</span><span style="font-size:12.0pt;font-family:"Arial",sans-serif;color:black"> </span><span style="font-size:12.0pt;color:black">PM<br>
<b>To: </b>Łukasz Ślusarczyk <lukasz.slusarczyk@intel.com>, libfabric-users@lists.openfabrics.org <libfabric-users@lists.openfabrics.org><br>
<b>Cc: </b>nd <nd@arm.com><br>
<b>Subject: </b>Re: [libfabric-users] psm3 for Mellanox NIC</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt">Thank you so much for the reply.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">I will try this.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<div id="mail-editor-reference-message-container">
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" style="margin-bottom:12.0pt"><b><span style="font-size:11.0pt;color:black">From:
</span></b><span style="font-size:11.0pt;color:black">Łukasz Ślusarczyk <lukasz.slusarczyk@intel.com><br>
<b>Date: </b>Thursday, June 20, 2024 at 12:57</span><span style="font-size:11.0pt;font-family:"Arial",sans-serif;color:black"> </span><span style="font-size:11.0pt;color:black">AM<br>
<b>To: </b>Niyaz Murshed <Niyaz.Murshed@arm.com>, libfabric-users@lists.openfabrics.org <libfabric-users@lists.openfabrics.org><br>
<b>Cc: </b>nd <nd@arm.com><br>
<b>Subject: </b>Re: [libfabric-users] psm3 for Mellanox NIC</span><o:p></o:p></p>
</div>
<p>Hi!<o:p></o:p></p>
<p>It is supported. There is Intel Infiniband Package: <a href="https://www.intel.com/content/www/us/en/download/768193/intel-basic-infiniband-package.html">
https://www.intel.com/content/www/us/en/download/768193/intel-basic-infiniband-package.html</a><o:p></o:p></p>
<p>In section 4.5 of document describing installation of Intel's PSM3 <a href="https://downloadmirror.intel.com/818023/632484_Intel_Ethernet_Fabric_Software_Install_Guide_v1.7.pdf">
https://downloadmirror.intel.com/818023/632484_Intel_Ethernet_Fabric_Software_Install_Guide_v1.7.pdf</a> there are described optional steps for packages which support Mellanox OFED.<o:p></o:p></p>
<p>Note that not all Linux distributions work with IB (e.g. Ubuntu does not). See section 1.11 of
<a href="https://downloadmirror.intel.com/812204/N36141_Intel%20Ethernet%20Fabric%20Software%20Release%20Notes_11.5.1.2_v1.2.pdf">
https://downloadmirror.intel.com/812204/N36141_Intel%20Ethernet%20Fabric%20Software%20Release%20Notes_11.5.1.2_v1.2.pdf</a> for supported distributions.<o:p></o:p></p>
<p>Regards,<o:p></o:p></p>
<p style="margin-bottom:12.0pt">Łukasz<o:p></o:p></p>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt">On 20.06.2024 03:08, Niyaz Murshed wrote:</span><o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal"><span style="font-size:11.0pt">Hello All, </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Do PSM3 provider support Mellanox NIC?</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<pre><span style="color:black">Root#/libfabric# lshw -c net -businfo -numeric</span><o:p></o:p></pre>
<pre><span style="color:black">Bus info Device Class Description</span><o:p></o:p></pre>
<pre><span style="color:black">============================================================</span><o:p></o:p></pre>
<pre><span style="color:black"><a href="https://lists.openfabrics.org/mailman/listinfo/libfabric-users">pci at 0000</a>:01:00.0<mailto:<a href="https://lists.openfabrics.org/mailman/listinfo/libfabric-users">pci at 0000</a>:01:00.0> eno1 network I210 Gigabit Network Connection [8086:1533]</span><o:p></o:p></pre>
<pre><span style="color:black"> </span><o:p></o:p></pre>
<pre><span style="color:black"><a href="https://lists.openfabrics.org/mailman/listinfo/libfabric-users">pci at 0000</a>:40:00.0<mailto:<a href="https://lists.openfabrics.org/mailman/listinfo/libfabric-users">pci at 0000</a>:40:00.0> ens2f0np0 network MT2910 Family [ConnectX-7] [15B3:1021] (Mellanox Technologies MT2910 Family [ConnectX-7])</span><o:p></o:p></pre>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<pre><span style="color:black">When I run fi_info, psm3 is only enabled on for the intel nic</span><o:p></o:p></pre>
<pre><span style="color:black"> </span><o:p></o:p></pre>
<pre><span style="color:black">root#fi_info -p psm3</span><o:p></o:p></pre>
<pre><span style="color:black">provider: psm3</span><o:p></o:p></pre>
<pre><span style="color:black"> fabric: TCP-10.118.91.0/24</span><o:p></o:p></pre>
<pre><span style="color:black"> domain: eno1</span><o:p></o:p></pre>
<pre><span style="color:black"> version: 306.10</span><o:p></o:p></pre>
<pre><span style="color:black"> type: FI_EP_RDM</span><o:p></o:p></pre>
<pre><span style="color:black"> protocol: FI_PROTO_PSMX3</span><o:p></o:p></pre>
<pre><span style="color:black">provider: psm3</span><o:p></o:p></pre>
<pre><span style="color:black"> fabric: TCP-10.118.91.0/24</span><o:p></o:p></pre>
<pre><span style="color:black"> domain: eno1</span><o:p></o:p></pre>
<pre><span style="color:black"> version: 306.10</span><o:p></o:p></pre>
<pre><span style="color:black"> type: FI_EP_RDM</span><o:p></o:p></pre>
<pre><span style="color:black"> protocol: FI_PROTO_PSMX3</span><o:p></o:p></pre>
<pre><span style="color:black">provider: psm3</span><o:p></o:p></pre>
<pre><span style="color:black"> fabric: TCP-10.118.91.0/24</span><o:p></o:p></pre>
<pre><span style="color:black"> domain: eno1</span><o:p></o:p></pre>
<pre><span style="color:black"> version: 306.10</span><o:p></o:p></pre>
<pre><span style="color:black"> type: FI_EP_RDM</span><o:p></o:p></pre>
<pre><span style="color:black"> protocol: FI_PROTO_PSMX3</span><o:p></o:p></pre>
<pre><span style="color:black"> </span><o:p></o:p></pre>
<pre><span style="color:black"> </span><o:p></o:p></pre>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">root # ibv_devinfo</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">hca_id: mlx5_0</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"> transport: InfiniBand (0)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"> fw_ver: 28.39.3004</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"> node_guid: 946d:ae03:007d:a230</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"> sys_image_guid: 946d:ae03:007d:a230</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"> vendor_id: 0x02c9</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"> vendor_part_id: 4129</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"> hw_ver: 0x0</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"> board_id: MT_0000000834</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"> phys_port_cnt: 1</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"> port: 1</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"> state: PORT_ACTIVE (4)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"> max_mtu: 4096 (5)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"> active_mtu: 1024 (3)</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"> sm_lid: 0</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"> port_lid: 0</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"> port_lmc: 0x00</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"> link_layer: Ethernet</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:12.0pt"> </span><o:p></o:p></p>
<pre><span style="color:black"> </span><o:p></o:p></pre>
<pre><span style="color:black">root # lscpu</span><o:p></o:p></pre>
<pre><span style="color:black">Architecture: x86_64</span><o:p></o:p></pre>
<pre><span style="color:black"> CPU op-mode(s): 32-bit, 64-bit</span><o:p></o:p></pre>
<pre><span style="color:black">Vendor ID: GenuineIntel</span><o:p></o:p></pre>
<pre><span style="color:black"> Model name: Intel(R) Xeon(R) Platinum 8480+</span><o:p></o:p></pre>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Is this expected?</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>Libfabric-users mailing list<o:p></o:p></pre>
<pre><a href="mailto:Libfabric-users@lists.openfabrics.org">Libfabric-users@lists.openfabrics.org</a><o:p></o:p></pre>
<pre><a href="https://lists.openfabrics.org/mailman/listinfo/libfabric-users">https://lists.openfabrics.org/mailman/listinfo/libfabric-users</a><o:p></o:p></pre>
</blockquote>
<div class="MsoNormal" align="center" style="text-align:center"><span style="font-size:12.0pt">
<hr size="0" width="100%" align="center">
</span></div>
<p class="MsoNormal"><strong><span style="font-size:9.0pt;font-family:"Arial Narrow",sans-serif;color:#595959">Intel Technology Poland sp. z o.o.</span></strong><b><span style="font-size:9.0pt;font-family:"Arial Narrow",sans-serif;color:#595959"><br>
</span></b><span style="font-size:9.0pt;font-family:"Arial Narrow",sans-serif;color:#595959">ul. Słowackiego 173 | 80-298 Gdańsk | Sąd Rejonowy Gdańsk Północ | VII Wydział Gospodarczy Krajowego Rejestru Sądowego - KRS 101882 | NIP 957-07-52-316 | Kapitał zakładowy
200.000 PLN.<br>
Spółka oświadcza, że posiada status dużego przedsiębiorcy w rozumieniu ustawy z dnia 8 marca 2013 r. o przeciwdziałaniu nadmiernym opóźnieniom w transakcjach handlowych.
</span><o:p></o:p></p>
<p><span style="font-size:8.0pt;font-family:"Arial Narrow",sans-serif;color:#595959">Ta wiadomość wraz z załącznikami jest przeznaczona dla określonego adresata i może zawierać informacje poufne. W razie przypadkowego otrzymania tej wiadomości, prosimy o powiadomienie
nadawcy oraz trwałe jej usunięcie; jakiekolwiek przeglądanie lub rozpowszechnianie jest zabronione.<br>
This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). If you are not the intended recipient, please contact the sender and delete all copies; any review or distribution by others is strictly prohibited.
</span><o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>