<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">All,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I had one of my developers give it a quick try on an Intel build laptop (Windows 10 Enterprise). Initial testing with rxe looked fine with both Ubuntu 18.10 (4.18) and 18.04.1 (4.15). The verbs tests worked on both but we did see some issues
with libfabric-verbs on 18.10 using fi_pingpong.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Note: any VM will need Hyper-V disabled to run. At Intel it required IT to disable on our laptop builds.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Here is a BKM from my developer for reference:<o:p></o:p></p>
<p class="MsoNormal"><span style="color:#1F3864"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">create 2 drives each 10G to mount to / and /home<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">set up network/firefox proxies (if needed)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">set root passwd just in case<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">set NOPASSWD: in sudoers<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">set Acquire::http::Proxy "<a href="http://proxy_server:port">http://proxy_server:port</a>"; and<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864"> Acquire::https::Proxy "<a href="https://proxy_server:port">https://proxy_server:port</a>";<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864"> in a /etc/apt/apt.conf.d/ file<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">sudo apt update<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">sudo apt upgrade<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">#--- if you want to build your own kernel but not needed with ubuntu 18.04.1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">sudo apt install -y git make gcc bison flex libelf-dev libssl.dev<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">git clone <a href="https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git">
https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git</a><o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">cd linux<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">git reset --hard v4.19 (or latest stable tag)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">cp /boot/config* .confg<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">make && sudo make modules_install install<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">reboot<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">#----<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">sudo apt install -y rdmacm-utils librdmacm-dev libibverbs-dev ibverbs-utils<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">sudo apt install -y perftest rdma-core libfabrics-dev libfabric1<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">sudo modprobe rdma_rxe<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">sudo rxe_cfg add enp0s3 #or whatever the Ethernet device name is<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">server client<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">ib_read_bw ib_read_bw localhost<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864">fi_pingpong -p verbs -e rdm fi_pingpong -p verbs -e rdm localhost<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F3864"><o:p> </o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>