<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Title" content="">
<meta name="Keywords" content="">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.gmail-p1, li.gmail-p1, div.gmail-p1
{mso-style-name:gmail-p1;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman";}
span.gmail-s1
{mso-style-name:gmail-s1;}
span.gmail-s2
{mso-style-name:gmail-s2;}
span.gmail-s3
{mso-style-name:gmail-s3;}
span.gmail-s4
{mso-style-name:gmail-s4;}
span.hoenzb
{mso-style-name:hoenzb;}
span.EmailStyle23
{mso-style-type:personal-reply;
font-family:Calibri;
color:windowtext;}
span.msoIns
{mso-style-type:export-only;
mso-style-name:"";
text-decoration:underline;
color:teal;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:595.0pt 842.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body bgcolor="white" lang="EN-GB" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:14.0pt;font-family:Calibri;mso-fareast-language:EN-US">Howard,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt;font-family:Calibri;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt;font-family:Calibri;mso-fareast-language:EN-US">Thanks for this info. HPX does its own thread->core binding so we never use the slurm settings, but I’ll bear this in mind if I discover problems and I’ll make
sure I use the --cpus-per-task option - I should only ever 1 process per node. I will know within a few days if our stuff runs properly as my first prototype is almost ready …<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt;font-family:Calibri;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt;font-family:Calibri;mso-fareast-language:EN-US">Yours<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt;font-family:Calibri;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt;font-family:Calibri;mso-fareast-language:EN-US">JB<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt;font-family:Calibri;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-family:Calibri;color:black">From: </span>
</b><span style="font-family:Calibri;color:black">Howard Pritchard <hppritcha@gmail.com><br>
<b>Date: </b>Thursday, 16 February 2017 at 23:30<br>
<b>To: </b>John Biddiscombe <biddisco@cscs.ch><br>
<b>Cc: </b>Sung-Eun Choi <sungeun@cray.com>, "libfabric-users@lists.openfabrics.org" <libfabric-users@lists.openfabrics.org><br>
<b>Subject: </b>Re: [libfabric-users] FI_EP_MSG on cray<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Hi John, <o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Okay I figured out the problem. I do not know if this will be important for your HPX work.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Basically the way SLURM is configured at NERSC, and apparently at CSCS is that<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">unless you suggest otherwise, each process launched by srun only gets 1/(total number of cores on node) network resources (Aries FMA descriptors, etc.). The Cray internal systems apparently aren't<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">configured this way. This results in the aborts in the GNI unit tests you were seeing.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">A workaround for that is to add the following to the run_gnitest script:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="gmail-p1"><span class="gmail-s1"> </span><span class="gmail-s2">args</span><span class="gmail-s1">=</span><span class="gmail-s3">"</span><span class="gmail-s4">-N1 --exclusive --cpu_bind=none -t00:20:00 --ntasks=1 --cpus-per-task=X"</span><o:p></o:p></p>
<p class="gmail-p1"><o:p> </o:p></p>
<p class="gmail-p1"><span class="gmail-s4">where X is the number of cores on the nodes of piz daint.</span><o:p></o:p></p>
<p class="gmail-p1">The tests that are failing exercise are using multi FMA descriptors per process as they test support for scalable endpoints and shared tx contexts. So, if HPX is going to use either of these libfabric constructs, you will need to remember
this --cpus-per-task SLURM argument.<o:p></o:p></p>
<p class="gmail-p1">I'll update the running criterion tests wiki.<o:p></o:p></p>
<p class="gmail-p1">Thanks,<o:p></o:p></p>
<p class="gmail-p1">Howard<o:p></o:p></p>
<p class="gmail-p1"><o:p> </o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">2017-02-16 14:29 GMT-07:00 Howard Pritchard <<a href="mailto:hppritcha@gmail.com" target="_blank">hppritcha@gmail.com</a>>:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<p class="MsoNormal">HI John, <o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I'm seeing this same problem at NERSC/edison. I'll use that system to debug this problem.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:#888888"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:#888888">Howard<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="color:#888888"><o:p> </o:p></span></p>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">2017-02-15 13:40 GMT-07:00 Biddiscombe, John A. <<a href="mailto:biddisco@cscs.ch" target="_blank">biddisco@cscs.ch</a>>:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<p class="MsoNormal">Sung<br>
<br>
just fyi : I checked out the v2.2.0 branch of criterion and recompiled it and libfabric and got broadly the same results, slightly different number of fails, but the same pattern.<br>
<br>
daint103:/scratch/snx3000/biddisco/src/libfabric-cray (master *=)$ ~/apps/libfabric/bin/run_gnitest<br>
[----] Warning! The test `api_cq::msg_send_only` crashed during its setup or teardown.<br>
Unidentified node: Error detected by libibgni.so. Subsequent operation may be unreliable. IAA did not recognize this as an MPI process<br>
Unidentified node: Error detected by libibgni.so. Subsequent operation may be unreliable. IAA did not recognize this as an MPI process<br>
[----] prov/gni/test/cm.c:203: Assertion failed: fi_endpoint<br>
[FAIL] cm_basic::srv_setup: (0.44s)<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal">[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::inject` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::inject_write` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::inject_write_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::inject_writedata` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::inject_writedata_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::read` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::read_alignment` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::readmsg` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::readv` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::write` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::write_alignment` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::write_alignment_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::write_autoreg` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::write_autoreg_uncached` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::write_error` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::write_fence` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::write_fence_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::write_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::writedata` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::writedata_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::writemsg` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::writemsg_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::writev` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `dgram_rma_stx::writev_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">[----] Warning! The test `rdm_rma_stx::inject` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::inject_write` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::inject_write_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::inject_writedata` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::inject_writedata_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::read` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::read_alignment` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::read_alignment_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::read_error` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::read_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::readmsg` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::readmsg_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::readv` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::readv_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::trigger` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::write` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::write_alignment` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::write_alignment_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::write_autoreg` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::write_autoreg_uncached` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::write_error` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::write_fence` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::write_fence_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::write_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::writedata` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::writedata_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::writemsg` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::writemsg_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::writev` crashed during its setup or teardown.<br>
[----] prov/gni/test/rdm_dgram_stx.c:165: Assertion failed: fi_endpoint<br>
[----] Warning! The test `rdm_rma_stx::writev_retrans` crashed during its setup or teardown.<br>
[----] prov/gni/test/sep.c:2343: Assertion failed: fi_scalable_ep<br>
[FAIL] scalable::av_insert: (0.46s)<br>
[----] prov/gni/test/sep.c:177: Assertion failed: fi_scalable_ep<br>
[----] Warning! The test `scalablem::all` crashed during its setup or teardown.<br>
[----] prov/gni/test/sep.c:177: Assertion failed: fi_scalable_ep<br>
[----] Warning! The test `scalablem::misc` crashed during its setup or teardown.<br>
[----] prov/gni/test/sep.c:177: Assertion failed: fi_scalable_ep<br>
[----] Warning! The test `scalablet::all` crashed during its setup or teardown.<br>
Unidentified node: Error detected by libibgni.so. Subsequent operation may be unreliable. IAA did not recognize this as an MPI process<br>
[----] prov/gni/test/vc.c:271: Assertion failed: fi_endpoint<br>
[----] Warning! The test `vc_conn_ping_auto::ep_connect_inter_cm` crashed during its setup or teardown.<br>
Unidentified node: Error detected by libibgni.so. Subsequent operation may be unreliable. IAA did not recognize this as an MPI process<br>
[----] prov/gni/test/vc.c:271: Assertion failed: fi_endpoint<br>
[----] Warning! The test `vc_conn_ping_auto::ep_connect_inter_cm_pp` crashed during its setup or teardown.<br>
Unidentified node: Error detected by libibgni.so. Subsequent operation may be unreliable. IAA did not recognize this as an MPI process<br>
[----] prov/gni/test/vc.c:271: Assertion failed: fi_endpoint<br>
[----] Warning! The test `vc_conn_ping_auto::ep_connect_intra_cm` crashed during its setup or teardown.<br>
Unidentified node: Error detected by libibgni.so. Subsequent operation may be unreliable. IAA did not recognize this as an MPI process<br>
[----] prov/gni/test/vc.c:271: Assertion failed: fi_endpoint<br>
[----] Warning! The test `vc_conn_ping_auto::ep_connect_intra_cm_pp` crashed during its setup or teardown.<br>
Unidentified node: Error detected by libibgni.so. Subsequent operation may be unreliable. IAA did not recognize this as an MPI process<br>
[----] prov/gni/test/vc.c:271: Assertion failed: fi_endpoint<br>
[----] Warning! The test `vc_conn_ping_auto::ep_connect_self` crashed during its setup or teardown.<br>
Unidentified node: Error detected by libibgni.so. Subsequent operation may be unreliable. IAA did not recognize this as an MPI process<br>
[----] prov/gni/test/vc.c:271: Assertion failed: fi_endpoint<br>
[----] Warning! The test `vc_conn_ping_auto::ep_connect_self_pp` crashed during its setup or teardown.<br>
Unidentified node: Error detected by libibgni.so. Subsequent operation may be unreliable. IAA did not recognize this as an MPI process<br>
[----] prov/gni/test/vc.c:271: Assertion failed: fi_endpoint<br>
[----] Warning! The test `vc_conn_ping_manual::ep_connect_inter_cm_pp` crashed during its setup or teardown.<br>
Unidentified node: Error detected by libibgni.so. Subsequent operation may be unreliable. IAA did not recognize this as an MPI process<br>
[----] prov/gni/test/vc.c:271: Assertion failed: fi_endpoint<br>
[----] Warning! The test `vc_conn_ping_manual::ep_connect_intra_cm` crashed during its setup or teardown.<br>
Unidentified node: Error detected by libibgni.so. Subsequent operation may be unreliable. IAA did not recognize this as an MPI process<br>
[----] prov/gni/test/vc.c:271: Assertion failed: fi_endpoint<br>
[----] Warning! The test `vc_conn_ping_manual::ep_connect_intra_cm_pp` crashed during its setup or teardown.<br>
Unidentified node: Error detected by libibgni.so. Subsequent operation may be unreliable. IAA did not recognize this as an MPI process<br>
[----] prov/gni/test/vc.c:271: Assertion failed: fi_endpoint<br>
[----] Warning! The test `vc_conn_ping_manual::ep_connect_self` crashed during its setup or teardown.<br>
Unidentified node: Error detected by libibgni.so. Subsequent operation may be unreliable. IAA did not recognize this as an MPI process<br>
[----] prov/gni/test/vc.c:271: Assertion failed: fi_endpoint<br>
[----] Warning! The test `vc_conn_ping_manual::ep_connect_self_pp` crashed during its setup or teardown.<br>
[====] Synthesis: Tested: 631 | Passing: 561 | Failing: 70 | Crashing: 68<o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</body>
</html>