<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr">
<p><span>Apologies - I missed this<br>
</span></p>
<p><span><br>
</span></p>
<p><span>"For versions 1.5 and later, scalable is implied by the lack of any mr_mode bits being set"</span></p>
<p><span><br>
</span></p>
<p><span>So I can just leave the mode unset and check the MR_LOCAL flag.</span></p>
<p><span><br>
</span></p>
<p><span>JB<br>
</span></p>
<p><br>
</p>
</div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Libfabric-users <libfabric-users-bounces@lists.openfabrics.org> on behalf of Biddiscombe, John A. <biddisco@cscs.ch><br>
<b>Sent:</b> 31 August 2020 13:00:15<br>
<b>To:</b> libfabric-users@lists.openfabrics.org<br>
<b>Subject:</b> [libfabric-users] FI_MR_SCALABLE on GNI</font>
<div> </div>
</div>
<div>
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr">
<p></p>
<div>Dear List</div>
<div><br>
</div>
<div>libfabric:16321:gni:core:ofi_check_mr_mode():545<info> Invalid memory registration mode<br>
libfabric:16321:gni:core:ofi_check_mr_mode():546<info> Expected: FI_MR_BASIC, FI_MR_MMU_NOTIFY<br>
libfabric:16321:gni:core:ofi_check_mr_mode():546<info> Given: FI_MR_SCALABLE<br>
libfabric:16321:gni:domain:_gnix_ep_getinfo():597<info> [16321:1] failed ofi_check_mr_mode, ret=-61</div>
<p></p>
<p><br>
</p>
<p>I'm using the libfabric 1.11 tag from the git repo and according to the feature matrix, scalable memory registration is supported on gni, however, I get the above error in the logs when I ask for it in using
<br>
</p>
<p> <span>fabric_hints_->domain_attr->mr_mode = FI_MR_SCALABLE;</span></p>
<p><br>
</p>
<p>Is the matrix incorrect, or should I keep playing with flags in case I've messed something up elsewhere?</p>
<p><br>
</p>
<p>Thanks</p>
<p><br>
</p>
<p>JB<br>
</p>
</div>
</div>
</body>
</html>