<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Hi Sean --</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
I called fi_cq_read(cq, buf, 5) and it filled in buf with 5 entries. buf[0].flags==FI_MSG|FI_RECV and buf[0].buf was near the end of the multi-receive buffer. buf[1].flags==FI_MULTI_RECV. buf[2].flags==FI_MSG|FI_RECV and buf[2].buf was much earlier in the
multi-receive buffer than buf[0].buf. buf[3] and buf[4] were the same as buf[2] but with different .buf pointers though both were also much earlier in the multi-receive buffer than buf[0].buf.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
greg</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div id="appendonsend"></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> Hefty, Sean <sean.hefty@intel.com><br>
<b>Sent:</b> Wednesday, June 24, 2020 4:17 PM<br>
<b>To:</b> Titus, Greg <gregory.titus@hpe.com>; libfabric-users@lists.openfabrics.org <libfabric-users@lists.openfabrics.org><br>
<b>Subject:</b> RE: multi-receive CQ entry with FI_MULTI_RECV, not the last one read by fi_cq_read()?</font>
<div> </div>
</div>
<div class="BodyFragment"><font size="2"><span style="font-size:11pt">
<div class="PlainText">> Hmm, interesting. My only ordering assertions are that I have<br>
> FI_ORDER_RMA_RAW|FI_ORDER_SAS|FI_ORDER_SAW in both the tx_attr and rx_attr msg_order<br>
> members of the hints for my fi_getinfo(). In the tx_attr and rx_attr op_flags I've just<br>
> got FI_COMPLETION. But the CQ entry with the FI_MULTI_RECV flag set was entry 1 out of<br>
> a range of 0..4, as I said. Definitely not the last one.<br>
<br>
At least with rxm, the completion that reports that a multi-recv buffer has been consumed is not associated with a message. I'm not sure what you mean by entry 1 out of a range of 0 to 4.<br>
</div>
</span></font></div>
</body>
</html>