[libfabric-users] completion at remote end of fi_read(msg)

[Biddiscombe, John A.]

Sean


OK thank. I suspect it wouldn't be doable - after all, which CQ would the remote read signal on - it's understandable that the end that initiates the read has a CQ that can signal a completion, but on the far end ...


I'll stick with my ack method for now (node A sends an ack to node B to sat, all rma complete)


The counter would be nice, except that I can only use it 'per endpoint' - if I could have a counter 'per context' then each rma read could use a different context and increment different counters. Never mind.


Thanks anyway


JB


________________________________
From: Hefty, Sean <sean.hefty at intel.com>
Sent: 23 March 2020 00:44:41
To: Biddiscombe, John A.; libfabric-users at lists.openfabrics.org
Subject: RE: completion at remote end of fi_read(msg)

> Is it possible to have a completion event on the remote end of an fi_read - by which I
> mean node A performs an fi_read from node B, and I'd like node B to have a completion
> when node A has received the data. I experimented with various CQ flags and selective
> completion things, but didn't manage to get a completion on node B.

This is not possible for most devices.

The capability (fi_info::caps) associated with this feature is FI_RMA_EVENT.  The API only defines support for target side events through completion counters.  See the fi_ep_bind() call to bind an ep with a counter using the FI_REMOTE_READ.

- Sean
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/libfabric-users/attachments/20200323/7ab66b06/attachment.htm>