[libfabric-users] FI_REMOTE_CQ_DATA & RMA
wzam at amazon.com
Mon Sep 26 08:14:19 PDT 2022
The following is the prototype of fi_write:
ssize_t fi_write(struct fid_ep *ep, const void *buf, size_t len,
void *desc, fi_addr_t dest_addr, uint64_t addr, uint64_t key,
dest_addr is the remote endpoint address.
For connection less endpoints (like rdm), the way you get dest_address is:
First, call fi_getname() on the remote endpoint, to get raw address
Second, somehow transfer the raw address of remote endpoint to local process.
Finally, the local process call fi_av_insert() to insert raw address to address vector, this call will return the dest_address.
On 9/26/22, 7:43 AM, "QUENTIN BOYER" <quentin.boyer at atos.net> wrote:
CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe.
I don't really see which is the parameter that controls this for
connection-less endpoints, the destination address ?
On 26/09/2022 16:34, Zhang, Wei wrote:
> Caution: External email. Do not open attachments or click links, unless this email comes from a known sender and you know the content is safe.
> When you can fi_write, you need to specify which end point you are targeting to (alongside with memory address).
> So only the target endpoint will generate completion.
> On 9/26/22, 6:23 AM, "Libfabric-users on behalf of QUENTIN BOYER via Libfabric-users" <libfabric-users-bounces at lists.openfabrics.org on behalf of libfabric-users at lists.openfabrics.org> wrote:
> CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe.
> There is an interaction I don't quite understand. If a provider does
> *not* have FI_MR_ENDPOINT the memory regions are bound to domains. But
> when the are target with a RMA write that provides cq data with
> FI_REMOTE_CQ_DATA where should the completion be generated ? because
> there may be one, zero, or many endpoints associated with this domain.
> Or is this flag only applicable with FI_MR_ENDPOINT ?
> Quentin Boyer
> Libfabric-users mailing list
> Libfabric-users at lists.openfabrics.org
More information about the Libfabric-users