[libfabric-users] fi_read completion event (Biddiscombe, John A.)

Biddiscombe, John A. biddisco at cscs.ch
Fri Mar 10 10:57:55 PST 2017

I gave up with verbs and moved the cray (which I need more urgently). I’m using the GNI provider now with endpoint type RDM

(The connectionless model is fabulous – so much less code now handling connection setup).

Still no completions though. Trying to work on a train with dodgy wifi, so not making much progress. 

Do I need to set  (waiting to test this)
           fabric_hints_->tx_attr->op_flags = FI_COMPLETION;
           fabric_hints_->rx_attr->op_flags = FI_COMPLETION;
can’t test it yet due to ssh dropouts

I tried adding READ/WRITE to these flags, but that causes an error abiout unsupported mode or type or something.
                ret = fi_ep_bind(*new_endpoint, &txcq->fid, FI_TRANSMIT/* | FI_READ | FI_WRITE*/);

So I guess that’s a red herring. I will keep experimenting


On 10.03.17, 19:46, "Hefty, Sean" <sean.hefty at intel.com> wrote:

    > Is there something else I need to look out for? I can confirm that I
    > get recv/send completions and all is fine, but nothing for fi_read.
    I spent a few minutes looking through the code here:
    I checked the calls to getinfo, ep_bind, cq_open, fi_read, cq_read, etc.  Nothing that I saw stood out as an obvious issue.  :/  Even if the read failed, you should still get some sort of completion, with fi_cq_read returning -FI_EAVAIL.
    I'm assuming that you're using the verbs provider with FI_MSG endpoints.

More information about the Libfabric-users mailing list