[libfabric-users] fi_cq_open fails on the verbs provider

[Jörn Schumacher]

Hi Arun,

that helped with the fi_cq_open call, thanks. I thought cq_attr.size = 0 
will let the provider choose a default value.

But then I get a (related?) problem a few lines later with fi_connect:

error: fi_connect failed: -263 'Missing or unavailable completion queue'


>   if(ret = fi_connect(socket->ep, socket->fi->dest_addr, NULL, 0)) {
>     ERROR("fi_connect failed: %d '%s'", ret, strerror(-ret));
>   }



Cheers,
Jörn


On 02/24/2016 07:30 PM, Ilango, Arun wrote:
> The fi_cq_open call is failing because the CQ size (cq_attr.size) is 0. Can you try it with a non-zero size?
>
> -----Original Message-----
> From: libfabric-users-bounces at lists.openfabrics.org [mailto:libfabric-users-bounces at lists.openfabrics.org] On Behalf Of Jörn Schumacher
> Sent: Wednesday, February 24, 2016 10:03 AM
> To: libfabric-users at lists.openfabrics.org
> Subject: [libfabric-users] fi_cq_open fails on the verbs provider
>
> Hi,
>
> I managed to setup a reliable connection using libfabric and the sockets provider. I use FI_WAIT_FD with epoll to manage completions. Now I am trying to run the code on the verbs provider, but it fails on the client side while creating a CQ:
>
>>    struct fi_cq_attr cq_attr;
>>    cq_attr.size = 0;      /* # entries for CQ */
>>    cq_attr.flags = 0;     /* operation flags */
>>    cq_attr.format = FI_CQ_FORMAT_CONTEXT;    /* completion format */
>>    cq_attr.wait_obj= FI_WAIT_FD;  /* requested wait object */
>>    cq_attr.signaling_vector = 0; /* interrupt affinity */
>>    cq_attr.wait_cond = FI_WAIT_NONE; /* wait condition format */
>>    cq_attr.wait_set = NULL;  /* optional wait set */
>>
>>    if(ret = fi_cq_open(socket->domain, &cq_attr, &socket->cq, NULL))
>>    {
>>      ERROR("fi_cq_open failed: %d '%s'", ret, fi_strerror(-ret));
>>    }
>
> fi_cq_open returns -22 ('Invalid argument'). The manpage of fi_verbs says FI_WAIT_FD is supported. FI_CQ_FORMAT_UNSPEC also did not help.
> What could be the source of this error?
>
> Here is the full code:
> https://gist.github.com/joerns/7833f418edb28e348d98#file-client-c-L83
>
> Thanks for any help,
> Jörn
> _______________________________________________
> Libfabric-users mailing list
> Libfabric-users at lists.openfabrics.org
> http://lists.openfabrics.org/mailman/listinfo/libfabric-users
>