[libfabric-users] Verbs send message slow down

Ilango, Arun arun.ilango at intel.com
Tue Mar 21 12:26:03 PDT 2017


Hi Supun,

I tried to reproduce the issue but I'm not hitting it. I have modified fabtests bandwidth test to read multiple completions (=window_size) at a time on the receive side. I have the patch on the following branch:
https://github.com/a-ilango/fabtests/tree/comp_debug

I'm using fi_cq_read. Please try out fi_msg_bw and see if you get the issue. 

Thanks,
Arun.

-----Original Message-----
From: Libfabric-users [mailto:libfabric-users-bounces at lists.openfabrics.org] On Behalf Of Ilango, Arun
Sent: Tuesday, March 21, 2017 11:07 AM
To: Hefty, Sean <sean.hefty at intel.com>; Supun Kamburugamuve <skamburugamuve at gmail.com>
Cc: libfabric-users at lists.openfabrics.org
Subject: Re: [libfabric-users] Verbs send message slow down

This might need some debugging. In the verbs provider, we call ibv_poll_cq with num_entries set to 1 and repeatedly call it when the app has requested multiple completions. I'm not sure if this is the issue but let me check.

-Arun.

-----Original Message-----
From: Libfabric-users [mailto:libfabric-users-bounces at lists.openfabrics.org] On Behalf Of Hefty, Sean
Sent: Tuesday, March 21, 2017 10:53 AM
To: Supun Kamburugamuve <skamburugamuve at gmail.com>
Cc: libfabric-users at lists.openfabrics.org
Subject: Re: [libfabric-users] Verbs send message slow down

> I found a workaround to the problem. Previously I was doing cq_read 
> for multiple completions. If I do cq_read for a single completion the 
> problem goes away. Is this the expected behavior or something wrong 
> with my program or a bug in libfabric?

This is not expected behavior.  Something else is going goofy here.
_______________________________________________
Libfabric-users mailing list
Libfabric-users at lists.openfabrics.org
http://lists.openfabrics.org/mailman/listinfo/libfabric-users
_______________________________________________
Libfabric-users mailing list
Libfabric-users at lists.openfabrics.org
http://lists.openfabrics.org/mailman/listinfo/libfabric-users


More information about the Libfabric-users mailing list