[libfabric-users] Libfabric : Facing issues with FI_VERSION(1, 5) in fi_getinfo()

[Ilango, Arun]

Subhadeep,

I don't see anything unusual in the debug logs for fi_info output. It  The other logs didn't contain any debug output but that shouldn't matter.

Btw, are you using libfabric v1.5.0? You might want to get an updated version: v1.6.1 (https://github.com/ofiwg/libfabric/releases/tag/v1.6.1)

I believe v1.5.0 was probably not handling a NULL value for node and service correctly.

Thanks,
Arun.

From: Subhadeep Bhattacharya [mailto:sb17v at my.fsu.edu]
Sent: Monday, May 14, 2018 1:23 PM
To: Ilango, Arun <arun.ilango at intel.com>
Cc: libfabric-users at lists.openfabrics.org
Subject: RE: [libfabric-users] Libfabric : Facing issues with FI_VERSION(1, 5) in fi_getinfo()

Hi Arun,

I have built Libfabric with -enable-debug configuration option and set FI_LOG_LEVEL env variable as debug. Please find the attached log and output from fi_info -v output.

Thanks,
Subhadeep

From: Ilango, Arun [mailto:arun.ilango at intel.com]
Sent: Monday, May 14, 2018 1:35 PM
To: Subhadeep Bhattacharya <sb17v at my.fsu.edu<mailto:sb17v at my.fsu.edu>>; libfabric-users at lists.openfabrics.org<mailto:libfabric-users at lists.openfabrics.org>
Subject: RE: [libfabric-users] Libfabric : Facing issues with FI_VERSION(1, 5) in fi_getinfo()

Subhadeep,

I don't see any debug level logs. Did you set the correct level in FI_LOG_LEVEL env variable? Also you would have to build libfabric with --enable-debug configure option.

Can you also try running fi_info -v to see if you get all the interfaces?

Thanks,
Arun.

From: Subhadeep Bhattacharya [mailto:sb17v at my.fsu.edu]
Sent: Monday, May 14, 2018 9:42 AM
To: Ilango, Arun <arun.ilango at intel.com<mailto:arun.ilango at intel.com>>; libfabric-users at lists.openfabrics.org<mailto:libfabric-users at lists.openfabrics.org>
Subject: RE: [libfabric-users] Libfabric : Facing issues with FI_VERSION(1, 5) in fi_getinfo()

Hi Arun,

Please find the attached debug level logs.


Thanks,
Subhadeep

From: Ilango, Arun [mailto:arun.ilango at intel.com]
Sent: Monday, May 14, 2018 12:29 PM
To: Subhadeep Bhattacharya <sb17v at my.fsu.edu<mailto:sb17v at my.fsu.edu>>; libfabric-users at lists.openfabrics.org<mailto:libfabric-users at lists.openfabrics.org>
Subject: RE: [libfabric-users] Libfabric : Facing issues with FI_VERSION(1, 5) in fi_getinfo()

Subhadeep,

For scenario in 1, verbs;ofi_rxm should return fi_info for all available interfaces. Can you check if the provider is returning just the fi_info for localhost or is it returning other fi_info in the list as well? If you can share the debug level logs, I can take a look.

2) ofi_rxm doesn't have atomics support yet but it has read and write functionality. Can you try just setting FI_WRITE and FI_READ in hints->caps?

Thanks,
Arun.

From: Libfabric-users [mailto:libfabric-users-bounces at lists.openfabrics.org] On Behalf Of Subhadeep Bhattacharya
Sent: Monday, May 14, 2018 8:23 AM
To: libfabric-users at lists.openfabrics.org<mailto:libfabric-users at lists.openfabrics.org>
Subject: [libfabric-users] Libfabric : Facing issues with FI_VERSION(1, 5) in fi_getinfo()

Hi,

I have few questions regarding the usage of verbs;ofi_rxm provider.
1)      We have latest OFED driver installed in our cluster and it have mlx5_0. The inet address for infiniband is set to 10.10.16.2 for node 2. However, if I put node and service as NULL and flag as 0 while querying the fi_getinfo, it is fetching the localhost address(127.0.0.1) instead of ib0(10.10.16.2). Can you please let us know how to solve this issue.


2)      I am trying to get read, write and atomics functionality. I can see in the manual that verbs support FI_ATOMIC but ofi_rxm does not support it. Do I need to use both FI_EP_RDM and FI_EP_MSG as endpoint types with verbs;ofi_rxm to enable atomics along with read and write.


We are trying to get read, write and atomics functionality using verbs;ofi_rxm provider of Libfabric. Can you please let us know, which options are necessary to set in hints before passing it to fi_getinfo.


Thanks and Regards,
Subhadeep

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/libfabric-users/attachments/20180514/71aac5bd/attachment.html>