[libfabric-users] Libfabric : Facing issues with FI_VERSION(1, 5) in fi_getinfo()

Subhadeep Bhattacharya sb17v at my.fsu.edu
Mon May 14 13:23:02 PDT 2018


Hi Arun,

I have built Libfabric with -enable-debug configuration option and set FI_LOG_LEVEL env variable as debug. Please find the attached log and output from fi_info -v output.

Thanks,
Subhadeep

From: Ilango, Arun [mailto:arun.ilango at intel.com]
Sent: Monday, May 14, 2018 1:35 PM
To: Subhadeep Bhattacharya <sb17v at my.fsu.edu>; libfabric-users at lists.openfabrics.org
Subject: RE: [libfabric-users] Libfabric : Facing issues with FI_VERSION(1, 5) in fi_getinfo()

Subhadeep,

I don't see any debug level logs. Did you set the correct level in FI_LOG_LEVEL env variable? Also you would have to build libfabric with --enable-debug configure option.

Can you also try running fi_info -v to see if you get all the interfaces?

Thanks,
Arun.

From: Subhadeep Bhattacharya [mailto:sb17v at my.fsu.edu]
Sent: Monday, May 14, 2018 9:42 AM
To: Ilango, Arun <arun.ilango at intel.com<mailto:arun.ilango at intel.com>>; libfabric-users at lists.openfabrics.org<mailto:libfabric-users at lists.openfabrics.org>
Subject: RE: [libfabric-users] Libfabric : Facing issues with FI_VERSION(1, 5) in fi_getinfo()

Hi Arun,

Please find the attached debug level logs.


Thanks,
Subhadeep

From: Ilango, Arun [mailto:arun.ilango at intel.com]
Sent: Monday, May 14, 2018 12:29 PM
To: Subhadeep Bhattacharya <sb17v at my.fsu.edu<mailto:sb17v at my.fsu.edu>>; libfabric-users at lists.openfabrics.org<mailto:libfabric-users at lists.openfabrics.org>
Subject: RE: [libfabric-users] Libfabric : Facing issues with FI_VERSION(1, 5) in fi_getinfo()

Subhadeep,

For scenario in 1, verbs;ofi_rxm should return fi_info for all available interfaces. Can you check if the provider is returning just the fi_info for localhost or is it returning other fi_info in the list as well? If you can share the debug level logs, I can take a look.

2) ofi_rxm doesn't have atomics support yet but it has read and write functionality. Can you try just setting FI_WRITE and FI_READ in hints->caps?

Thanks,
Arun.

From: Libfabric-users [mailto:libfabric-users-bounces at lists.openfabrics.org] On Behalf Of Subhadeep Bhattacharya
Sent: Monday, May 14, 2018 8:23 AM
To: libfabric-users at lists.openfabrics.org<mailto:libfabric-users at lists.openfabrics.org>
Subject: [libfabric-users] Libfabric : Facing issues with FI_VERSION(1, 5) in fi_getinfo()

Hi,

I have few questions regarding the usage of verbs;ofi_rxm provider.

  1.  We have latest OFED driver installed in our cluster and it have mlx5_0. The inet address for infiniband is set to 10.10.16.2 for node 2. However, if I put node and service as NULL and flag as 0 while querying the fi_getinfo, it is fetching the localhost address(127.0.0.1) instead of ib0(10.10.16.2). Can you please let us know how to solve this issue.



  1.  I am trying to get read, write and atomics functionality. I can see in the manual that verbs support FI_ATOMIC but ofi_rxm does not support it. Do I need to use both FI_EP_RDM and FI_EP_MSG as endpoint types with verbs;ofi_rxm to enable atomics along with read and write.


We are trying to get read, write and atomics functionality using verbs;ofi_rxm provider of Libfabric. Can you please let us know, which options are necessary to set in hints before passing it to fi_getinfo.


Thanks and Regards,
Subhadeep

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/libfabric-users/attachments/20180514/ec9355fe/attachment.html>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: fi_info-v.txt
URL: <http://lists.openfabrics.org/pipermail/libfabric-users/attachments/20180514/ec9355fe/attachment.txt>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: Debug_log.txt
URL: <http://lists.openfabrics.org/pipermail/libfabric-users/attachments/20180514/ec9355fe/attachment-0001.txt>


More information about the Libfabric-users mailing list