[ofiwg] libfabric fi_getinfo question

[Ilango, Arun]

Hi Vasiliy,

The verbs provider uses rdma_cm internally for setup and establishing connections. I believe rdma_cm needs IPoIB to be functional to resolve hostnames to IB addresses.

Does your setup not have IPoIB?

By the way, hints->addr_format corresponds to the addresses specified in hints->src_addr and hints->dest_addr.

Thanks,
Arun.

-----Original Message-----
From: ofiwg-bounces at lists.openfabrics.org [mailto:ofiwg-bounces at lists.openfabrics.org] On Behalf Of Jose, Jithin
Sent: Thursday, July 16, 2015 12:48 PM
To: Vasiliy Tolstov
Cc: ofiwg
Subject: Re: [ofiwg] libfabric fi_getinfo question

Vasiliy ,

The verbs provider internally calls rdma_getaddrinfo(), and I am guessing that is failing in your setup.

- Jithin




-----Original Message-----
From: <vase at selfip.ru> on behalf of Vasiliy Tolstov <v.tolstov at selfip.ru>
Date: Thursday, July 16, 2015 at 11:40 AM
To: Jithin Jose <jithin.jose at intel.com>
Cc: ofiwg <ofiwg at lists.openfabrics.org>
Subject: Re: [ofiwg] libfabric fi_getinfo question

>
>16 июля 2015 г. 20:54 пользователь "Jose, Jithin" 
><jithin.jose at intel.com>
>написал:
>>
>> Hi Vasiliy,
>>
>> The example looks fine, and the verbs provider should be able to give 
>> valid output for fi_getinfo.
>> In fact, we tried this example with verbs provider and it gave valid 
>> fi_info.
>> So, could the failure be because the node name is not resolvable or 
>> something?
>> If the issue still exists, we can create an issue in github as Dave 
>> mentioned.
>>
>>
>> One anomaly we noticed is that verbs provider currently returns with 
>> FI_SOCKADDR_IN address format, even though the requested format is 
>> different.
>> But, this should not result in returning -FI_EINVAL.
>>
>> - Jithin
>>
>>
>
>I think in you test you have working Ethernet or ipoib network. But I 
>need pure rdma resolving.
>So as I see libfabric and rdma_cm writes something to /sys and fallback 
>to DNS requests via Ethernet,and with absence Ethernet exit with error.
>
>>
>>
>> -----Original Message-----
>> From: <ofiwg-bounces at lists.openfabrics.org> on behalf of Vasiliy 
>> Tolstov <v.tolstov at selfip.ru>
>> Date: Thursday, July 16, 2015 at 2:14 AM
>> To: ofiwg <ofiwg at lists.openfabrics.org>
>> Subject: [ofiwg] libfabric fi_getinfo question
>>
>> >Hello, i'm try to understand usage of libfabric and stuc at simple 
>> >example, it returns
>> >fi_getinfo(): info.c:34, ret=-22 (Invalid argument)
>> >
>> >i'm try to resolve local node address with hostname = 
>> >cn33.z1.mn2.simplecloud.ru <http://cn33.z1.mn2.simplecloud.ru> and
>>node_desc =
>cn33.z1.mn2.simplecloud.ru <http://cn33.z1.mn2.simplecloud.ru>
>> >
>> >P.S does it possible to resolve node address via libfabric that 
>> >entered in node_desc
>> 
>>>(/sys/devices/pci0000:00/0000:00:02.0/0000:02:00.0/infiniband/mlx4_0/
>>>nod
>>>e_
>> >desc)
>> >
>> >int main(int argc, char **argv) {
>> >        int ret;
>> >        hints = fi_allocinfo();
>> >        if (hints == NULL) {
>> >          fprintf(stderr, "%s\n", "failed to alloc info");
>> >          return -1;
>> >        }
>> >        hints->addr_format = FI_SOCKADDR_IB;
>> >        ret = fi_getinfo(FI_VERSION(1, 0), 
>> >"cn33.z1.mn2.simplecloud.ru <http://cn33.z1.mn2.simplecloud.ru>",
>>NULL, 0, hints, &fi);
>> >        if (ret < 0) {
>> >                FT_PRINTERR("fi_getinfo", ret);
>> >                return ret;
>> >        }
>> >        if (fi == NULL) {
>> >                fprintf(stderr, "%s\n", "failed to get info");
>> >                return -1;
>> >        }
>> >        for (rp = fi; rp != NULL; rp = rp->next) {
>> >                if (rp->addr_format == FI_SOCKADDR_IB) {
>> >                        addrlen = fi->dest_addrlen;
>> >                        remote_addr = malloc(addrlen);
>> >                        memcpy(remote_addr, fi->dest_addr, addrlen);
>> >                }
>> >        }
>> >        fi_freeinfo(fi);
>> >        return 0;
>> >}
>> >
>> >
>> >--
>> >Vasiliy Tolstov,
>> >e-mail: v.tolstov at selfip.ru
>> >_______________________________________________
>> >ofiwg mailing list
>> >ofiwg at lists.openfabrics.org
>> >http://lists.openfabrics.org/mailman/listinfo/ofiwg
>>
>

_______________________________________________
ofiwg mailing list
ofiwg at lists.openfabrics.org
http://lists.openfabrics.org/mailman/listinfo/ofiwg