[libfabric-users] troubled by FI_SOURCE use

[Biddiscombe, John A.]

Just a follow up question - I was busy with other items and didn't really chase up on investigating the RXM and RXD providers.
As utility providers, is there a matrix (like the very useful feature matrix) that says which hardware providers they are compatible with?
For example, if I want to use RXD on top of verbs or RXM on top of verbs, or on top of sockets, tcp, udp - how do I know which ones are possible?

I suppose I should assume that 
* if the core provider supports MSG endpoint then RXM can run on it - NB the fi_provider man page mentions RXM, but doesn't really include RXD in the utility providers list but discusses it later).
* if the core provider supports DGRAM endpoint then RXD can run on it.

So If I need RDM endpoint type for GNI/Sockets/Verbs I can use GNI/rxd+udp/rxm+verbs for the 3 configurations?

On an unrelated note. I was testing the libfabric (gni) code on our cray and doing random messages between nodes and got 6.2TB/s aggregated between 4096 nodes. Still some tuning to do to reach max, but I'm very impressed. Well done to all of the libfabric developers and thank you for making our lives easier.

JB

-----Original Message-----
From: Libfabric-users <libfabric-users-bounces at lists.openfabrics.org> On Behalf Of Biddiscombe, John A.
Sent: 14 March 2019 19:15
To: Hefty, Sean <sean.hefty at intel.com>; libfabric-users at lists.openfabrics.org
Subject: Re: [libfabric-users] troubled by FI_SOURCE use

Sean

>Verbs only supports MSG and DGRAM EPs.  So far, the primary target has been MSG EPs, which doesn't use FI_SOURCE.

oops. I completely forgot to check the endpoint types. I guess I won't be deleting the old MSG code after all. I hoped to get rid of a ton of stuff.

>The util providers, rxm and rxd, both support FI_SOURCE, if you're using RDM EPs.

I don't know what they are, so I'd better look into it.

Thanks for warning me about the RDM support being absent.

JB 
_______________________________________________
Libfabric-users mailing list
Libfabric-users at lists.openfabrics.org
https://lists.openfabrics.org/mailman/listinfo/libfabric-users