[libfabric-users] Progress question

[Hefty, Sean]

> Is there a right way to handle this (I guess I need a flush operation of some kind, but
> I'm not sure where to put it).

For fabtests, we handle this sort of situation by adding a 'finalize' step at the end of all tests.  Fabtests is easier, since most are client-server based.  But the finalize step sends a message to the peer using FI_TRANSMIT_COMPLETE and waiting for the send completion.  Prior to adding a finalize step, we would see a similar issue where sends would never be received.  This shows up fairly easily when using socket based providers, with the sends being buffered in the kernel.

- Sean