[openib-general] Local SA caching - why we need it

[Arlin Davis]

Or Gerlitz wrote:

>What need to be done now is to share/review the ***Intel MPI*** conn
>establishment design. The developers has to come and say ***how*** do
>they execute this all-to-all connection establishment on the job
>start, and why they think this is the optimal way to go (first, not a
>connection establishement on demand model, second why the
>establishment pattern they use is optimal). Same for the Open MPI
>developers, who (Galen, Jeff) also mentioned in the devcon that
>consider to go for using the RDMA CM for connection establishment and
>think there are issues with SA/CM scalability.
>  
>
I disagree. How these applications establish connections is not the 
issue. The issue is that IB requires path records and currently there is 
one centralized service that provides this information. Lets flip the 
request.....someone tell us how they will provide non-centralize path 
record services that will scale out with applications requiring 
all-to-all communications from 1000's nodes.

-arlin