[openib-general] IPoIB CM

Michael S. Tsirkin mst at mellanox.co.il
Wed Nov 29 22:53:32 PST 2006


> Michael S. Tsirkin wrote:
> > e. Some notes on code
> > 1. SRQ is used for scalability to large cluster sizes
> > 2. Only RC connections are used (UC does not support SRQ now)
> > 3. Retry count is set to 0 since spec draft warns against retries
> > 4. Each connection is used for data transfers in only 1 direction,
> >    so each connection is either active(TX) or passive (RX).
> >    2 sides that want to communicate create 2 connections.
> > 5. Each active (TX) connection has a separate CQ for send completions -
> >    this keeps the code simple without CQ resize and other tricks
> 
> Would you expect that the use of this code would likely result in creating 
> all-to-all connections between all nodes?  In particular, I'm thinking about MPI 
> applications that use all-to-all connections.  I realize this is done at the 
> RDMA layer, but is there anything that would end up connecting all of the nodes 
> via iopib?

Possibly - I don't really know.

-- 
MST




More information about the general mailing list