[openib-general] openMPI for 2.6.17.10 kernel

[Steve Wise]

On Thu, 2006-11-30 at 15:03 -0500, Jeff Squyres wrote:
> On Nov 30, 2006, at 2:58 PM, Steve Wise wrote:
> 
> >> 	// initiatior
> >> 	ibv_create_qp(...);
> >> 	ibv_modify_qp(...);// set pkey, port num, etc.
> >> 	send_via_oob_channel(lid, mtu, my_port_num, ...other info...);
> >> 	wait_for_oob_reply(...);
> >> 	ibv_modify_qp(...);//set mtu, lid, remote_port #, etc.
> >>
> >> Are you telling me that the *ONLY* way to make QPs over iWARP
> >> connections is to use the RDMA CM, and it is not possible to work
> >> using a scheme like i listed above (passing relevant info via OOB
> >> channels)?
> >
> > Yup.
> 
> Then why did Tom Tucker tell me otherwise last week?  Hrm.  Tom --  
> did I not explain our current scheme well last week?
> 

There must have been some mis-communication.

> >> If so, I'm curious: what magic is the RDMA CM doing such
> >> that this is necessary?
> >
> > Setting up an TCP connection and negotiating RDMA mode.
> 
> Are you telling me that ibv_create_qp() and ibv_modify_qp() don't  
> actually make a connection?
> 

Yes.  The QP is created with ibv_create_qp().  The TCP connection is
setup and bound to the QP via rdma_connect() or
rdma_listen()/rdma_accept().


Steve.