[openib-general] openMPI for 2.6.17.10 kernel

[Chen, Helen Y]

Steve,

As you know, I have my rnfs kernel running the stable iwarp-stack on my cluster now.  But how do I compile the userspace packages from that stack?  

Thanks,
Helen

-----Original Message-----
From: Steve Wise [mailto:swise at opengridcomputing.com]
Sent: Thu 11/30/2006 1:10 PM
To: Jeff Squyres
Cc: Chen, Helen Y; openib-general at openib.org; Leininger, Matthew L
Subject: Re: [openib-general] openMPI for 2.6.17.10 kernel
 
On Thu, 2006-11-30 at 15:03 -0500, Jeff Squyres wrote:
> On Nov 30, 2006, at 2:58 PM, Steve Wise wrote:
> 
> >> 	// initiatior
> >> 	ibv_create_qp(...);
> >> 	ibv_modify_qp(...);// set pkey, port num, etc.
> >> 	send_via_oob_channel(lid, mtu, my_port_num, ...other info...);
> >> 	wait_for_oob_reply(...);
> >> 	ibv_modify_qp(...);//set mtu, lid, remote_port #, etc.
> >>
> >> Are you telling me that the *ONLY* way to make QPs over iWARP
> >> connections is to use the RDMA CM, and it is not possible to work
> >> using a scheme like i listed above (passing relevant info via OOB
> >> channels)?
> >
> > Yup.
> 
> Then why did Tom Tucker tell me otherwise last week?  Hrm.  Tom --  
> did I not explain our current scheme well last week?
> 

There must have been some mis-communication.

> >> If so, I'm curious: what magic is the RDMA CM doing such
> >> that this is necessary?
> >
> > Setting up an TCP connection and negotiating RDMA mode.
> 
> Are you telling me that ibv_create_qp() and ibv_modify_qp() don't  
> actually make a connection?
> 

Yes.  The QP is created with ibv_create_qp().  The TCP connection is
setup and bound to the QP via rdma_connect() or
rdma_listen()/rdma_accept().


Steve.


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20061130/caedeebf/attachment.html>