[openib-general] openMPI for 2.6.17.10 kernel

Steve Wise swise at opengridcomputing.com
Fri Dec 1 06:40:00 PST 2006


On Thu, 2006-11-30 at 20:57 -0800, Matt Leininger wrote:
> On Thu, 2006-11-30 at 12:30 -0600, Steve Wise wrote:
> > On Thu, 2006-11-30 at 12:12 -0500, Jeff Squyres wrote:
> > > It just clicked in my brain as to why you were asking this question.
> > > 
> > > Remember that OMPI currently does not use any CM for OF connections  
> > > at all.  So it's not like it's using the old CM that doesn't support  
> > > iWARP.  OMPI uses its own out-of-band mechanism, which, as I  
> > > understand it, should work with iWARP just as well as it works for IB.
> > > 
> > > Am I incorrect in thinking that?  (I have no iWARP hardware to test  
> > > with)
> > 
> > iWARP _requires_ the RDMA-CM for connection setup...
> > 
> > So OMPI as it stands today won't work over iwarp devices.
> > 
> > Right now, the only non-uDAPL MPI solution that will work with the iwarp
> > stable svn branch + 2.6.17 RNFS is MVAPICH2.
> > 
> > If you utilize uDAPL, then Intel and HP have MPI libs that might work...
> 
>   OMPI also has a uDAPL network device (along with a device that uses
> verbs directly).  So if we just use OMPI uDAPL it should work over
> iWarp?
> 

It should.  You might have to tweak OMPI slightly to work with uDAPL
from the iWARP branch.  Or take the latest uDAPL and back-port it to the
iwarp branch. 

Steve.






More information about the general mailing list