[openib-general] Dump and load routes with opensm?

[Hal Rosenstock]

On Thu, 2006-05-04 at 14:41, Greg Johnson wrote:
> On Thu, May 04, 2006 at 01:48:29PM -0400, Hal Rosenstock wrote:
> > On Thu, 2006-05-04 at 13:26, Greg Johnson wrote:
> > > On Thu, May 04, 2006 at 01:08:54PM -0400, Hal Rosenstock wrote:
> > > > On Thu, 2006-05-04 at 12:55, Greg Johnson wrote:
> > > > > I actually want routes.  
> > > > 
> > > > OpenSM calculates the unicast and multicast routes and populates the
> > > > (unicast and multicast) forwarding tables. 
> > > > 
> > > > > I have queried them with ibtraceroute and ibroute, 
> > > > 
> > > > ibroute dumps the forwarding tables and ibtracert traces the path from a
> > > > source to a destination so these are displaying how OpenSM has setup the
> > > > fabric which is a function of the routing algorithm chosen and the
> > > > physical topology (which may be dynamic).
> > > > 
> > > > > but we need routes for the whole fabric. 
> > > > 
> > > > Unicast, multicast, or both ? Just to look at ? There is no way to load
> > > > these into OpenSM.
> > > 
> > > At this point we are only interested in unicast routes.  We would like
> > > to be able to dump and load the forwarding tables.
> > 
> > You can dump them (via ibroute) just not load them.
> 
> Right.  I imagine a tool that would dump the routes to a file that could
> be reloaded later.  If I could edit the file, I could load my own
> routes as well.
> 
> > > We have a single 288 port switch chassis for our cluster.  We would like to be able to
> > > load routes for two reasons.  One is to be able to do testing with a
> > > fixed set of routes.
> > 
> > So the topology is fixed and no links ever fail ?
> 
> Yes, basically.  We want this for testing, not production (at this
> point).  We can handle faults manually for now.  The internal topology
> of the switch chassis is fixed.  
> 
> > > The other is that we would like to program our own
> > > routes into the switches.
> > 
> > Once the fabric is up, what are the requirements ? Do you need SA
> > queries (e.g. PathRecords) to work ?
> 
> I'm not sure if we need SA queries.  What are they good for?

Helping to set up connections, etc.

> Basically, we want to be able to run MPI over the IB fabric.  We don't need
> anything else.  I'm not sure if MVAPICH or OpenMPI use SA queries
> internally.

I don't think they do currently but will in the near term future. I'm
not sure whether MVAPICH supports multicast but that also would require
SA support.

-- Hal

> Greg