[ofa-general] opensm --lcm

Sasha Khapyorsky sashak at voltaire.com
Mon Nov 12 12:36:38 PST 2007


On 12:14 Mon 12 Nov     , Hal Rosenstock wrote:
> On Mon, 2007-11-12 at 22:21 +0200, Sasha Khapyorsky wrote:
> > Hi,
> > 
> > On 19:13 Mon 12 Nov     , Bernd Schubert wrote:
> > > 
> > > so far we always did run opensm without the --lmc option, but just recently I 
> > > read in opensm's manpage about it.
> > > 
> > > <opensm manpage>
> > > This option specifies the subnet's LMC value.  The number of LIDs assigned to 
> > > each port  is  2^LMC.   
> > > The LMC  value  must be in the range 0-7.  LMC values > 0 allow multiple paths 
> > > between ports.  LMC values > 0 should only be used if the subnet topology 
> > > actually provides multiple paths between ports, i.e.  multiple
> > > interconnects  between  switches.   Without -l, OpenSM defaults to LMC = 0, 
> > > which allows one path between any two ports.
> > > </opensm manpage>
> > > 
> > > In one of our configurations we do have a mts2400 (master) switch and 
> > > connected to it are two mts14400 switches (each with 3 connections to the the 
> > > mts2400).
> > > I think from the description of the opensm manpage we need to give the "--lmc" 
> > > to make use of the 3 connections from each mts14400 switch to the mts2400 
> > > switch, don't we?
> > 
> > In theory (AFAIR by default OpenSM will not assign LMC for Switch port 0
> 
> Non 0 LMC is only valid (per spec) for enhanced SP0. LMC must be 0 for
> base SP0.

Of course, this is too. But also it doesn't work for enhanced SP0 with
current switches.

Sasha

> > due to some chip bug), when target is switch itself. But if you have
> > end nodes connected to this switch and targets are end nodes when OpenSM
> > will try to use all links for it.
> > 
> > > Furthermore, from manpage I would think we even need this 
> > > option for proper inter-communication between the switch modules?
> > 
> > For switch modules yes, but again OpenSM will not assign LMC for
> > switches (even then --lmc specified), only for end nodes. In order to
> > enable it you will need to turn on 'lmc_esp0' option in OpenSM options
> > file. But as far as I remember it is not supported by switches now.
> 
> It didn't work last time I tried it and I don't think it's been fixed.
> 
> -- Hal
> 
> > Sasha
> > _______________________________________________
> > general mailing list
> > general at lists.openfabrics.org
> > http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
> > 
> > To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general



More information about the general mailing list