[openib-general] question on QoS support

Hal Rosenstock halr at voltaire.com
Thu Nov 2 06:42:57 PST 2006


On Thu, 2006-11-02 at 09:15, Makia Minich wrote:
> Hal Rosenstock wrote:
> > Makia,
> > 
> > On Wed, 2006-11-01 at 17:42, Makia Minich wrote:
> >> It just so happens that we've started looking at this here at ORNL as
> >> well.  I had a question about the options.  The manpage makes it seem
> >> that you can set these qos options (e.g. qos_high_limit) from the
> >> command line, but I haven't been overly successful.
> > 
> > What are you referring to in the man page ?
> 
> OK, re-reading the man page section on qos, I now realize that I didn't
> understand the statement "cached options file" on my initial read
> through.  So, now I've got it.
> 
> > Which OpenSM are you using (trunk or 1.1 based) ?
> 
> 1.1 based
> 
> >> Is there an example of this being done?
> > 
> > Yes in both the man page under QOS CONFIGURATION or under
> > osm/doc/qos-config.txt in the repository.
> 
> I see that that file doesn't install in the doc directory with OFED,
> perhaps that should be added (so that I can find it in the ${OFED}/doc
> directory).

I used that doc and put it pretty much verbatim into the man page so IMO
this is somewhat redundant but it could be added to the next release if
you think this adds value (having the separate docs).

-- Hal

> >>   Or is changing the /var/cache/osm/opensm.opts file
> >> the preferred method of changing the options?
> > 
> > I think it's the only way but it is imperative QoS is enabled for this
> > to have any effect.
> > 
> > -- Hal
> 
> That part I've got set in the opensm.opts file:
> 
> no_qos FALSE
> 
> >> Sasha Khapyorsky wrote:
> >>> On 16:52 Wed 01 Nov     , Oliver wrote:
> >>>> Hi, folks -
> >>>>
> >>>> I am trying to verify and evaluate IB QoS support, running openSM as
> >>>> subnet manager. The perftest program is extended to set SL as command
> >>>> line options instead of default 0, and by modifying VL arbitration
> >>>> tables, I am expecting to see the traffic shaping can actually take
> >>>> place, but it did not.  More details on configuration:
> >>>>
> >>>> in opensm.opts:
> >>>> # QoS default options
> >>>> qos_high_limit 255 # disable low priority table
> >>>> qos_vlarb_high: 0:4,1:4,2:8,3:0, 4:0 .... # this is to give VL 2
> >>>> (corresponding to SL 2) a higher weight 8
> >>>> qos_sl2vl 0,1,2,3,4, ... # no changes here
> >>>>
> >>>> I think (though not verified) the Voltaire HCA we are using can
> >>>> support 8 data VLs. I don't have much more information to go on why
> >>>> qos shaping is not taking place, any suggestions?
> >>> You can verify actual port's parameters with smpquery (from diags), you
> >>> will need to run to get QoS related parameters:
> >>>
> >>>   smpquery portinfo ...
> >>>   smpquery vlarb ...
> >>>   smpquery sl2vl ...
> >>>
> >>> Sasha
> >>>
> >>>> A related question is, if I modify qos setting in SM, do I need to
> >>>> restart SA on each hosts for it to see the changes? (I am hoping not,
> >>>> as I tried in the test, it doesn't seem to make a difference)
> >>>>
> >>>> Thanks for help.
> >>>> -- 
> >>>> Oliver
> >>>>
> >>>> _______________________________________________
> >>>> openib-general mailing list
> >>>> openib-general at openib.org
> >>>> http://openib.org/mailman/listinfo/openib-general
> >>>>
> >>>> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
> >>>>
> >>> _______________________________________________
> >>> openib-general mailing list
> >>> openib-general at openib.org
> >>> http://openib.org/mailman/listinfo/openib-general
> >>>
> >>> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
> >>>
> >>>
> > 
> > 





More information about the general mailing list