[openib-general] question on QoS support
Makia Minich
minich at ornl.gov
Thu Nov 2 06:15:17 PST 2006
Hal Rosenstock wrote:
> Makia,
>
> On Wed, 2006-11-01 at 17:42, Makia Minich wrote:
>> It just so happens that we've started looking at this here at ORNL as
>> well. I had a question about the options. The manpage makes it seem
>> that you can set these qos options (e.g. qos_high_limit) from the
>> command line, but I haven't been overly successful.
>
> What are you referring to in the man page ?
OK, re-reading the man page section on qos, I now realize that I didn't
understand the statement "cached options file" on my initial read
through. So, now I've got it.
> Which OpenSM are you using (trunk or 1.1 based) ?
1.1 based
>> Is there an example of this being done?
>
> Yes in both the man page under QOS CONFIGURATION or under
> osm/doc/qos-config.txt in the repository.
I see that that file doesn't install in the doc directory with OFED,
perhaps that should be added (so that I can find it in the ${OFED}/doc
directory).
>> Or is changing the /var/cache/osm/opensm.opts file
>> the preferred method of changing the options?
>
> I think it's the only way but it is imperative QoS is enabled for this
> to have any effect.
>
> -- Hal
That part I've got set in the opensm.opts file:
no_qos FALSE
>> Sasha Khapyorsky wrote:
>>> On 16:52 Wed 01 Nov , Oliver wrote:
>>>> Hi, folks -
>>>>
>>>> I am trying to verify and evaluate IB QoS support, running openSM as
>>>> subnet manager. The perftest program is extended to set SL as command
>>>> line options instead of default 0, and by modifying VL arbitration
>>>> tables, I am expecting to see the traffic shaping can actually take
>>>> place, but it did not. More details on configuration:
>>>>
>>>> in opensm.opts:
>>>> # QoS default options
>>>> qos_high_limit 255 # disable low priority table
>>>> qos_vlarb_high: 0:4,1:4,2:8,3:0, 4:0 .... # this is to give VL 2
>>>> (corresponding to SL 2) a higher weight 8
>>>> qos_sl2vl 0,1,2,3,4, ... # no changes here
>>>>
>>>> I think (though not verified) the Voltaire HCA we are using can
>>>> support 8 data VLs. I don't have much more information to go on why
>>>> qos shaping is not taking place, any suggestions?
>>> You can verify actual port's parameters with smpquery (from diags), you
>>> will need to run to get QoS related parameters:
>>>
>>> smpquery portinfo ...
>>> smpquery vlarb ...
>>> smpquery sl2vl ...
>>>
>>> Sasha
>>>
>>>> A related question is, if I modify qos setting in SM, do I need to
>>>> restart SA on each hosts for it to see the changes? (I am hoping not,
>>>> as I tried in the test, it doesn't seem to make a difference)
>>>>
>>>> Thanks for help.
>>>> --
>>>> Oliver
>>>>
>>>> _______________________________________________
>>>> openib-general mailing list
>>>> openib-general at openib.org
>>>> http://openib.org/mailman/listinfo/openib-general
>>>>
>>>> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
>>>>
>>> _______________________________________________
>>> openib-general mailing list
>>> openib-general at openib.org
>>> http://openib.org/mailman/listinfo/openib-general
>>>
>>> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
>>>
>>>
>
>
--
Makia Minich <minich at ornl.gov>
National Center for Computation Science
Oak Ridge National Laboratory
Phone: 865.574.7460
More information about the general
mailing list