[ofa-general] qos on service-id

[Céline Bourde]

Hi,

I'm trying to configure qos-policy.donc file for service-id use.
I've tried basic RDMA_PS_TCP service-id level with service id 0x0106

[]# cat /etc/opensm/qos-policy.conf
qos-levels
       qos-level
       name: DEFAULT
       sl: 0
       end-qos-level
       qos-level
           name: TCP
           sl: 4
       end-qos-level
         qos-level
            name: MPI
            sl: 5
        end-qos-level
end-qos-levels

qos-ulps
   default                       : 0 # default SL
   any, service-id 0x0000000001060000- 0x000000000106FFFF : 4
end-qos-ulps

I add this rule in my configuration and check by mapping
sl 4 on a vl with a weight of 0

# QoS default options
qos_max_vls 8
qos_high_limit 1
qos_vlarb_high 0:1,1:0,2:0,3:0,4:0
qos_vlarb_low 0:1,1:2,2:4,3:8,4:0,5:32
qos_sl2vl 0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15

I've launched qperf on the server side
and listen on client:

j=100; for i in $(seq 0 $j) ; do /usr/bin/qperf -ri mlx4_0:1 -li mlx4_0:1
10.12.1.4 -sl 4 -lp 20004 rc_bw; done;
rc_bw:
   bw  =  0 bytes/sec
rc_bw:
   bw  =  0 bytes/sec

j=100; for i in $(seq 0 $j) ; do /usr/bin/qperf -ri mlx4_0:1 -li mlx4_0:1
10.12.1.4 -sl 5 -lp 20005 rc_bw; done;
rc_bw:
   bw  =  3.37 GB/sec
rc_bw:
   bw  =  3.37 GB/sec

Qperf gives me results I expected due to qos-level configuration part, 
but no
expected results using qperf tcp_bw, bandwith is not
filtered/blocked by sl weight.

# j=100; for i in $(seq 0 $j) ; do /usr/bin/qperf 10.12.1.4 tcp_bw; done;
tcp_bw:
   bw  =  923 MB/sec
tcp_bw:
   bw  =  935 MB/sec

j=100; for i in $(seq 0 $j) ; do /usr/bin/qperf -ri mlx4_0:1 -li mlx4_0:1
10.12.1.4 -sl 5 -lp 20005 rc_bw; done;
rc_bw:
   bw  =  2.23 GB/sec
rc_bw:
   bw  =  2.24 GB/sec
rc_bw:
   bw  =  2.21 GB/sec

Could you help me to understanding service-id mechanism or give me a 
relevant
test to test TCP service id level ?

Thanks.

Céline Bourde.