On Mon, Nov 23, 2009 at 3:48 AM, Céline Bourde <[email protected]> wrote: > Hi, > > I'm trying to configure qos-policy.donc file for service-id use. > I've tried basic RDMA_PS_TCP service-id level with service id 0x0106 > > []# cat /etc/opensm/qos-policy.conf > qos-levels > qos-level > name: DEFAULT > sl: 0 > end-qos-level > qos-level > name: TCP > sl: 4 > end-qos-level > qos-level > name: MPI > sl: 5 > end-qos-level > end-qos-levels > > qos-ulps > default : 0 # default SL > any, service-id 0x0000000001060000- 0x000000000106FFFF : 4 > end-qos-ulps > > I add this rule in my configuration and check by mapping > sl 4 on a vl with a weight of 0 > > # QoS default options > qos_max_vls 8 > qos_high_limit 1 > qos_vlarb_high 0:1,1:0,2:0,3:0,4:0 > qos_vlarb_low 0:1,1:2,2:4,3:8,4:0,5:32 > qos_sl2vl 0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15 > > I've launched qperf on the server side > and listen on client: > > j=100; for i in $(seq 0 $j) ; do /usr/bin/qperf -ri mlx4_0:1 -li mlx4_0:1 > 10.12.1.4 -sl 4 -lp 20004 rc_bw; done; > rc_bw: > bw = 0 bytes/sec > rc_bw: > bw = 0 bytes/sec > > j=100; for i in $(seq 0 $j) ; do /usr/bin/qperf -ri mlx4_0:1 -li mlx4_0:1 > 10.12.1.4 -sl 5 -lp 20005 rc_bw; done; > rc_bw: > bw = 3.37 GB/sec > rc_bw: > bw = 3.37 GB/sec > > Qperf gives me results I expected due to qos-level configuration part, but > no > expected results using qperf tcp_bw, bandwith is not > filtered/blocked by sl weight. > > # j=100; for i in $(seq 0 $j) ; do /usr/bin/qperf 10.12.1.4 tcp_bw; done; > tcp_bw: > bw = 923 MB/sec > tcp_bw: > bw = 935 MB/sec > > j=100; for i in $(seq 0 $j) ; do /usr/bin/qperf -ri mlx4_0:1 -li mlx4_0:1 > 10.12.1.4 -sl 5 -lp 20005 rc_bw; done; > rc_bw: > bw = 2.23 GB/sec > rc_bw: > bw = 2.24 GB/sec > rc_bw: > bw = 2.21 GB/sec > > Could you help me to understanding service-id mechanism or give me a > relevant > test to test TCP service id level ?
A weight of 0 for a VL can still allow for packets to be sent when the arbiter has available "slots". To filter, the SL can be set to VL15 or some VL above the OperationalVLs. -- Hal > > Thanks. > > Céline Bourde. > > -- > To unsubscribe from this list: send the line "unsubscribe linux-rdma" in > the body of a message to [email protected] > More majordomo info at http://vger.kernel.org/majordomo-info.html > -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
