Hi, I might have misunderstood the usage of l3-src-only, but my goal is to have all packets from the same ip to end up on the same worker thread (queue) In my case I have trex running with 1core and only allowed to use 10.0.0.1 as src ip but I still get an even spread over the workers. Am I missing something in my config for this to work ? Or is it just not possible?
vpp v25.06-release
DPDK Config
dpdk {
no-multi-seg
enable-tcp-udp-checksum
dev 0000:06:00.0 {
name vppin
tso on
num-rx-queues 16
num-tx-queues 16
num-rx-desc 8192
num-tx-desc 4096
rss { ipv4-frag ipv4-tcp ipv4-udp ipv4-other l3-src-only }
}
dev 0000:05:00.0 {
name vppout
tso on
num-rx-queues 16
num-tx-queues 16
num-rx-desc 8192
num-tx-desc 4096
rss { ipv4-frag ipv4-tcp ipv4-udp ipv4-other l3-dst-only }
}
}
Queue
[email protected]:/home/jimmy# vppctl clear hardware-interfaces vppin
[email protected]:/home/jimmy# vppctl show hardware-interfaces vppin | grep
rx_q
rx_q0_packets 29
rx_q0_bytes 2109
rx_q1_packets 28
rx_q1_bytes 2178
rx_q2_packets 28
rx_q2_bytes 2178
rx_q3_packets 14
rx_q3_bytes 1089
rx_q4_packets 11
rx_q4_bytes 662
rx_q5_packets 14
rx_q5_bytes 1089
rx_q6_packets 14
rx_q6_bytes 1089
rx_q7_packets 28
rx_q7_bytes 2178
rx_q8_packets 14
rx_q8_bytes 1089
rx_q10_packets 28
rx_q10_bytes 2178
rx_q11_packets 14
rx_q11_bytes 1089
rx_q12_packets 28
rx_q12_bytes 2178
rx_q13_packets 14
rx_q13_bytes 1089
rx_q14_packets 14
rx_q14_bytes 1089
rx_q15_packets 28
rx_q15_bytes 2178
Hardware:
vppin 2 up vppin
Link speed: 100 Gbps
RX Queues:
queue thread mode
0 vpp_wk_16 (17) polling
1 vpp_wk_0 (1) polling
2 vpp_wk_1 (2) polling
3 vpp_wk_2 (3) polling
4 vpp_wk_3 (4) polling
5 vpp_wk_4 (5) polling
6 vpp_wk_5 (6) polling
7 vpp_wk_6 (7) polling
8 vpp_wk_7 (8) polling
9 vpp_wk_8 (9) polling
10 vpp_wk_9 (10) polling
11 vpp_wk_10 (11) polling
12 vpp_wk_11 (12) polling
13 vpp_wk_12 (13) polling
14 vpp_wk_13 (14) polling
15 vpp_wk_14 (15) polling
TX Queues:
TX Hash: [name: hash-eth-l34 priority: 50 description: Hash ethernet L34
headers]
queue shared thread(s)
0 yes 0, 16
1 yes 1, 17
2 no 2
3 no 3
4 no 4
5 no 5
6 no 6
7 no 7
8 no 8
9 no 9
10 no 10
11 no 11
12 no 12
13 no 13
14 no 14
15 no 15
Ethernet address 0c:42:a1:8b:e4:59
Mellanox ConnectX-4/5/6 Family
carrier up full duplex max-frame-size 2048
flags: admin-up subif tx-offload intel-phdr-cksum rx-ip4-cksum
Devargs:
rx: queues 16 (max 1024), desc 8192 (min 0 max 32768 align 1)
tx: queues 16 (max 1024), desc 4096 (min 0 max 32768 align 1)
pci: device 15b3:1019 subsystem 15b3:0026 address 0000:06:00.00 numa 0
switch info: name 0000:06:00.0 domain id 1 port id 65535
max rx packet len: 65536
promiscuous: unicast off all-multicast on
vlan offload: strip off filter off qinq off
rx offload avail: vlan-strip ipv4-cksum udp-cksum tcp-cksum tcp-lro
vlan-filter scatter timestamp keep-crc rss-hash
buffer-split
rx offload active: ipv4-cksum udp-cksum tcp-cksum
tx offload avail: vlan-insert ipv4-cksum udp-cksum tcp-cksum tcp-tso
outer-ipv4-cksum vxlan-tnl-tso gre-tnl-tso geneve-tnl-tso
multi-segs mbuf-fast-free udp-tnl-tso ip-tnl-tso
tx offload active: ipv4-cksum udp-cksum tcp-cksum tcp-tso vxlan-tnl-tso
rss avail: ipv4-frag ipv4-tcp ipv4-udp ipv4-other ipv4 ipv6-tcp-ex
ipv6-udp-ex ipv6-frag ipv6-tcp ipv6-udp ipv6-other
ipv6-ex ipv6 esp l4-dst-only l4-src-only l3-dst-only
l3-src-only
rss active: ipv4-frag ipv4-tcp ipv4-udp ipv4-other l3-src-only
tx burst mode: Enhanced MPW + MULTI + TSO + SWP + CSUM + INLINE + VLAN +
METADATA
tx burst function: (not available)
rx burst mode: Vector SSE
rx burst function: (not available)
tx frames ok 3077
tx bytes ok 4472562
rx frames ok 1971
rx bytes ok 152601
extended stats:
rx_good_packets 1971
tx_good_packets 3077
rx_good_bytes 152601
tx_good_bytes 4472562
rx_q0_packets 211
rx_q0_bytes 15876
rx_q1_packets 112
rx_q1_bytes 8712
rx_q2_packets 126
rx_q2_bytes 9801
rx_q3_packets 112
rx_q3_bytes 8712
rx_q4_packets 122
rx_q4_bytes 9312
rx_q5_packets 112
rx_q5_bytes 8712
rx_q6_packets 112
rx_q6_bytes 8712
rx_q7_packets 126
rx_q7_bytes 9801
rx_q8_packets 112
rx_q8_bytes 8712
rx_q9_packets 112
rx_q9_bytes 8712
rx_q10_packets 126
rx_q10_bytes 9801
rx_q11_packets 112
rx_q11_bytes 8712
rx_q12_packets 126
rx_q12_bytes 9801
rx_q13_packets 112
rx_q13_bytes 8712
rx_q14_packets 112
rx_q14_bytes 8712
rx_q15_packets 126
rx_q15_bytes 9801
tx_q0_packets 253
tx_q0_bytes 367774
tx_q1_packets 231
tx_q1_bytes 334400
tx_q2_packets 161
tx_q2_bytes 234038
tx_q3_packets 207
tx_q3_bytes 300906
tx_q4_packets 138
tx_q4_bytes 200604
tx_q5_packets 161
tx_q5_bytes 234038
tx_q6_packets 253
tx_q6_bytes 367774
tx_q7_packets 132
tx_q7_bytes 192950
tx_q8_packets 230
tx_q8_bytes 334340
tx_q9_packets 253
tx_q9_bytes 367774
tx_q10_packets 138
tx_q10_bytes 200604
tx_q11_packets 230
tx_q11_bytes 334340
tx_q12_packets 161
tx_q12_bytes 234038
tx_q13_packets 138
tx_q13_bytes 200604
tx_q14_packets 230
tx_q14_bytes 334340
tx_q15_packets 161
tx_q15_bytes 234038
rx_unicast_bytes 145437
rx_multicast_bytes 7104
rx_broadcast_bytes 60
rx_unicast_packets 1872
rx_multicast_packets 98
rx_broadcast_packets 1
tx_unicast_bytes 4472562
tx_unicast_packets 3077
tx_phy_packets 3080
rx_phy_packets 1971
tx_phy_bytes 4485122
rx_phy_bytes 160485
vppout 1 up vppout
Link speed: 100 Gbps
RX Queues:
queue thread mode
0 vpp_wk_0 (1) polling
1 vpp_wk_1 (2) polling
2 vpp_wk_2 (3) polling
3 vpp_wk_3 (4) polling
4 vpp_wk_4 (5) polling
5 vpp_wk_5 (6) polling
6 vpp_wk_6 (7) polling
7 vpp_wk_7 (8) polling
8 vpp_wk_8 (9) polling
9 vpp_wk_9 (10) polling
10 vpp_wk_10 (11) polling
11 vpp_wk_11 (12) polling
12 vpp_wk_12 (13) polling
13 vpp_wk_13 (14) polling
14 vpp_wk_14 (15) polling
15 vpp_wk_15 (16) polling
TX Queues:
TX Hash: [name: hash-eth-l34 priority: 50 description: Hash ethernet L34
headers]
queue shared thread(s)
0 yes 0, 16
1 yes 1, 17
2 no 2
3 no 3
4 no 4
5 no 5
6 no 6
7 no 7
8 no 8
9 no 9
10 no 10
11 no 11
12 no 12
13 no 13
14 no 14
15 no 15
Ethernet address 0c:42:a1:8b:e4:58
Mellanox ConnectX-4/5/6 Family
carrier up full duplex max-frame-size 2048
flags: admin-up subif tx-offload intel-phdr-cksum rx-ip4-cksum
Devargs:
rx: queues 16 (max 1024), desc 8192 (min 0 max 32768 align 1)
tx: queues 16 (max 1024), desc 4096 (min 0 max 32768 align 1)
pci: device 15b3:1019 subsystem 15b3:0026 address 0000:05:00.00 numa 0
switch info: name 0000:05:00.0 domain id 0 port id 65535
max rx packet len: 65536
promiscuous: unicast off all-multicast on
vlan offload: strip off filter off qinq off
rx offload avail: vlan-strip ipv4-cksum udp-cksum tcp-cksum tcp-lro
vlan-filter scatter timestamp keep-crc rss-hash
buffer-split
rx offload active: ipv4-cksum udp-cksum tcp-cksum
tx offload avail: vlan-insert ipv4-cksum udp-cksum tcp-cksum tcp-tso
outer-ipv4-cksum vxlan-tnl-tso gre-tnl-tso geneve-tnl-tso
multi-segs mbuf-fast-free udp-tnl-tso ip-tnl-tso
tx offload active: ipv4-cksum udp-cksum tcp-cksum tcp-tso vxlan-tnl-tso
rss avail: ipv4-frag ipv4-tcp ipv4-udp ipv4-other ipv4 ipv6-tcp-ex
ipv6-udp-ex ipv6-frag ipv6-tcp ipv6-udp ipv6-other
ipv6-ex ipv6 esp l4-dst-only l4-src-only l3-dst-only
l3-src-only
rss active: ipv4-frag ipv4-tcp ipv4-udp ipv4-other l3-dst-only
tx burst mode: Enhanced MPW + MULTI + TSO + SWP + CSUM + INLINE + VLAN +
METADATA
tx burst function: (not available)
rx burst mode: Vector SSE
rx burst function: (not available)
tx frames ok 13177
tx bytes ok 1025169
rx frames ok 22181
rx bytes ok 31437090
extended stats:
rx_good_packets 22181
tx_good_packets 13177
rx_good_bytes 31437090
tx_good_bytes 1025169
rx_q0_packets 2102
rx_q0_bytes 2249208
rx_q1_packets 1104
rx_q1_bytes 1604832
rx_q2_packets 1564
rx_q2_bytes 2273512
rx_q3_packets 1081
rx_q3_bytes 1571398
rx_q4_packets 1173
rx_q4_bytes 1705134
rx_q5_packets 1564
rx_q5_bytes 2273512
rx_q6_packets 1127
rx_q6_bytes 1638266
rx_q7_packets 1587
rx_q7_bytes 2306946
rx_q8_packets 1610
rx_q8_bytes 2340380
rx_q9_packets 1081
rx_q9_bytes 1571398
rx_q10_packets 1564
rx_q10_bytes 2273512
rx_q11_packets 1127
rx_q11_bytes 1638266
rx_q12_packets 1127
rx_q12_bytes 1638266
rx_q13_packets 1587
rx_q13_bytes 2306946
rx_q14_packets 1173
rx_q14_bytes 1705134
rx_q15_packets 1610
rx_q15_bytes 2340380
tx_q0_packets 3
tx_q0_bytes 310
tx_q1_packets 1638
tx_q1_bytes 127413
tx_q2_packets 812
tx_q2_bytes 63162
tx_q3_packets 828
tx_q3_bytes 64427
tx_q4_packets 820
tx_q4_bytes 63898
tx_q5_packets 826
tx_q5_bytes 64251
tx_q6_packets 826
tx_q6_bytes 64251
tx_q7_packets 826
tx_q7_bytes 64251
tx_q8_packets 826
tx_q8_bytes 64251
tx_q9_packets 812
tx_q9_bytes 63162
tx_q10_packets 840
tx_q10_bytes 65259
tx_q11_packets 830
tx_q11_bytes 64619
tx_q12_packets 826
tx_q12_bytes 64251
tx_q13_packets 826
tx_q13_bytes 64251
tx_q14_packets 826
tx_q14_bytes 64251
tx_q15_packets 812
tx_q15_bytes 63162
rx_unicast_bytes 31394526
rx_multicast_bytes 42300
rx_broadcast_bytes 60
rx_unicast_packets 21597
rx_multicast_packets 580
rx_broadcast_packets 1
tx_unicast_bytes 1022571
tx_multicast_bytes 1496
tx_broadcast_bytes 60
tx_unicast_packets 13146
tx_multicast_packets 18
tx_broadcast_packets 1
tx_phy_packets 13190
rx_phy_packets 22178
tx_phy_bytes 1078887
rx_phy_bytes 31525598
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#27078): https://lists.fd.io/g/vpp-dev/message/27078 Mute This Topic: https://lists.fd.io/mt/119954526/21656 Group Owner: [email protected] Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/14379924/21656/631435203/xyzzy [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
