On 8.6.2022. 15:04, Jan Klemkow wrote:
> Could you show me, how your setup and your configuration looks like?
Yes, of course ..
All my lab boxes are connected to switch (no flow-control). In this
setup ix0 and ix1 are in aggr and vlans 700 and 800 are tagged on aggr3.
I have tried tcpbench and iperf3 from openbsd or linux box and with tso
I'm getting few Kbps. In attachment you can find tcpdump for iperf3 on
openbsd with or without tso
I will play more with this setup maybe I'm doing something terribly wrong...
My OpenBSD conf:
r620-1# cat /etc/hostname.ix0
up
r620-1# cat /etc/hostname.ix1
up
r620-1# cat /etc/hostname.aggr3
trunkport ix0
trunkport ix1
up
r620-1# cat /etc/hostname.vlan700
parent aggr3
vnetid 700
lladdr ec:f4:bb:da:f7:f8
inet 192.168.100.11/24
!route add 16/8 192.168.100.111
up
r620-1# cat /etc/hostname.vlan800
parent aggr3
vnetid 800
lladdr ec:f4:bb:da:f7:fa
inet 192.168.111.11/24
!route add 48/8 192.168.111.111
up
ifconfig output
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 32768
index 8 priority 0 llprio 3
groups: lo
inet6 ::1 prefixlen 128
inet6 fe80::1%lo0 prefixlen 64 scopeid 0x8
inet 127.0.0.1 netmask 0xff000000
ix0:
flags=8b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST,TSO>
mtu 1500
lladdr fe:e1:ba:d0:12:43
index 1 priority 0 llprio 3
trunk: trunkdev aggr3
media: Ethernet autoselect (10GSFP+Cu full-duplex,rxpause,txpause)
status: active
ix1:
flags=2008b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST,TSO>
mtu 1500
lladdr fe:e1:ba:d0:12:43
index 2 priority 0 llprio 3
trunk: trunkdev aggr3
media: Ethernet autoselect (10GSFP+Cu full-duplex,rxpause,txpause)
status: active
ix2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
lladdr a0:36:9f:29:f2:0c
index 3 priority 0 llprio 3
media: Ethernet autoselect (10GbaseT full-duplex,rxpause,txpause)
status: active
inet 192.168.1.1 netmask 0xfffffffc broadcast 192.168.1.3
ix3: flags=8802<BROADCAST,SIMPLEX,MULTICAST> mtu 1500
lladdr a0:36:9f:29:f2:0e
index 4 priority 0 llprio 3
media: Ethernet autoselect (10GbaseT full-duplex)
status: active
em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
lladdr ec:f4:bb:da:f7:fc
index 5 priority 0 llprio 3
groups: egress
media: Ethernet autoselect (1000baseT full-duplex,master)
status: active
inet BLA.BLA.BLA.BLA netmask 0xffffffe0 broadcast BLA.BLA.BLA
em1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> mtu 1500
lladdr ec:f4:bb:da:f7:fd
index 6 priority 0 llprio 3
media: Ethernet autoselect (1000baseT full-duplex,rxpause,txpause)
status: active
enc0: flags=0<>
index 7 priority 0 llprio 3
groups: enc
status: active
aggr3: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
lladdr fe:e1:ba:d0:12:43
index 9 priority 0 llprio 7
trunk: trunkproto lacp
trunk id: [(8000,fe:e1:ba:d0:12:43,0009,0000,0000),
(0000,02:04:96:a5:30:cc,03EB,0000,0000)]
ix0 lacp actor system pri 0x8000 mac fe:e1:ba:d0:12:43,
key 0x9, port pri 0x8000 number 0x1
ix0 lacp actor state
activity,aggregation,sync,collecting,distributing
ix0 lacp partner system pri 0x0 mac 02:04:96:a5:30:cc,
key 0x3eb, port pri 0x0 number 0x3eb
ix0 lacp partner state
activity,aggregation,sync,collecting,distributing
ix0 port active,collecting,distributing
ix1 lacp actor system pri 0x8000 mac fe:e1:ba:d0:12:43,
key 0x9, port pri 0x8000 number 0x2
ix1 lacp actor state
activity,aggregation,sync,collecting,distributing
ix1 lacp partner system pri 0x0 mac 02:04:96:a5:30:cc,
key 0x3eb, port pri 0x0 number 0x3ec
ix1 lacp partner state
activity,aggregation,sync,collecting,distributing
ix1 port active,collecting,distributing
groups: aggr
media: Ethernet autoselect
status: active
vlan700: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
lladdr ec:f4:bb:da:f7:f8
index 10 priority 0 llprio 3
encap: vnetid 700 parent aggr3 txprio packet rxprio outer
groups: vlan
media: Ethernet autoselect
status: active
inet 192.168.100.11 netmask 0xffffff00 broadcast 192.168.100.255
vlan800: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
lladdr ec:f4:bb:da:f7:fa
index 11 priority 0 llprio 3
encap: vnetid 800 parent aggr3 txprio packet rxprio outer
groups: vlan
media: Ethernet autoselect
status: active
inet 192.168.111.11 netmask 0xffffff00 broadcast 192.168.111.255
tcpdump without tso
Jun 08 21:54:21.393214 90:e2:ba:33:b4:a0 ec:f4:bb:da:f7:f8 8100 1518: 802.1Q
vid 700 pri 1 192.168.100.112.52088 > 192.168.100.11.5201: .
333030430:333031878(1448) ack 1 win 229 <nop,nop,timestamp 2450722895
4062148097> (DF) (ttl 64, id 26693, len 1500)
Jun 08 21:54:21.393214 90:e2:ba:33:b4:a0 ec:f4:bb:da:f7:f8 8100 1518: 802.1Q
vid 700 pri 1 192.168.100.112.52088 > 192.168.100.11.5201: .
333031878:333033326(1448) ack 1 win 229 <nop,nop,timestamp 2450722895
4062148097> (DF) (ttl 64, id 26694, len 1500)
Jun 08 21:54:21.393214 90:e2:ba:33:b4:a0 ec:f4:bb:da:f7:f8 8100 1518: 802.1Q
vid 700 pri 1 192.168.100.112.52088 > 192.168.100.11.5201: .
333033326:333034774(1448) ack 1 win 229 <nop,nop,timestamp 2450722895
4062148097> (DF) (ttl 64, id 26695, len 1500)
Jun 08 21:54:21.393215 90:e2:ba:33:b4:a0 ec:f4:bb:da:f7:f8 8100 1518: 802.1Q
vid 700 pri 1 192.168.100.112.52088 > 192.168.100.11.5201: .
333034774:333036222(1448) ack 1 win 229 <nop,nop,timestamp 2450722895
4062148097> (DF) (ttl 64, id 26696, len 1500)
Jun 08 21:54:21.393215 90:e2:ba:33:b4:a0 ec:f4:bb:da:f7:f8 8100 1518: 802.1Q
vid 700 pri 1 192.168.100.112.52088 > 192.168.100.11.5201: .
333036222:333037670(1448) ack 1 win 229 <nop,nop,timestamp 2450722895
4062148097> (DF) (ttl 64, id 26697, len 1500)
Jun 08 21:54:21.393215 90:e2:ba:33:b4:a0 ec:f4:bb:da:f7:f8 8100 1518: 802.1Q
vid 700 pri 1 192.168.100.112.52088 > 192.168.100.11.5201: .
333037670:333039118(1448) ack 1 win 229 <nop,nop,timestamp 2450722895
4062148097> (DF) (ttl 64, id 26698, len 1500)
tcpdump with tso
Jun 08 21:55:31.480735 ec:f4:bb:da:f7:f8 90:e2:ba:33:b4:a0 8100 70: 802.1Q vid
700 pri 3 192.168.100.11.5201 > 192.168.100.112.52092: . [bad tcp cksum 49f3!
-> e9fb] 1:1(0) ack 275120 win 271 <nop,nop,timestamp 2380136623 2450792983>
(DF) (ttl 64, id 50554, len 52, bad ip cksum 0! -> 2b7d)
Jun 08 21:55:31.480830 90:e2:ba:33:b4:a0 ec:f4:bb:da:f7:f8 0800 4410:
192.168.100.112.52092 > 192.168.100.11.5201: . 275120:279464(4344) ack 1 win
229 <nop,nop,timestamp 2450792983 2380136623> (DF) (ttl 64, id 61267, len 4396)
Jun 08 21:55:31.490464 90:e2:ba:33:b4:a0 ec:f4:bb:da:f7:f8 8100 1518: 802.1Q
vid 700 pri 1 192.168.100.112.52092 > 192.168.100.11.5201: .
279464:280912(1448) ack 1 win 229 <nop,nop,timestamp 2450792993 2380136623>
(DF) (ttl 64, id 61268, len 1500)
Jun 08 21:55:31.490543 ec:f4:bb:da:f7:f8 90:e2:ba:33:b4:a0 8100 82: 802.1Q vid
700 pri 3 192.168.100.11.5201 > 192.168.100.112.52092: . [bad tcp cksum 49ff!
-> 5c1a] 1:1(0) ack 275120 win 271 <nop,nop,timestamp 2380136623
2450792983,nop,nop,sack 1 {279464:280912} > (DF) (ttl 64, id 49842, len 64, bad
ip cksum 0! -> 2e39)
Jun 08 21:55:31.490569 90:e2:ba:33:b4:a0 ec:f4:bb:da:f7:f8 8100 1518: 802.1Q
vid 700 pri 1 192.168.100.112.52092 > 192.168.100.11.5201: .
275120:276568(1448) ack 1 win 229 <nop,nop,timestamp 2450792993 2380136623>
(DF) (ttl 64, id 61269, len 1500)
Jun 08 21:55:31.490580 ec:f4:bb:da:f7:f8 90:e2:ba:33:b4:a0 8100 82: 802.1Q vid
700 pri 3 192.168.100.11.5201 > 192.168.100.112.52092: . [bad tcp cksum 49ff!
-> 567f] 1:1(0) ack 276568 win 248 <nop,nop,timestamp 2380136623
2450792993,nop,nop,sack 1 {279464:280912} > (DF) (ttl 64, id 17054, len 64, bad
ip cksum 0! -> ae4d)
