> On 10 Jun 2022, at 08:24, Hrvoje Popovski <[email protected]> wrote:
>
> On 9.6.2022. 19:25, Hrvoje Popovski wrote:
>> On 9.6.2022. 19:11, Jan Klemkow wrote:
>>> On Thu, Jun 09, 2022 at 08:25:22AM +0200, Hrvoje Popovski wrote:
>>>> On 8.6.2022. 22:01, Hrvoje Popovski wrote:
>>>>> On 8.6.2022. 15:04, Jan Klemkow wrote:
>>>>>> Could you show me, how your setup and your configuration looks like?
>>>>> Yes, of course ..
>>>>>
>>>>> All my lab boxes are connected to switch (no flow-control). In this
>>>>> setup ix0 and ix1 are in aggr and vlans 700 and 800 are tagged on aggr3.
>>>>> I have tried tcpbench and iperf3 from openbsd or linux box and with tso
>>>>> I'm getting few Kbps. In attachment you can find tcpdump for iperf3 on
>>>>> openbsd with or without tso
>>>>>
>>>>> I will play more with this setup maybe I'm doing something terribly
>>>>> wrong...
>>>>>
>>>>> My OpenBSD conf:
>>>>>
>>>>> r620-1# cat /etc/hostname.ix0
>>>>> up
>>>>>
>>>>> r620-1# cat /etc/hostname.ix1
>>>>> up
>>>>>
>>>>> r620-1# cat /etc/hostname.aggr3
>>>>> trunkport ix0
>>>>> trunkport ix1
>>>>> up
>>>>>
>>>>> r620-1# cat /etc/hostname.vlan700
>>>>> parent aggr3
>>>>> vnetid 700
>>>>> lladdr ec:f4:bb:da:f7:f8
>>>>> inet 192.168.100.11/24
>>>>> !route add 16/8 192.168.100.111
>>>>> up
>>>>>
>>>>> r620-1# cat /etc/hostname.vlan800
>>>>> parent aggr3
>>>>> vnetid 800
>>>>> lladdr ec:f4:bb:da:f7:fa
>>>>> inet 192.168.111.11/24
>>>>> !route add 48/8 192.168.111.111
>>>>> up
>>>>
>>>> now I've configured aggr like this
>>>>
>>>> ix0 - aggr0 - vlan700
>>>> ix1 - aggr1 - vlan800
>>>> ip configuration is the same
>>>>
>>>> still I have problem with tso
>>>>
>>>> tcpdump in attachment
>>>
>>> The tcpdump output on my machine looks similar to yours.
>>> Do you see TCP retransmits on your sending Linux host?
>>>
>>> # netstat -s | grep retransmitted
>>> 0 segments retransmitted
>>>
>>
>> [root@test2 pktgen]# netstat -s | grep -i segment
>> 8352173627 segments received
>> 14648977712 segments send out
>> 13336873 segments retransmited
>> 586 bad segments received.
>>
>> yes, segments retransmited is increasing
>>
>>
>>> Which specific ix(4) NIC do you use?
>>>
>>
>> r620-1# dmesg | grep ix
>> mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
>> ix0 at pci1 dev 0 function 0 "Intel 82599" rev 0x01, msix, 6 queues,
>> address ec:f4:bb:da:f7:f8
>> ix1 at pci1 dev 0 function 1 "Intel 82599" rev 0x01, msix, 6 queues,
>> address ec:f4:bb:da:f7:fa
>> ix2 at pci4 dev 0 function 0 "Intel X540T" rev 0x01, msix, 6 queues,
>> address a0:36:9f:29:f2:0c
>> ix3 at pci4 dev 0 function 1 "Intel X540T" rev 0x01, msix, 6 queues,
>> address a0:36:9f:29:f2:0e
>>
>>
>> I'm using ix0 and ix1 for testing
>>> I'm using these two:
>>>
>>> # dmesg | grep ^ix
>>> ix0 at pci3 dev 0 function 0 "Intel 82599" rev 0x01, msix, 12 queues,
>>> address 00:1b:21:87:fb:2c
>>> ix1 at pci3 dev 0 function 1 "Intel 82599" rev 0x01, msix, 12 queues,
>>> address 00:1b:21:87:fb:2d
>>>
>>> Thanks,
>>> Jan
>>>
>>
>
> Hi,
>
> I tried with trunk lacp and tagged vlan700 over trunk0 and it's working
> as expected. Everything is the same as before, only aggr0 is now trunk0.
>
> with tso
> [ 4] 17.00-18.00 sec 1.09 GBytes 9.39 Gbits/sec 22 622 KBytes
> [ 4] 18.00-19.00 sec 1.09 GBytes 9.39 Gbits/sec 17 662 KBytes
> [ 4] 19.00-20.00 sec 1.09 GBytes 9.39 Gbits/sec 0 696 KBytes
> [ 4] 20.00-21.00 sec 1.09 GBytes 9.39 Gbits/sec 0 735 KBytes
>
>
> without tso
> [ 4] 17.00-18.00 sec 594 MBytes 4.98 Gbits/sec 0 612 KBytes
> [ 4] 18.00-19.00 sec 594 MBytes 4.98 Gbits/sec 0 646 KBytes
> [ 4] 19.00-20.00 sec 595 MBytes 4.99 Gbits/sec 0 665 KBytes
> [ 4] 20.00-20.87 sec 515 MBytes 4.99 Gbits/sec 0 675 KBytes
>
>
> tcpdump is the same as with aggr...
>
>
> After this I've tried same aggr/vlan setup on two different boxes with
> ix interfaces and send traffic to them from linux and openbsd and
> results are not good ...
> Only differences between your setup and mine is that i have switch and
> you have directly connected hosts... but i don't think that should be
> the problem..
>
> It would be great if someone else could test this because it's not that
> i don't know what I'm doing but I'm running out of ideas...
is this rx ring moderation not scaling fast enough?
what's systat mb look like when you're trying? do you see qdrops increase in
the ix-rxq kstats?
dlg
