Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-20 Thread Paweł Staszewski
W dniu 19.11.2018 o 22:59, David Ahern pisze: On 11/9/18 5:06 PM, David Ahern wrote: On 11/9/18 9:21 AM, David Ahern wrote: Is there possible to add only counters from xdp for vlans ? This will help me in testing. I will take a look today at adding counters that you can dump using bpftool.

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-19 Thread David Ahern
On 11/9/18 5:06 PM, David Ahern wrote: > On 11/9/18 9:21 AM, David Ahern wrote: >>> Is there possible to add only counters from xdp for vlans ? >>> This will help me in testing. >> I will take a look today at adding counters that you can dump using >> bpftool. It will be a temporary solution for

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-12 Thread Paweł Staszewski
W dniu 11.11.2018 o 09:56, Jesper Dangaard Brouer pisze: On Sat, 10 Nov 2018 22:53:53 +0100 Paweł Staszewski wrote: Now im messing with ring configuration for connectx5 nics. And after reading that paper:

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-11 Thread Paweł Staszewski
W dniu 11.11.2018 o 09:03, Jesper Dangaard Brouer pisze: On Sat, 10 Nov 2018 23:19:50 +0100 Paweł Staszewski wrote: W dniu 10.11.2018 o 23:06, Jesper Dangaard Brouer pisze: On Sat, 10 Nov 2018 20:56:02 +0100 Paweł Staszewski wrote: W dniu 10.11.2018 o 20:49, Paweł Staszewski pisze:

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-11 Thread Jesper Dangaard Brouer
On Sat, 10 Nov 2018 22:53:53 +0100 Paweł Staszewski wrote: > Now im messing with ring configuration for connectx5 nics. > And after reading that paper: > https://netdevconf.org/2.1/slides/apr6/network-performance/04-amir-RX_and_TX_bulking_v2.pdf > Do notice that some of the ideas in that

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-11 Thread Jesper Dangaard Brouer
On Sat, 10 Nov 2018 23:19:50 +0100 Paweł Staszewski wrote: > W dniu 10.11.2018 o 23:06, Jesper Dangaard Brouer pisze: > > On Sat, 10 Nov 2018 20:56:02 +0100 > > Paweł Staszewski wrote: > > > >> W dniu 10.11.2018 o 20:49, Paweł Staszewski pisze: > >>> > >>> W dniu 10.11.2018 o 20:34, Jesper

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-10 Thread Paweł Staszewski
W dniu 10.11.2018 o 23:06, Jesper Dangaard Brouer pisze: On Sat, 10 Nov 2018 20:56:02 +0100 Paweł Staszewski wrote: W dniu 10.11.2018 o 20:49, Paweł Staszewski pisze: W dniu 10.11.2018 o 20:34, Jesper Dangaard Brouer pisze: On Fri, 9 Nov 2018 23:20:38 +0100 Paweł Staszewski wrote:

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-10 Thread Jesper Dangaard Brouer
On Sat, 10 Nov 2018 20:56:02 +0100 Paweł Staszewski wrote: > W dniu 10.11.2018 o 20:49, Paweł Staszewski pisze: > > > > > > W dniu 10.11.2018 o 20:34, Jesper Dangaard Brouer pisze: > >> On Fri, 9 Nov 2018 23:20:38 +0100 Paweł Staszewski > >> wrote: > >> > >>> W dniu 08.11.2018 o 20:12,

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-10 Thread Paweł Staszewski
W dniu 10.11.2018 o 22:53, Paweł Staszewski pisze: W dniu 10.11.2018 o 22:01, Jesper Dangaard Brouer pisze: On Sat, 10 Nov 2018 21:02:10 +0100 Paweł Staszewski wrote: W dniu 10.11.2018 o 20:34, Jesper Dangaard Brouer pisze: I want you to experiment with:    ethtool --set-priv-flags

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-10 Thread Paweł Staszewski
W dniu 10.11.2018 o 22:01, Jesper Dangaard Brouer pisze: On Sat, 10 Nov 2018 21:02:10 +0100 Paweł Staszewski wrote: W dniu 10.11.2018 o 20:34, Jesper Dangaard Brouer pisze: I want you to experiment with: ethtool --set-priv-flags DEVICE rx_striding_rq off just checked that previously

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-10 Thread Jesper Dangaard Brouer
On Sat, 10 Nov 2018 21:02:10 +0100 Paweł Staszewski wrote: > W dniu 10.11.2018 o 20:34, Jesper Dangaard Brouer pisze: > > I want you to experiment with: > > > > ethtool --set-priv-flags DEVICE rx_striding_rq off > > just checked that previously connectx4 was have thos disabled: >  ethtool

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-10 Thread Paweł Staszewski
W dniu 10.11.2018 o 20:34, Jesper Dangaard Brouer pisze: I want you to experiment with: ethtool --set-priv-flags DEVICE rx_striding_rq off just checked that previously connectx4 was have thos disabled:  ethtool --show-priv-flags enp175s0f0 Private flags for enp175s0f0: rx_cqe_moder  

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-10 Thread Paweł Staszewski
W dniu 10.11.2018 o 20:49, Paweł Staszewski pisze: W dniu 10.11.2018 o 20:34, Jesper Dangaard Brouer pisze: On Fri, 9 Nov 2018 23:20:38 +0100 Paweł Staszewski wrote: W dniu 08.11.2018 o 20:12, Paweł Staszewski pisze: CPU load is lower than for connectx4 - but it looks like bandwidth

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-10 Thread Paweł Staszewski
W dniu 10.11.2018 o 20:34, Jesper Dangaard Brouer pisze: On Fri, 9 Nov 2018 23:20:38 +0100 Paweł Staszewski wrote: W dniu 08.11.2018 o 20:12, Paweł Staszewski pisze: CPU load is lower than for connectx4 - but it looks like bandwidth limit is the same :) But also after reaching

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-10 Thread Jesper Dangaard Brouer
On Fri, 9 Nov 2018 23:20:38 +0100 Paweł Staszewski wrote: > W dniu 08.11.2018 o 20:12, Paweł Staszewski pisze: > > CPU load is lower than for connectx4 - but it looks like bandwidth > > limit is the same :) > > But also after reaching 60Gbit/60Gbit > > > >  bwm-ng v0.6.1 (probing every

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-10 Thread David Ahern
On 11/10/18 6:18 AM, Paweł Staszewski wrote: > > ./xdp_fwd enp175s0f0 enp175s0f1 > libbpf: failed to create map (name: 'stats_map'): Operation not permitted > libbpf: failed to load object './xdp_fwd_kern.o' Forgot I had increased locked memory: ulimit -l unlimited ./xdp_fwd enp175s0f0

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-10 Thread Paweł Staszewski
W dniu 10.11.2018 o 01:06, David Ahern pisze: On 11/9/18 9:21 AM, David Ahern wrote: Is there possible to add only counters from xdp for vlans ? This will help me in testing. I will take a look today at adding counters that you can dump using bpftool. It will be a temporary solution for

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-09 Thread David Ahern
On 11/9/18 9:21 AM, David Ahern wrote: >> Is there possible to add only counters from xdp for vlans ? >> This will help me in testing. > I will take a look today at adding counters that you can dump using > bpftool. It will be a temporary solution for this xdp program only. > Same tree,

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-09 Thread Paweł Staszewski
W dniu 08.11.2018 o 20:12, Paweł Staszewski pisze: CPU load is lower than for connectx4 - but it looks like bandwidth limit is the same :) But also after reaching 60Gbit/60Gbit  bwm-ng v0.6.1 (probing every 1.000s), press 'h' for help   input: /proc/net/dev type: rate   - iface  

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-09 Thread Paweł Staszewski
W dniu 09.11.2018 o 17:21, David Ahern pisze: On 11/9/18 3:20 AM, Paweł Staszewski wrote: I just catch some weird behavior :) All was working fine for about 20k packets Then after xdp start to forward every 10 packets Interesting. Any counter showing drops? nothing that will fit NIC

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-09 Thread David Ahern
On 11/9/18 3:20 AM, Paweł Staszewski wrote: > > I just catch some weird behavior :) > All was working fine for about 20k packets > > Then after xdp start to forward every 10 packets Interesting. Any counter showing drops? > ping 172.16.0.2 -i 0.1 > PING 172.16.0.2 (172.16.0.2) 56(84) bytes of

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-09 Thread Paweł Staszewski
W dniu 08.11.2018 o 17:06, David Ahern pisze: On 11/8/18 6:33 AM, Paweł Staszewski wrote: W dniu 07.11.2018 o 22:06, David Ahern pisze: On 11/3/18 6:24 PM, Paweł Staszewski wrote: Does your setup have any other device types besides physical ports with VLANs (e.g., any macvlans or bonds)?

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-09 Thread Paweł Staszewski
W dniu 09.11.2018 o 05:52, Saeed Mahameed pisze: On Thu, 2018-11-08 at 17:42 -0700, David Ahern wrote: On 11/8/18 5:40 PM, Paweł Staszewski wrote: W dniu 08.11.2018 o 17:32, David Ahern pisze: On 11/8/18 9:27 AM, Paweł Staszewski wrote: What hardware is this? mellanox connectx 4 ethtool

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread Jesper Dangaard Brouer
On Fri, 9 Nov 2018 04:52:01 + Saeed Mahameed wrote: > On Thu, 2018-11-08 at 17:42 -0700, David Ahern wrote: > > On 11/8/18 5:40 PM, Paweł Staszewski wrote: > > > > > > W dniu 08.11.2018 o 17:32, David Ahern pisze: > > > > On 11/8/18 9:27 AM, Paweł Staszewski wrote: > > > > > > > What

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread Saeed Mahameed
On Thu, 2018-11-08 at 17:42 -0700, David Ahern wrote: > On 11/8/18 5:40 PM, Paweł Staszewski wrote: > > > > W dniu 08.11.2018 o 17:32, David Ahern pisze: > > > On 11/8/18 9:27 AM, Paweł Staszewski wrote: > > > > > > What hardware is this? > > > > > > > > > > mellanox connectx 4 > > > > ethtool

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread David Ahern
On 11/8/18 5:40 PM, Paweł Staszewski wrote: > > > W dniu 08.11.2018 o 17:32, David Ahern pisze: >> On 11/8/18 9:27 AM, Paweł Staszewski wrote: > What hardware is this? > >>> mellanox connectx 4 >>> ethtool -i enp175s0f0 >>> driver: mlx5_core >>> version: 5.0-0 >>> firmware-version:

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread Paweł Staszewski
W dniu 08.11.2018 o 17:32, David Ahern pisze: On 11/8/18 9:27 AM, Paweł Staszewski wrote: What hardware is this? mellanox connectx 4 ethtool -i enp175s0f0 driver: mlx5_core version: 5.0-0 firmware-version: 12.21.1000 (SM_200101033) expansion-rom-version: bus-info: :af:00.0

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread Paweł Staszewski
W dniu 03.11.2018 o 01:18, Paweł Staszewski pisze: W dniu 01.11.2018 o 21:37, Saeed Mahameed pisze: On Thu, 2018-11-01 at 12:09 +0100, Paweł Staszewski wrote: W dniu 01.11.2018 o 10:50, Saeed Mahameed pisze: On Wed, 2018-10-31 at 22:57 +0100, Paweł Staszewski wrote: Hi So maybee

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread David Ahern
On 11/8/18 10:30 AM, Paweł Staszewski wrote: > Wondering about this: > swapper 0 [045] 68494.770287: fib:fib_table_lookup: table 254 oif 0 > iif 6 proto 1 192.168.22.237/0 -> 172.16.0.2/0 tos 0 scope 0 flags 0 ==> > dev vlan1740 gw 0.0.0.0 src 172.16.0.1 err 0 >     7fff818c13b5

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread Paweł Staszewski
W dniu 08.11.2018 o 17:32, David Ahern pisze: On 11/8/18 9:27 AM, Paweł Staszewski wrote: What hardware is this? mellanox connectx 4 ethtool -i enp175s0f0 driver: mlx5_core version: 5.0-0 firmware-version: 12.21.1000 (SM_200101033) expansion-rom-version: bus-info: :af:00.0

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread David Ahern
On 11/8/18 9:27 AM, Paweł Staszewski wrote: >>> What hardware is this? >>> > mellanox connectx 4 > ethtool -i enp175s0f0 > driver: mlx5_core > version: 5.0-0 > firmware-version: 12.21.1000 (SM_200101033) > expansion-rom-version: > bus-info: :af:00.0 > supports-statistics: yes >

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread Paweł Staszewski
W dniu 08.11.2018 o 17:25, Paweł Staszewski pisze: W dniu 08.11.2018 o 17:06, David Ahern pisze: On 11/8/18 6:33 AM, Paweł Staszewski wrote: W dniu 07.11.2018 o 22:06, David Ahern pisze: On 11/3/18 6:24 PM, Paweł Staszewski wrote: Does your setup have any other device types besides

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread Paweł Staszewski
W dniu 08.11.2018 o 17:06, David Ahern pisze: On 11/8/18 6:33 AM, Paweł Staszewski wrote: W dniu 07.11.2018 o 22:06, David Ahern pisze: On 11/3/18 6:24 PM, Paweł Staszewski wrote: Does your setup have any other device types besides physical ports with VLANs (e.g., any macvlans or bonds)?

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread David Ahern
On 11/8/18 6:33 AM, Paweł Staszewski wrote: > > > W dniu 07.11.2018 o 22:06, David Ahern pisze: >> On 11/3/18 6:24 PM, Paweł Staszewski wrote: Does your setup have any other device types besides physical ports with VLANs (e.g., any macvlans or bonds)? >>> no. >>> just >>>

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread Paweł Staszewski
W dniu 08.11.2018 o 01:59, Paweł Staszewski pisze: W dniu 05.11.2018 o 21:17, Jesper Dangaard Brouer pisze: On Sun, 4 Nov 2018 01:24:03 +0100 Paweł Staszewski wrote: And today again after allpy patch for page allocator - reached again 64/64 Gbit/s with only 50-60% cpu load Great.

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread Paweł Staszewski
W dniu 07.11.2018 o 22:06, David Ahern pisze: On 11/3/18 6:24 PM, Paweł Staszewski wrote: Does your setup have any other device types besides physical ports with VLANs (e.g., any macvlans or bonds)? no. just phy(mlnx)->vlans only config VLAN and non-VLAN (and a mix) seem to work ok.

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-07 Thread Paweł Staszewski
W dniu 08.11.2018 o 01:59, Paweł Staszewski pisze: W dniu 05.11.2018 o 21:17, Jesper Dangaard Brouer pisze: On Sun, 4 Nov 2018 01:24:03 +0100 Paweł Staszewski wrote: And today again after allpy patch for page allocator - reached again 64/64 Gbit/s with only 50-60% cpu load Great.

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-07 Thread Paweł Staszewski
W dniu 05.11.2018 o 21:17, Jesper Dangaard Brouer pisze: On Sun, 4 Nov 2018 01:24:03 +0100 Paweł Staszewski wrote: And today again after allpy patch for page allocator - reached again 64/64 Gbit/s with only 50-60% cpu load Great. today no slowpath hit for netwoking :) But again

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-07 Thread David Ahern
On 11/3/18 6:24 PM, Paweł Staszewski wrote: >> Does your setup have any other device types besides physical ports with >> VLANs (e.g., any macvlans or bonds)? >> >> > no. > just > phy(mlnx)->vlans only config VLAN and non-VLAN (and a mix) seem to work ok. Patches are here:

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-05 Thread Jesper Dangaard Brouer
On Sun, 4 Nov 2018 01:24:03 +0100 Paweł Staszewski wrote: > And today again after allpy patch for page allocator - reached again > 64/64 Gbit/s > > with only 50-60% cpu load Great. > today no slowpath hit for netwoking :) > > But again dropped pckt at 64GbitRX and 64TX > And as it

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-05 Thread Jesper Dangaard Brouer
On Mon, 5 Nov 2018 14:28:36 +0800 Aaron Lu wrote: > On Sat, Nov 03, 2018 at 01:53:25PM +0100, Jesper Dangaard Brouer wrote: > > > > On Fri, 2 Nov 2018 22:20:24 +0800 Aaron Lu wrote: > > > > > On Fri, Nov 02, 2018 at 12:40:37PM +0100, Jesper Dangaard Brouer wrote: > > > > On Fri, 2 Nov

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-05 Thread Aaron Lu
On Mon, Nov 05, 2018 at 08:42:33AM +, Tariq Toukan wrote: > > On 03/11/2018 2:53 PM, Jesper Dangaard Brouer wrote: > > > > On Fri, 2 Nov 2018 22:20:24 +0800 Aaron Lu wrote: > >> > >> I think here is a problem - order 0 pages are freed directly to buddy, > >> bypassing per-cpu-pages. This

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-05 Thread Tariq Toukan
On 03/11/2018 2:53 PM, Jesper Dangaard Brouer wrote: > > On Fri, 2 Nov 2018 22:20:24 +0800 Aaron Lu wrote: > >> On Fri, Nov 02, 2018 at 12:40:37PM +0100, Jesper Dangaard Brouer wrote: >>> On Fri, 2 Nov 2018 13:23:56 +0800 >>> Aaron Lu wrote: >>> On Thu, Nov 01, 2018 at 08:23:19PM

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-04 Thread Aaron Lu
On Sat, Nov 03, 2018 at 01:53:25PM +0100, Jesper Dangaard Brouer wrote: > > On Fri, 2 Nov 2018 22:20:24 +0800 Aaron Lu wrote: > > > On Fri, Nov 02, 2018 at 12:40:37PM +0100, Jesper Dangaard Brouer wrote: > > > On Fri, 2 Nov 2018 13:23:56 +0800 > > > Aaron Lu wrote: > > > > > > > On Thu, Nov

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-03 Thread Paweł Staszewski
n W dniu 03.11.2018 o 18:32, David Ahern pisze: On 11/1/18 11:30 AM, Paweł Staszewski wrote: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/samples/bpf/xdp_fwd_kern.c I can try some tests on same hw but testlab configuration - will give it a try :) That

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-03 Thread David Ahern
On 11/1/18 11:30 AM, Paweł Staszewski wrote:   https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/samples/bpf/xdp_fwd_kern.c >>> I can try some tests on same hw but testlab configuration - will give it >>> a try :) >>> >> That version does not work with

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-03 Thread Paweł Staszewski
W dniu 03.11.2018 o 16:23, Paweł Staszewski pisze: W dniu 03.11.2018 o 13:58, Jesper Dangaard Brouer pisze: On Sat, 3 Nov 2018 01:16:08 +0100 Paweł Staszewski wrote: W dniu 02.11.2018 o 20:02, Paweł Staszewski pisze: W dniu 02.11.2018 o 15:20, Aaron Lu pisze: On Fri, Nov 02, 2018 at

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-03 Thread Paweł Staszewski
W dniu 03.11.2018 o 13:58, Jesper Dangaard Brouer pisze: On Sat, 3 Nov 2018 01:16:08 +0100 Paweł Staszewski wrote: W dniu 02.11.2018 o 20:02, Paweł Staszewski pisze: W dniu 02.11.2018 o 15:20, Aaron Lu pisze: On Fri, Nov 02, 2018 at 12:40:37PM +0100, Jesper Dangaard Brouer wrote: On

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-03 Thread Jesper Dangaard Brouer
On Sat, 3 Nov 2018 01:16:08 +0100 Paweł Staszewski wrote: > W dniu 02.11.2018 o 20:02, Paweł Staszewski pisze: > > > > > > W dniu 02.11.2018 o 15:20, Aaron Lu pisze: > >> On Fri, Nov 02, 2018 at 12:40:37PM +0100, Jesper Dangaard Brouer wrote: > >>> On Fri, 2 Nov 2018 13:23:56 +0800 > >>>

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-03 Thread Jesper Dangaard Brouer
On Fri, 2 Nov 2018 22:20:24 +0800 Aaron Lu wrote: > On Fri, Nov 02, 2018 at 12:40:37PM +0100, Jesper Dangaard Brouer wrote: > > On Fri, 2 Nov 2018 13:23:56 +0800 > > Aaron Lu wrote: > > > > > On Thu, Nov 01, 2018 at 08:23:19PM +, Saeed Mahameed wrote: > > > > On Thu, 2018-11-01 at

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-03 Thread Paweł Staszewski
W dniu 03.11.2018 o 01:16, Paweł Staszewski pisze: W dniu 02.11.2018 o 20:02, Paweł Staszewski pisze: W dniu 02.11.2018 o 15:20, Aaron Lu pisze: On Fri, Nov 02, 2018 at 12:40:37PM +0100, Jesper Dangaard Brouer wrote: On Fri, 2 Nov 2018 13:23:56 +0800 Aaron Lu wrote: On Thu, Nov 01,

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-02 Thread Paweł Staszewski
W dniu 01.11.2018 o 21:37, Saeed Mahameed pisze: On Thu, 2018-11-01 at 12:09 +0100, Paweł Staszewski wrote: W dniu 01.11.2018 o 10:50, Saeed Mahameed pisze: On Wed, 2018-10-31 at 22:57 +0100, Paweł Staszewski wrote: Hi So maybee someone will be interested how linux kernel handles normal

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-02 Thread Paweł Staszewski
W dniu 02.11.2018 o 20:02, Paweł Staszewski pisze: W dniu 02.11.2018 o 15:20, Aaron Lu pisze: On Fri, Nov 02, 2018 at 12:40:37PM +0100, Jesper Dangaard Brouer wrote: On Fri, 2 Nov 2018 13:23:56 +0800 Aaron Lu wrote: On Thu, Nov 01, 2018 at 08:23:19PM +, Saeed Mahameed wrote: On

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-02 Thread Paweł Staszewski
W dniu 02.11.2018 o 15:20, Aaron Lu pisze: On Fri, Nov 02, 2018 at 12:40:37PM +0100, Jesper Dangaard Brouer wrote: On Fri, 2 Nov 2018 13:23:56 +0800 Aaron Lu wrote: On Thu, Nov 01, 2018 at 08:23:19PM +, Saeed Mahameed wrote: On Thu, 2018-11-01 at 23:27 +0800, Aaron Lu wrote: On Thu,

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-02 Thread Aaron Lu
On Fri, Nov 02, 2018 at 12:40:37PM +0100, Jesper Dangaard Brouer wrote: > On Fri, 2 Nov 2018 13:23:56 +0800 > Aaron Lu wrote: > > > On Thu, Nov 01, 2018 at 08:23:19PM +, Saeed Mahameed wrote: > > > On Thu, 2018-11-01 at 23:27 +0800, Aaron Lu wrote: > > > > On Thu, Nov 01, 2018 at

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-02 Thread Jesper Dangaard Brouer
On Fri, 2 Nov 2018 13:23:56 +0800 Aaron Lu wrote: > On Thu, Nov 01, 2018 at 08:23:19PM +, Saeed Mahameed wrote: > > On Thu, 2018-11-01 at 23:27 +0800, Aaron Lu wrote: > > > On Thu, Nov 01, 2018 at 10:22:13AM +0100, Jesper Dangaard Brouer > > > wrote: > > > ... ... > > > > Section copied

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Aaron Lu
On Thu, Nov 01, 2018 at 08:23:19PM +, Saeed Mahameed wrote: > On Thu, 2018-11-01 at 23:27 +0800, Aaron Lu wrote: > > On Thu, Nov 01, 2018 at 10:22:13AM +0100, Jesper Dangaard Brouer > > wrote: > > ... ... > > > Section copied out: > > > > > > mlx5e_poll_tx_cq > > > | > > >

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Paweł Staszewski
W dniu 01.11.2018 o 22:24, Paweł Staszewski pisze: W dniu 01.11.2018 o 22:18, Paweł Staszewski pisze: W dniu 01.11.2018 o 21:37, Saeed Mahameed pisze: On Thu, 2018-11-01 at 12:09 +0100, Paweł Staszewski wrote: W dniu 01.11.2018 o 10:50, Saeed Mahameed pisze: On Wed, 2018-10-31 at

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Paweł Staszewski
W dniu 01.11.2018 o 22:18, Paweł Staszewski pisze: W dniu 01.11.2018 o 21:37, Saeed Mahameed pisze: On Thu, 2018-11-01 at 12:09 +0100, Paweł Staszewski wrote: W dniu 01.11.2018 o 10:50, Saeed Mahameed pisze: On Wed, 2018-10-31 at 22:57 +0100, Paweł Staszewski wrote: Hi So maybee

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Paweł Staszewski
W dniu 01.11.2018 o 21:37, Saeed Mahameed pisze: On Thu, 2018-11-01 at 12:09 +0100, Paweł Staszewski wrote: W dniu 01.11.2018 o 10:50, Saeed Mahameed pisze: On Wed, 2018-10-31 at 22:57 +0100, Paweł Staszewski wrote: Hi So maybee someone will be interested how linux kernel handles normal

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Saeed Mahameed
On Thu, 2018-11-01 at 12:09 +0100, Paweł Staszewski wrote: > > W dniu 01.11.2018 o 10:50, Saeed Mahameed pisze: > > On Wed, 2018-10-31 at 22:57 +0100, Paweł Staszewski wrote: > > > Hi > > > > > > So maybee someone will be interested how linux kernel handles > > > normal > > > traffic (not pktgen

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Saeed Mahameed
On Thu, 2018-11-01 at 23:27 +0800, Aaron Lu wrote: > On Thu, Nov 01, 2018 at 10:22:13AM +0100, Jesper Dangaard Brouer > wrote: > ... ... > > Section copied out: > > > > mlx5e_poll_tx_cq > > | > >--16.34%--napi_consume_skb > > | > >

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Paweł Staszewski
W dniu 01.11.2018 o 18:23, David Ahern pisze: On 11/1/18 7:52 AM, Paweł Staszewski wrote: W dniu 01.11.2018 o 11:55, Jesper Dangaard Brouer pisze: On Wed, 31 Oct 2018 21:37:16 -0600 David Ahern wrote: This is mainly a forwarding use case? Seems so based on the perf report. I suspect

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread David Ahern
On 11/1/18 7:52 AM, Paweł Staszewski wrote: > > > W dniu 01.11.2018 o 11:55, Jesper Dangaard Brouer pisze: >> On Wed, 31 Oct 2018 21:37:16 -0600 David Ahern wrote: >> >>> This is mainly a forwarding use case? Seems so based on the perf report. >>> I suspect forwarding with XDP would show pretty

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Paweł Staszewski
W dniu 01.11.2018 o 12:09, Paweł Staszewski pisze: rx_cqe_compress_pkts: 0 If this is a pcie bottleneck it might be useful to  enable CQE compression (to reduce PCIe completion descriptors transactions) you should see the above rx_cqe_compress_pkts increasing when enabled. $ ethtool 

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Aaron Lu
On Thu, Nov 01, 2018 at 10:22:13AM +0100, Jesper Dangaard Brouer wrote: ... ... > Section copied out: > > mlx5e_poll_tx_cq > | >--16.34%--napi_consume_skb > | > |--12.65%--__free_pages_ok > | | > |

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Paweł Staszewski
W dniu 01.11.2018 o 11:55, Jesper Dangaard Brouer pisze: On Wed, 31 Oct 2018 21:37:16 -0600 David Ahern wrote: This is mainly a forwarding use case? Seems so based on the perf report. I suspect forwarding with XDP would show pretty good improvement. Yes, significant performance

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Jesper Dangaard Brouer
On Wed, 31 Oct 2018 21:37:16 -0600 David Ahern wrote: > This is mainly a forwarding use case? Seems so based on the perf report. > I suspect forwarding with XDP would show pretty good improvement. Yes, significant performance improvements. Notice Davids talk: "Leveraging Kernel Tables with

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Paweł Staszewski
W dniu 01.11.2018 o 10:22, Jesper Dangaard Brouer pisze: On Wed, 31 Oct 2018 23:20:01 +0100 Paweł Staszewski wrote: W dniu 31.10.2018 o 23:09, Eric Dumazet pisze: On 10/31/2018 02:57 PM, Paweł Staszewski wrote: Hi So maybee someone will be interested how linux kernel handles normal

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Jesper Dangaard Brouer
On Wed, 31 Oct 2018 23:20:01 +0100 Paweł Staszewski wrote: > W dniu 31.10.2018 o 23:09, Eric Dumazet pisze: > > > > On 10/31/2018 02:57 PM, Paweł Staszewski wrote: > >> Hi > >> > >> So maybee someone will be interested how linux kernel handles > >> normal traffic (not pktgen :) ) Pawel is

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-10-31 Thread David Ahern
On 10/31/18 3:57 PM, Paweł Staszewski wrote: > Hi > > So maybee someone will be interested how linux kernel handles normal > traffic (not pktgen :) ) > > > Server HW configuration: > > CPU : Intel(R) Xeon(R) Gold 6132 CPU @ 2.60GHz > > NIC's: 2x 100G Mellanox ConnectX-4 (connected to x16 pcie

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-10-31 Thread Paweł Staszewski
W dniu 31.10.2018 o 23:20, Paweł Staszewski pisze: W dniu 31.10.2018 o 23:09, Eric Dumazet pisze: On 10/31/2018 02:57 PM, Paweł Staszewski wrote: Hi So maybee someone will be interested how linux kernel handles normal traffic (not pktgen :) ) Server HW configuration: CPU : Intel(R)

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-10-31 Thread Paweł Staszewski
W dniu 31.10.2018 o 23:09, Eric Dumazet pisze: On 10/31/2018 02:57 PM, Paweł Staszewski wrote: Hi So maybee someone will be interested how linux kernel handles normal traffic (not pktgen :) ) Server HW configuration: CPU : Intel(R) Xeon(R) Gold 6132 CPU @ 2.60GHz NIC's: 2x 100G

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-10-31 Thread Eric Dumazet
On 10/31/2018 02:57 PM, Paweł Staszewski wrote: > Hi > > So maybee someone will be interested how linux kernel handles normal traffic > (not pktgen :) ) > > > Server HW configuration: > > CPU : Intel(R) Xeon(R) Gold 6132 CPU @ 2.60GHz > > NIC's: 2x 100G Mellanox ConnectX-4 (connected to