Weird traces 4.20.0-rc3+ / RIP: 0010:fib6_walk_continue+0x37/0xe6

2018-11-30 Thread Paweł Staszewski
Traces attached below: [310658.536190] rcu: INFO: rcu_sched self-detected stall on CPU [310658.536195] rcu:    15-: (322 ticks this GP) idle=fca/1/0x4002 softirq=50617185/50617185 fqs=64 [310658.536195] rcu: (t=15049 jiffies g=84272013 q=4728) [310658.536200] NMI

Re: [Patch net] net: invert the check of detecting hardware RX checksum fault

2018-11-21 Thread Paweł Staszewski
W dniu 16.11.2018 o 21:06, Cong Wang pisze: On Thu, Nov 15, 2018 at 8:50 PM Herbert Xu wrote: On Thu, Nov 15, 2018 at 06:23:38PM -0800, Cong Wang wrote: Normally if the hardware's partial checksum is valid then we just trust it and send the packet along. However, if the partial checksum is

Re: consistency for statistics with XDP mode

2018-11-21 Thread Paweł Staszewski
W dniu 21.11.2018 o 22:14, Toke Høiland-Jørgensen pisze: David Ahern writes: Paweł ran some more XDP tests yesterday and from it found a couple of issues. One is a panic in the mlx5 driver unloading the bpf program (mlx5e_xdp_xmit); he will send a send a separate email for that problem.

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-20 Thread Paweł Staszewski
W dniu 19.11.2018 o 22:59, David Ahern pisze: On 11/9/18 5:06 PM, David Ahern wrote: On 11/9/18 9:21 AM, David Ahern wrote: Is there possible to add only counters from xdp for vlans ? This will help me in testing. I will take a look today at adding counters that you can dump using bpftool.

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-12 Thread Paweł Staszewski
W dniu 11.11.2018 o 09:56, Jesper Dangaard Brouer pisze: On Sat, 10 Nov 2018 22:53:53 +0100 Paweł Staszewski wrote: Now im messing with ring configuration for connectx5 nics. And after reading that paper: https://netdevconf.org/2.1/slides/apr6/network-performance/04-amir

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-11 Thread Paweł Staszewski
W dniu 11.11.2018 o 09:03, Jesper Dangaard Brouer pisze: On Sat, 10 Nov 2018 23:19:50 +0100 Paweł Staszewski wrote: W dniu 10.11.2018 o 23:06, Jesper Dangaard Brouer pisze: On Sat, 10 Nov 2018 20:56:02 +0100 Paweł Staszewski wrote: W dniu 10.11.2018 o 20:49, Paweł Staszewski pisze

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-10 Thread Paweł Staszewski
W dniu 10.11.2018 o 23:06, Jesper Dangaard Brouer pisze: On Sat, 10 Nov 2018 20:56:02 +0100 Paweł Staszewski wrote: W dniu 10.11.2018 o 20:49, Paweł Staszewski pisze: W dniu 10.11.2018 o 20:34, Jesper Dangaard Brouer pisze: On Fri, 9 Nov 2018 23:20:38 +0100 Paweł Staszewski wrote

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-10 Thread Paweł Staszewski
W dniu 10.11.2018 o 22:53, Paweł Staszewski pisze: W dniu 10.11.2018 o 22:01, Jesper Dangaard Brouer pisze: On Sat, 10 Nov 2018 21:02:10 +0100 Paweł Staszewski wrote: W dniu 10.11.2018 o 20:34, Jesper Dangaard Brouer pisze: I want you to experiment with:    ethtool --set-priv-flags

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-10 Thread Paweł Staszewski
W dniu 10.11.2018 o 22:01, Jesper Dangaard Brouer pisze: On Sat, 10 Nov 2018 21:02:10 +0100 Paweł Staszewski wrote: W dniu 10.11.2018 o 20:34, Jesper Dangaard Brouer pisze: I want you to experiment with: ethtool --set-priv-flags DEVICE rx_striding_rq off just checked that previously

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-10 Thread Paweł Staszewski
W dniu 10.11.2018 o 20:34, Jesper Dangaard Brouer pisze: I want you to experiment with: ethtool --set-priv-flags DEVICE rx_striding_rq off just checked that previously connectx4 was have thos disabled:  ethtool --show-priv-flags enp175s0f0 Private flags for enp175s0f0: rx_cqe_moder  

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-10 Thread Paweł Staszewski
W dniu 10.11.2018 o 20:49, Paweł Staszewski pisze: W dniu 10.11.2018 o 20:34, Jesper Dangaard Brouer pisze: On Fri, 9 Nov 2018 23:20:38 +0100 Paweł Staszewski wrote: W dniu 08.11.2018 o 20:12, Paweł Staszewski pisze: CPU load is lower than for connectx4 - but it looks like bandwidth

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-10 Thread Paweł Staszewski
W dniu 10.11.2018 o 20:34, Jesper Dangaard Brouer pisze: On Fri, 9 Nov 2018 23:20:38 +0100 Paweł Staszewski wrote: W dniu 08.11.2018 o 20:12, Paweł Staszewski pisze: CPU load is lower than for connectx4 - but it looks like bandwidth limit is the same :) But also after reaching 60Gbit

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-10 Thread Paweł Staszewski
W dniu 10.11.2018 o 01:06, David Ahern pisze: On 11/9/18 9:21 AM, David Ahern wrote: Is there possible to add only counters from xdp for vlans ? This will help me in testing. I will take a look today at adding counters that you can dump using bpftool. It will be a temporary solution for

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-09 Thread Paweł Staszewski
W dniu 08.11.2018 o 20:12, Paweł Staszewski pisze: CPU load is lower than for connectx4 - but it looks like bandwidth limit is the same :) But also after reaching 60Gbit/60Gbit  bwm-ng v0.6.1 (probing every 1.000s), press 'h' for help   input: /proc/net/dev type: rate   - iface

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-09 Thread Paweł Staszewski
W dniu 09.11.2018 o 17:21, David Ahern pisze: On 11/9/18 3:20 AM, Paweł Staszewski wrote: I just catch some weird behavior :) All was working fine for about 20k packets Then after xdp start to forward every 10 packets Interesting. Any counter showing drops? nothing that will fit NIC

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-09 Thread Paweł Staszewski
W dniu 08.11.2018 o 17:06, David Ahern pisze: On 11/8/18 6:33 AM, Paweł Staszewski wrote: W dniu 07.11.2018 o 22:06, David Ahern pisze: On 11/3/18 6:24 PM, Paweł Staszewski wrote: Does your setup have any other device types besides physical ports with VLANs (e.g., any macvlans or bonds

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-09 Thread Paweł Staszewski
W dniu 09.11.2018 o 05:52, Saeed Mahameed pisze: On Thu, 2018-11-08 at 17:42 -0700, David Ahern wrote: On 11/8/18 5:40 PM, Paweł Staszewski wrote: W dniu 08.11.2018 o 17:32, David Ahern pisze: On 11/8/18 9:27 AM, Paweł Staszewski wrote: What hardware is this? mellanox connectx 4 ethtool

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread Paweł Staszewski
W dniu 08.11.2018 o 17:32, David Ahern pisze: On 11/8/18 9:27 AM, Paweł Staszewski wrote: What hardware is this? mellanox connectx 4 ethtool -i enp175s0f0 driver: mlx5_core version: 5.0-0 firmware-version: 12.21.1000 (SM_200101033) expansion-rom-version: bus-info: :af:00.0 supports

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread Paweł Staszewski
W dniu 03.11.2018 o 01:18, Paweł Staszewski pisze: W dniu 01.11.2018 o 21:37, Saeed Mahameed pisze: On Thu, 2018-11-01 at 12:09 +0100, Paweł Staszewski wrote: W dniu 01.11.2018 o 10:50, Saeed Mahameed pisze: On Wed, 2018-10-31 at 22:57 +0100, Paweł Staszewski wrote: Hi So maybee

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread Paweł Staszewski
W dniu 08.11.2018 o 17:32, David Ahern pisze: On 11/8/18 9:27 AM, Paweł Staszewski wrote: What hardware is this? mellanox connectx 4 ethtool -i enp175s0f0 driver: mlx5_core version: 5.0-0 firmware-version: 12.21.1000 (SM_200101033) expansion-rom-version: bus-info: :af:00.0 supports

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread Paweł Staszewski
W dniu 08.11.2018 o 17:25, Paweł Staszewski pisze: W dniu 08.11.2018 o 17:06, David Ahern pisze: On 11/8/18 6:33 AM, Paweł Staszewski wrote: W dniu 07.11.2018 o 22:06, David Ahern pisze: On 11/3/18 6:24 PM, Paweł Staszewski wrote: Does your setup have any other device types besides

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread Paweł Staszewski
W dniu 08.11.2018 o 17:06, David Ahern pisze: On 11/8/18 6:33 AM, Paweł Staszewski wrote: W dniu 07.11.2018 o 22:06, David Ahern pisze: On 11/3/18 6:24 PM, Paweł Staszewski wrote: Does your setup have any other device types besides physical ports with VLANs (e.g., any macvlans or bonds

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread Paweł Staszewski
W dniu 08.11.2018 o 01:59, Paweł Staszewski pisze: W dniu 05.11.2018 o 21:17, Jesper Dangaard Brouer pisze: On Sun, 4 Nov 2018 01:24:03 +0100 Paweł Staszewski wrote: And today again after allpy patch for page allocator - reached again 64/64 Gbit/s with only 50-60% cpu load Great

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-08 Thread Paweł Staszewski
W dniu 07.11.2018 o 22:06, David Ahern pisze: On 11/3/18 6:24 PM, Paweł Staszewski wrote: Does your setup have any other device types besides physical ports with VLANs (e.g., any macvlans or bonds)? no. just phy(mlnx)->vlans only config VLAN and non-VLAN (and a mix) seem to work

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-07 Thread Paweł Staszewski
W dniu 08.11.2018 o 01:59, Paweł Staszewski pisze: W dniu 05.11.2018 o 21:17, Jesper Dangaard Brouer pisze: On Sun, 4 Nov 2018 01:24:03 +0100 Paweł Staszewski wrote: And today again after allpy patch for page allocator - reached again 64/64 Gbit/s with only 50-60% cpu load Great

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-07 Thread Paweł Staszewski
W dniu 05.11.2018 o 21:17, Jesper Dangaard Brouer pisze: On Sun, 4 Nov 2018 01:24:03 +0100 Paweł Staszewski wrote: And today again after allpy patch for page allocator - reached again 64/64 Gbit/s with only 50-60% cpu load Great. today no slowpath hit for netwoking :) But again

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-03 Thread Paweł Staszewski
n W dniu 03.11.2018 o 18:32, David Ahern pisze: On 11/1/18 11:30 AM, Paweł Staszewski wrote: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/samples/bpf/xdp_fwd_kern.c I can try some tests on same hw but testlab configuration - will give it a try

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-03 Thread Paweł Staszewski
W dniu 03.11.2018 o 16:23, Paweł Staszewski pisze: W dniu 03.11.2018 o 13:58, Jesper Dangaard Brouer pisze: On Sat, 3 Nov 2018 01:16:08 +0100 Paweł Staszewski wrote: W dniu 02.11.2018 o 20:02, Paweł Staszewski pisze: W dniu 02.11.2018 o 15:20, Aaron Lu pisze: On Fri, Nov 02, 2018

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-03 Thread Paweł Staszewski
W dniu 03.11.2018 o 13:58, Jesper Dangaard Brouer pisze: On Sat, 3 Nov 2018 01:16:08 +0100 Paweł Staszewski wrote: W dniu 02.11.2018 o 20:02, Paweł Staszewski pisze: W dniu 02.11.2018 o 15:20, Aaron Lu pisze: On Fri, Nov 02, 2018 at 12:40:37PM +0100, Jesper Dangaard Brouer wrote

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-03 Thread Paweł Staszewski
W dniu 03.11.2018 o 01:16, Paweł Staszewski pisze: W dniu 02.11.2018 o 20:02, Paweł Staszewski pisze: W dniu 02.11.2018 o 15:20, Aaron Lu pisze: On Fri, Nov 02, 2018 at 12:40:37PM +0100, Jesper Dangaard Brouer wrote: On Fri, 2 Nov 2018 13:23:56 +0800 Aaron Lu wrote: On Thu, Nov 01

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-02 Thread Paweł Staszewski
W dniu 01.11.2018 o 21:37, Saeed Mahameed pisze: On Thu, 2018-11-01 at 12:09 +0100, Paweł Staszewski wrote: W dniu 01.11.2018 o 10:50, Saeed Mahameed pisze: On Wed, 2018-10-31 at 22:57 +0100, Paweł Staszewski wrote: Hi So maybee someone will be interested how linux kernel handles normal

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-02 Thread Paweł Staszewski
W dniu 02.11.2018 o 20:02, Paweł Staszewski pisze: W dniu 02.11.2018 o 15:20, Aaron Lu pisze: On Fri, Nov 02, 2018 at 12:40:37PM +0100, Jesper Dangaard Brouer wrote: On Fri, 2 Nov 2018 13:23:56 +0800 Aaron Lu wrote: On Thu, Nov 01, 2018 at 08:23:19PM +, Saeed Mahameed wrote

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-02 Thread Paweł Staszewski
W dniu 02.11.2018 o 15:20, Aaron Lu pisze: On Fri, Nov 02, 2018 at 12:40:37PM +0100, Jesper Dangaard Brouer wrote: On Fri, 2 Nov 2018 13:23:56 +0800 Aaron Lu wrote: On Thu, Nov 01, 2018 at 08:23:19PM +, Saeed Mahameed wrote: On Thu, 2018-11-01 at 23:27 +0800, Aaron Lu wrote: On Thu,

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Paweł Staszewski
W dniu 01.11.2018 o 22:24, Paweł Staszewski pisze: W dniu 01.11.2018 o 22:18, Paweł Staszewski pisze: W dniu 01.11.2018 o 21:37, Saeed Mahameed pisze: On Thu, 2018-11-01 at 12:09 +0100, Paweł Staszewski wrote: W dniu 01.11.2018 o 10:50, Saeed Mahameed pisze: On Wed, 2018-10-31 at 22

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Paweł Staszewski
W dniu 01.11.2018 o 22:18, Paweł Staszewski pisze: W dniu 01.11.2018 o 21:37, Saeed Mahameed pisze: On Thu, 2018-11-01 at 12:09 +0100, Paweł Staszewski wrote: W dniu 01.11.2018 o 10:50, Saeed Mahameed pisze: On Wed, 2018-10-31 at 22:57 +0100, Paweł Staszewski wrote: Hi So maybee

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Paweł Staszewski
W dniu 01.11.2018 o 21:37, Saeed Mahameed pisze: On Thu, 2018-11-01 at 12:09 +0100, Paweł Staszewski wrote: W dniu 01.11.2018 o 10:50, Saeed Mahameed pisze: On Wed, 2018-10-31 at 22:57 +0100, Paweł Staszewski wrote: Hi So maybee someone will be interested how linux kernel handles normal

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Paweł Staszewski
W dniu 01.11.2018 o 18:23, David Ahern pisze: On 11/1/18 7:52 AM, Paweł Staszewski wrote: W dniu 01.11.2018 o 11:55, Jesper Dangaard Brouer pisze: On Wed, 31 Oct 2018 21:37:16 -0600 David Ahern wrote: This is mainly a forwarding use case? Seems so based on the perf report. I suspect

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Paweł Staszewski
W dniu 01.11.2018 o 12:09, Paweł Staszewski pisze: rx_cqe_compress_pkts: 0 If this is a pcie bottleneck it might be useful to  enable CQE compression (to reduce PCIe completion descriptors transactions) you should see the above rx_cqe_compress_pkts increasing when enabled. $ ethtool  --set

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Paweł Staszewski
W dniu 01.11.2018 o 11:55, Jesper Dangaard Brouer pisze: On Wed, 31 Oct 2018 21:37:16 -0600 David Ahern wrote: This is mainly a forwarding use case? Seems so based on the perf report. I suspect forwarding with XDP would show pretty good improvement. Yes, significant performance

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-11-01 Thread Paweł Staszewski
W dniu 01.11.2018 o 10:22, Jesper Dangaard Brouer pisze: On Wed, 31 Oct 2018 23:20:01 +0100 Paweł Staszewski wrote: W dniu 31.10.2018 o 23:09, Eric Dumazet pisze: On 10/31/2018 02:57 PM, Paweł Staszewski wrote: Hi So maybee someone will be interested how linux kernel handles normal

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-10-31 Thread Paweł Staszewski
W dniu 31.10.2018 o 23:20, Paweł Staszewski pisze: W dniu 31.10.2018 o 23:09, Eric Dumazet pisze: On 10/31/2018 02:57 PM, Paweł Staszewski wrote: Hi So maybee someone will be interested how linux kernel handles normal traffic (not pktgen :) ) Server HW configuration: CPU : Intel(R

Re: Kernel 4.19 network performance - forwarding/routing normal users traffic

2018-10-31 Thread Paweł Staszewski
W dniu 31.10.2018 o 23:09, Eric Dumazet pisze: On 10/31/2018 02:57 PM, Paweł Staszewski wrote: Hi So maybee someone will be interested how linux kernel handles normal traffic (not pktgen :) ) Server HW configuration: CPU : Intel(R) Xeon(R) Gold 6132 CPU @ 2.60GHz NIC's: 2x 100G

Re: Latest net-next kernel 4.19.0+

2018-10-31 Thread Paweł Staszewski
W dniu 30.10.2018 o 15:16, Eric Dumazet pisze: On 10/30/2018 01:09 AM, Paweł Staszewski wrote: W dniu 30.10.2018 o 08:29, Eric Dumazet pisze: On 10/29/2018 11:09 PM, Dimitris Michailidis wrote: Indeed this is a bug. I would expect it to produce frequent errors though as many odd-length

Re: Latest net-next kernel 4.19.0+

2018-10-31 Thread Paweł Staszewski
W dniu 31.10.2018 o 22:05, Saeed Mahameed pisze: On Tue, 2018-10-30 at 10:32 -0700, Cong Wang wrote: On Tue, Oct 30, 2018 at 7:16 AM Eric Dumazet wrote: On 10/30/2018 01:09 AM, Paweł Staszewski wrote: W dniu 30.10.2018 o 08:29, Eric Dumazet pisze: On 10/29/2018 11:09 PM, Dimitris

Re: Latest net-next kernel 4.19.0+

2018-10-30 Thread Paweł Staszewski
W dniu 30.10.2018 o 08:29, Eric Dumazet pisze: On 10/29/2018 11:09 PM, Dimitris Michailidis wrote: Indeed this is a bug. I would expect it to produce frequent errors though as many odd-length packets would trigger it. Do you have RXFCS? Regardless, how frequently do you see the problem?

Re: Latest net-next kernel 4.19.0+

2018-10-29 Thread Paweł Staszewski
W dniu 30.10.2018 o 01:11, Paweł Staszewski pisze: Sorry not complete - followed by hw csum: [  342.190831] vlan1490: hw csum failure [  342.190835] CPU: 52 PID: 0 Comm: swapper/52 Not tainted 4.19.0+ #1 [  342.190836] Call Trace: [  342.190839]  [  342.190849]  dump_stack+0x46/0x5b

Re: Latest net-next kernel 4.19.0+

2018-10-29 Thread Paweł Staszewski
00 R15: [  342.190929]  do_idle+0x1a3/0x1c0 [  342.190931]  cpu_startup_entry+0x14/0x20 [  342.190934]  start_secondary+0x165/0x190 [  342.190939]  secondary_startup_64+0xa4/0xb0 W dniu 30.10.2018 o 01:10, Paweł Staszewski pisze: Hi Just checked in test lab latest kernel and have weird

Latest net-next kernel 4.19.0+

2018-10-29 Thread Paweł Staszewski
Hi Just checked in test lab latest kernel and have weird traces: [  219.888673] CPU: 52 PID: 0 Comm: swapper/52 Not tainted 4.19.0+ #1 [  219.888674] Call Trace: [  219.888676]  [  219.888685]  dump_stack+0x46/0x5b [  219.888691]  __skb_checksum_complete+0x9a/0xa0 [  219.888694] 

Re: after adding > 200vlans to mlx nic no traffic

2018-02-01 Thread Paweł Staszewski
W dniu 31.01.2018 o 13:19, Gal Pressman pisze: On 30-Jan-18 17:57, Paweł Staszewski wrote: W dniu 30.01.2018 o 15:57, Gal Pressman pisze: On 30-Jan-18 02:29, Paweł Staszewski wrote: Weird thing with mellanox mlx5 (connectx-4) kernel 4.15-rc9 - from net-next davem tree after: ip link

Re: after adding > 200vlans to mlx nic no traffic

2018-01-30 Thread Paweł Staszewski
W dniu 30.01.2018 o 15:57, Gal Pressman pisze: On 30-Jan-18 02:29, Paweł Staszewski wrote: Weird thing with mellanox mlx5 (connectx-4) kernel 4.15-rc9 - from net-next davem tree after: ip link add link enp175s0f1 name vlan1538 type vlan id 1538 ip link set up dev vlan1538 traffic

after adding > 200vlans to mlx nic no traffic

2018-01-29 Thread Paweł Staszewski
Weird thing with mellanox mlx5 (connectx-4) kernel 4.15-rc9 - from net-next davem tree after: ip link add link enp175s0f1 name vlan1538 type vlan id 1538 ip link set up dev vlan1538 traffic on vlan is working But after VID="1160 1450 1451 1452 1453 1454 1455 1456 1457 1458 1459 1460

xdp_router_ipv4 mellanox problem

2018-01-29 Thread Paweł Staszewski
Hi Want to do some tests with xdp_router on two 100G physical interfaces but: Jan 29 17:00:40 HOST kernel: mlx5_core :af:00.0: MLX5E: StrdRq(0) RqSz(1024) StrdSz(1) RxCqeCmprss(0) Jan 29 17:00:40 HOST kernel: mlx5_core :af:00.0 enp175s0f0: Link up Jan 29 17:00:41 HOST kernel:

Re: kernel 4.15.0-rc9+ (net-next) high cpu load at 50Gbit/s - about 6Mpps

2018-01-28 Thread Paweł Staszewski
W dniu 27.01.2018 o 23:23, Paweł Staszewski pisze: Hi Today I made some real life traffic tests with kernel 4.15.0-rc9 but when traffic reach 50Gbit/s and about 6Mpps cpou load rises fast from 48% to 100% for all cpu cores. Here is some graph that presenting how cpu load rises when

kernel 4.15.0-rc9+ (net-next) high cpu load at 50Gbit/s - about 6Mpps

2018-01-27 Thread Paweł Staszewski
Hi Today I made some real life traffic tests with kernel 4.15.0-rc9 but when traffic reach 50Gbit/s and about 6Mpps cpou load rises fast from 48% to 100% for all cpu cores. Here is some graph that presenting how cpu load rises when there was more pps. https://ibb.co/mhD5ob here is

Re: Huge memory leak with 4.15.0-rc2+

2017-12-12 Thread Paweł Staszewski
W dniu 2017-12-11 o 23:27, Paweł Staszewski pisze: W dniu 2017-12-11 o 23:15, John Fastabend pisze: On 12/11/2017 01:48 PM, Paweł Staszewski wrote: W dniu 2017-12-11 o 22:23, Paweł Staszewski pisze: Hi I just upgraded some testing host to 4.15.0-rc2+ kernel And after some time

Re: Huge memory leak with 4.15.0-rc2+

2017-12-11 Thread Paweł Staszewski
W dniu 2017-12-11 o 23:15, John Fastabend pisze: On 12/11/2017 01:48 PM, Paweł Staszewski wrote: W dniu 2017-12-11 o 22:23, Paweł Staszewski pisze: Hi I just upgraded some testing host to 4.15.0-rc2+ kernel And after some time of traffic processing - when traffic on all ports reach about

Re: Huge memory leak with 4.15.0-rc2+

2017-12-11 Thread Paweł Staszewski
W dniu 2017-12-11 o 22:23, Paweł Staszewski pisze: Hi I just upgraded some testing host to 4.15.0-rc2+ kernel And after some time of traffic processing - when traffic on all ports reach about 3Mpps - memleak started. Graph attached from memory usage: https://ibb.co/idK4zb HW config

Huge memory leak with 4.15.0-rc2+

2017-12-11 Thread Paweł Staszewski
Hi I just upgraded some testing host to 4.15.0-rc2+ kernel And after some time of traffic processing - when traffic on all ports reach about 3Mpps - memleak started. Graph attached from memory usage: https://ibb.co/idK4zb HW config: Intel E5 8x Intel 82599 (used ixgbe driver from

Re: [Intel-wired-lan] Instability of i40e driver on 4.9 kernel

2017-10-27 Thread Paweł Staszewski
e1000 sourceforge is a bad place to make anything with Your problems Just checked this now if something changed :) But when I post reply to some bug that i was have same problem somebody closed the ticket and delete my message :) So rly :) W dniu 2017-10-25 o 23:49, Pavlos Parissis

Re: intel i40e buggy driver question

2017-10-27 Thread Paweł Staszewski
W dniu 2017-10-28 o 00:34, Paweł Staszewski pisze: Hi I have many problems with 40e driver memleaks , kernel panics , stack traces , tx hungx , tx timeouts and many many others :) But the main problem that can't be resolved in linux is resolved in freebsd problem in freebsd

intel i40e buggy driver question

2017-10-27 Thread Paweł Staszewski
Hi I have many problems with 40e driver memleaks , kernel panics , stack traces , tx hungx , tx timeouts and many many others :) But the main problem that can't be resolved in linux is resolved in freebsd problem in freebsd with this: [2501243.181829] i40e :01:00.1 eno2: VSI_seid

Re: [Intel-wired-lan] [jkirsher/net-queue PATCH] i40e: Add programming descriptors to cleaned_count

2017-10-27 Thread Paweł Staszewski
pisze: On 23 October 2017 at 01:15, Paweł Staszewski <pstaszew...@itcare.pl> wrote: Yes can confirm that after adding patch: [jkirsher/net-queue PATCH] i40e: Add programming descriptors to cleaned_count There is no memleak. Somehow this patch isn't present in the current net-nex

Re: [jkirsher/net-queue PATCH] i40e: Add programming descriptors to cleaned_count

2017-10-22 Thread Paweł Staszewski
Yes can confirm that after adding patch: [jkirsher/net-queue PATCH] i40e: Add programming descriptors to cleaned_count There is no memleak. W dniu 2017-10-22 o 20:01, Anders K. Pedersen | Cohaesio pisze: On lør, 2017-10-21 at 18:12 -0700, Alexander Duyck wrote: From: Alexander Duyck

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-18 Thread Paweł Staszewski
W dniu 2017-10-19 o 01:56, Paweł Staszewski pisze: W dniu 2017-10-19 o 01:51, Paweł Staszewski pisze: W dniu 2017-10-19 o 01:37, Alexander Duyck pisze: On Wed, Oct 18, 2017 at 4:22 PM, Paweł Staszewski <pstaszew...@itcare.pl> wrote: W dniu 2017-10-19 o 00:58, Paweł Staszewski

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-18 Thread Paweł Staszewski
W dniu 2017-10-19 o 01:51, Paweł Staszewski pisze: W dniu 2017-10-19 o 01:37, Alexander Duyck pisze: On Wed, Oct 18, 2017 at 4:22 PM, Paweł Staszewski <pstaszew...@itcare.pl> wrote: W dniu 2017-10-19 o 00:58, Paweł Staszewski pisze: W dniu 2017-10-19 o 00:50, Paweł Staszewski

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-18 Thread Paweł Staszewski
W dniu 2017-10-19 o 01:37, Alexander Duyck pisze: On Wed, Oct 18, 2017 at 4:22 PM, Paweł Staszewski <pstaszew...@itcare.pl> wrote: W dniu 2017-10-19 o 00:58, Paweł Staszewski pisze: W dniu 2017-10-19 o 00:50, Paweł Staszewski pisze: W dniu 2017-10-19 o 00:20, Paweł Staszewski

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-18 Thread Paweł Staszewski
W dniu 2017-10-19 o 01:29, Alexander Duyck pisze: On Mon, Oct 16, 2017 at 10:51 PM, Vitezslav Samel <vitezs...@samel.cz> wrote: On Tue, Oct 17, 2017 at 01:34:29AM +0200, Paweł Staszewski wrote: W dniu 2017-10-16 o 18:26, Paweł Staszewski pisze: W dniu 2017-10-16 o 13:20, Pavlos Pa

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-18 Thread Paweł Staszewski
W dniu 2017-10-19 o 00:58, Paweł Staszewski pisze: W dniu 2017-10-19 o 00:50, Paweł Staszewski pisze: W dniu 2017-10-19 o 00:20, Paweł Staszewski pisze: W dniu 2017-10-18 o 17:44, Paweł Staszewski pisze: W dniu 2017-10-17 o 16:08, Paweł Staszewski pisze: W dniu 2017-10-17 o 13:52

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-18 Thread Paweł Staszewski
W dniu 2017-10-19 o 00:50, Paweł Staszewski pisze: W dniu 2017-10-19 o 00:20, Paweł Staszewski pisze: W dniu 2017-10-18 o 17:44, Paweł Staszewski pisze: W dniu 2017-10-17 o 16:08, Paweł Staszewski pisze: W dniu 2017-10-17 o 13:52, Paweł Staszewski pisze: W dniu 2017-10-17 o 13:05

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-18 Thread Paweł Staszewski
W dniu 2017-10-19 o 00:20, Paweł Staszewski pisze: W dniu 2017-10-18 o 17:44, Paweł Staszewski pisze: W dniu 2017-10-17 o 16:08, Paweł Staszewski pisze: W dniu 2017-10-17 o 13:52, Paweł Staszewski pisze: W dniu 2017-10-17 o 13:05, Paweł Staszewski pisze: W dniu 2017-10-17 o 12:59

Re: Kernel 4.13.0-rc4-next-20170811 - IP Routing / Forwarding performance vs Core/RSS number / HT on

2017-10-18 Thread Paweł Staszewski
W dniu 2017-10-18 o 23:54, Eric Dumazet pisze: On Wed, 2017-10-18 at 23:49 +0200, Paweł Staszewski wrote: How far it is from applying this to the kernel ? So far im using this on all my servers from about 3 months now without problems It is a hack, and does not support properly bonding

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-18 Thread Paweł Staszewski
W dniu 2017-10-18 o 17:44, Paweł Staszewski pisze: W dniu 2017-10-17 o 16:08, Paweł Staszewski pisze: W dniu 2017-10-17 o 13:52, Paweł Staszewski pisze: W dniu 2017-10-17 o 13:05, Paweł Staszewski pisze: W dniu 2017-10-17 o 12:59, Paweł Staszewski pisze: W dniu 2017-10-17 o 12:51

Re: Kernel 4.13.0-rc4-next-20170811 - IP Routing / Forwarding performance vs Core/RSS number / HT on

2017-10-18 Thread Paweł Staszewski
W dniu 2017-09-21 o 23:41, Florian Fainelli pisze: On 09/21/2017 02:26 PM, Paweł Staszewski wrote: W dniu 2017-08-15 o 11:11, Paweł Staszewski pisze: diff --git a/net/8021q/vlan_netlink.c b/net/8021q/vlan_netlink.c index 5e831de3103e2f7092c7fa15534def403bc62fb4

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-18 Thread Paweł Staszewski
W dniu 2017-10-17 o 16:08, Paweł Staszewski pisze: W dniu 2017-10-17 o 13:52, Paweł Staszewski pisze: W dniu 2017-10-17 o 13:05, Paweł Staszewski pisze: W dniu 2017-10-17 o 12:59, Paweł Staszewski pisze: W dniu 2017-10-17 o 12:51, Paweł Staszewski pisze: W dniu 2017-10-17 o 12:20

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-17 Thread Paweł Staszewski
W dniu 2017-10-17 o 13:52, Paweł Staszewski pisze: W dniu 2017-10-17 o 13:05, Paweł Staszewski pisze: W dniu 2017-10-17 o 12:59, Paweł Staszewski pisze: W dniu 2017-10-17 o 12:51, Paweł Staszewski pisze: W dniu 2017-10-17 o 12:20, Paweł Staszewski pisze: W dniu 2017-10-17 o 11:48

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-17 Thread Paweł Staszewski
W dniu 2017-10-17 o 13:05, Paweł Staszewski pisze: W dniu 2017-10-17 o 12:59, Paweł Staszewski pisze: W dniu 2017-10-17 o 12:51, Paweł Staszewski pisze: W dniu 2017-10-17 o 12:20, Paweł Staszewski pisze: W dniu 2017-10-17 o 11:48, Paweł Staszewski pisze: W dniu 2017-10-17 o 02:44

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-17 Thread Paweł Staszewski
W dniu 2017-10-17 o 12:59, Paweł Staszewski pisze: W dniu 2017-10-17 o 12:51, Paweł Staszewski pisze: W dniu 2017-10-17 o 12:20, Paweł Staszewski pisze: W dniu 2017-10-17 o 11:48, Paweł Staszewski pisze: W dniu 2017-10-17 o 02:44, Paweł Staszewski pisze: W dniu 2017-10-17 o 01:56

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-17 Thread Paweł Staszewski
W dniu 2017-10-17 o 12:51, Paweł Staszewski pisze: W dniu 2017-10-17 o 12:20, Paweł Staszewski pisze: W dniu 2017-10-17 o 11:48, Paweł Staszewski pisze: W dniu 2017-10-17 o 02:44, Paweł Staszewski pisze: W dniu 2017-10-17 o 01:56, Alexander Duyck pisze: On Mon, Oct 16, 2017 at 4:34

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-17 Thread Paweł Staszewski
W dniu 2017-10-17 o 12:20, Paweł Staszewski pisze: W dniu 2017-10-17 o 11:48, Paweł Staszewski pisze: W dniu 2017-10-17 o 02:44, Paweł Staszewski pisze: W dniu 2017-10-17 o 01:56, Alexander Duyck pisze: On Mon, Oct 16, 2017 at 4:34 PM, Paweł Staszewski <pstaszew...@itcare.pl>

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-17 Thread Paweł Staszewski
W dniu 2017-10-17 o 11:48, Paweł Staszewski pisze: W dniu 2017-10-17 o 02:44, Paweł Staszewski pisze: W dniu 2017-10-17 o 01:56, Alexander Duyck pisze: On Mon, Oct 16, 2017 at 4:34 PM, Paweł Staszewski <pstaszew...@itcare.pl> wrote: W dniu 2017-10-16 o 18:26, Paweł Staszewski

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-17 Thread Paweł Staszewski
W dniu 2017-10-17 o 02:44, Paweł Staszewski pisze: W dniu 2017-10-17 o 01:56, Alexander Duyck pisze: On Mon, Oct 16, 2017 at 4:34 PM, Paweł Staszewski <pstaszew...@itcare.pl> wrote: W dniu 2017-10-16 o 18:26, Paweł Staszewski pisze: W dniu 2017-10-16 o 13:20, Pavlos Parissis

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-16 Thread Paweł Staszewski
W dniu 2017-10-17 o 01:56, Alexander Duyck pisze: On Mon, Oct 16, 2017 at 4:34 PM, Paweł Staszewski <pstaszew...@itcare.pl> wrote: W dniu 2017-10-16 o 18:26, Paweł Staszewski pisze: W dniu 2017-10-16 o 13:20, Pavlos Parissis pisze: On 15/10/2017 02:58 πμ, Alexander Duyck wrote: Hi

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-16 Thread Paweł Staszewski
W dniu 2017-10-16 o 18:26, Paweł Staszewski pisze: W dniu 2017-10-16 o 13:20, Pavlos Parissis pisze: On 15/10/2017 02:58 πμ, Alexander Duyck wrote: Hi Pawel, To clarify is that Dave Miller's tree or Linus's that you are talking about? If it is Dave's tree how long ago was it you pulled

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-16 Thread Paweł Staszewski
W dniu 2017-10-16 o 13:20, Pavlos Parissis pisze: On 15/10/2017 02:58 πμ, Alexander Duyck wrote: Hi Pawel, To clarify is that Dave Miller's tree or Linus's that you are talking about? If it is Dave's tree how long ago was it you pulled it since I think the fix was just pushed by Jeff Kirsher

Re: Linux 4.12+ memory leak on router with i40e NICs

2017-10-15 Thread Paweł Staszewski
st pushed by Jeff Kirsher a few days ago. The issue should be fixed in the following commit: https://git.kernel.org/pub/scm/linux/kernel/git/davem/net.git/commit/drivers/net/ethernet/intel/i40e/i40e_txrx.c?id=2b9478ffc550f17c6cd8c69057234e91150f5972 Thanks. - Alex On Sat, Oct 14, 2017 at 3:0

Re: Latest kernel net-next - 4.14-rc1+ / WARNING: CPU: 16 PID: 0 at net/sched/sch_hfsc.c:1385 hfsc_dequeue+0x241/0x269

2017-09-26 Thread Paweł Staszewski
trace 8558fb6f1ca3beb0 ]--- W dniu 2017-09-26 o 14:00, Paweł Staszewski pisze: [50102.787542] [ cut here ] [50102.787545] WARNING: CPU: 16 PID: 0 at net/sched/sch_hfsc.c:1385 hfsc_dequeue+0x241/0x269 [50102.787545] Modules linked in: ipmi_si x86_pkg_temp_thermal [50102.78754

Latest kernel net-next - 4.14-rc1+ / WARNING: CPU: 16 PID: 0 at net/sched/sch_hfsc.c:1385 hfsc_dequeue+0x241/0x269

2017-09-26 Thread Paweł Staszewski
[50102.787542] [ cut here ] [50102.787545] WARNING: CPU: 16 PID: 0 at net/sched/sch_hfsc.c:1385 hfsc_dequeue+0x241/0x269 [50102.787545] Modules linked in: ipmi_si x86_pkg_temp_thermal [50102.787547] CPU: 16 PID: 0 Comm: swapper/16 Tainted: G W   4.14.0-rc1+ #10

Re: Kernel 4.13.0-rc4-next-20170811 - IP Routing / Forwarding performance vs Core/RSS number / HT on

2017-09-21 Thread Paweł Staszewski
W dniu 2017-09-21 o 23:41, Florian Fainelli pisze: On 09/21/2017 02:26 PM, Paweł Staszewski wrote: W dniu 2017-08-15 o 11:11, Paweł Staszewski pisze: diff --git a/net/8021q/vlan_netlink.c b/net/8021q/vlan_netlink.c index 5e831de3103e2f7092c7fa15534def403bc62fb4

Re: Kernel 4.13.0-rc4-next-20170811 - IP Routing / Forwarding performance vs Core/RSS number / HT on

2017-09-21 Thread Paweł Staszewski
W dniu 2017-09-21 o 23:34, Eric Dumazet pisze: On Thu, 2017-09-21 at 23:26 +0200, Paweł Staszewski wrote: W dniu 2017-08-15 o 11:11, Paweł Staszewski pisze: diff --git a/net/8021q/vlan_netlink.c b/net/8021q/vlan_netlink.c index 5e831de3103e2f7092c7fa15534def403bc62fb4

Re: Kernel 4.13.0-rc4-next-20170811 - IP Routing / Forwarding performance vs Core/RSS number / HT on

2017-09-21 Thread Paweł Staszewski
W dniu 2017-08-15 o 11:11, Paweł Staszewski pisze: diff --git a/net/8021q/vlan_netlink.c b/net/8021q/vlan_netlink.c index 5e831de3103e2f7092c7fa15534def403bc62fb4..9472de846d5c0960996261cb2843032847fa4bf7 100644 --- a/net/8021q/vlan_netlink.c +++ b/net/8021q/vlan_netlink.c @@ -143,6 +143,7

Re: Latest net-next from GIT panic

2017-09-21 Thread Paweł Staszewski
W dniu 2017-09-21 o 13:31, Paweł Staszewski pisze: W dniu 2017-09-21 o 13:03, Eric Dumazet pisze: OK we have two problems here 1) We need to unify skb_dst_force()  ( for net tree ) 2) Vlan devices should try to correctly handle IFF_XMIT_DST_RELEASE from lower device

Re: Latest net-next from GIT panic

2017-09-21 Thread Paweł Staszewski
W dniu 2017-09-21 o 13:03, Eric Dumazet pisze: OK we have two problems here 1) We need to unify skb_dst_force() ( for net tree ) 2) Vlan devices should try to correctly handle IFF_XMIT_DST_RELEASE from lower device. This will considerably help your performance. For 1), this is what I had

Re: Latest net-next from GIT panic

2017-09-21 Thread Paweł Staszewski
W dniu 2017-09-21 o 13:12, Paweł Staszewski pisze: W dniu 2017-09-21 o 13:03, Eric Dumazet pisze: On Thu, 2017-09-21 at 11:06 +0200, Paweł Staszewski wrote: W dniu 2017-09-21 o 03:17, Eric Dumazet pisze: On Wed, 2017-09-20 at 18:09 -0700, Wei Wang wrote: Thanks very much Pawel

Re: Latest net-next from GIT panic

2017-09-21 Thread Paweł Staszewski
W dniu 2017-09-21 o 13:03, Eric Dumazet pisze: On Thu, 2017-09-21 at 11:06 +0200, Paweł Staszewski wrote: W dniu 2017-09-21 o 03:17, Eric Dumazet pisze: On Wed, 2017-09-20 at 18:09 -0700, Wei Wang wrote: Thanks very much Pawel for the feedback. I was looking into the code (specifically

Re: Latest net-next from GIT panic

2017-09-21 Thread Paweł Staszewski
W dniu 2017-09-21 o 03:17, Eric Dumazet pisze: On Wed, 2017-09-20 at 18:09 -0700, Wei Wang wrote: Thanks very much Pawel for the feedback. I was looking into the code (specifically IPv4 part) and found that in free_fib_info_rcu(), we call free_nh_exceptions() without holding the fnhe_lock. I

Re: Latest net-next from GIT panic

2017-09-20 Thread Paweł Staszewski
W dniu 2017-09-20 o 23:25, Paweł Staszewski pisze: W dniu 2017-09-20 o 23:24, Paweł Staszewski pisze: W dniu 2017-09-20 o 23:10, Paweł Staszewski pisze: W dniu 2017-09-20 o 21:23, Paweł Staszewski pisze: W dniu 2017-09-20 o 21:13, Paweł Staszewski pisze: W dniu 2017-09-20 o 20:36

Re: Latest net-next from GIT panic

2017-09-20 Thread Paweł Staszewski
W dniu 2017-09-20 o 23:24, Paweł Staszewski pisze: W dniu 2017-09-20 o 23:10, Paweł Staszewski pisze: W dniu 2017-09-20 o 21:23, Paweł Staszewski pisze: W dniu 2017-09-20 o 21:13, Paweł Staszewski pisze: W dniu 2017-09-20 o 20:36, Cong Wang pisze: On Wed, Sep 20, 2017 at 11:30 AM

Re: Latest net-next from GIT panic

2017-09-20 Thread Paweł Staszewski
W dniu 2017-09-20 o 23:10, Paweł Staszewski pisze: W dniu 2017-09-20 o 21:23, Paweł Staszewski pisze: W dniu 2017-09-20 o 21:13, Paweł Staszewski pisze: W dniu 2017-09-20 o 20:36, Cong Wang pisze: On Wed, Sep 20, 2017 at 11:30 AM, Eric Dumazet <eric.duma...@gmail.com> wrote:

Re: Latest net-next from GIT panic

2017-09-20 Thread Paweł Staszewski
W dniu 2017-09-20 o 21:23, Paweł Staszewski pisze: W dniu 2017-09-20 o 21:13, Paweł Staszewski pisze: W dniu 2017-09-20 o 20:36, Cong Wang pisze: On Wed, Sep 20, 2017 at 11:30 AM, Eric Dumazet <eric.duma...@gmail.com> wrote: On Wed, 2017-09-20 at 11:22 -0700, Cong Wang wrote: but

Re: Latest net-next from GIT panic

2017-09-20 Thread Paweł Staszewski
W dniu 2017-09-20 o 21:13, Paweł Staszewski pisze: W dniu 2017-09-20 o 20:36, Cong Wang pisze: On Wed, Sep 20, 2017 at 11:30 AM, Eric Dumazet <eric.duma...@gmail.com> wrote: On Wed, 2017-09-20 at 11:22 -0700, Cong Wang wrote: but dmesg at this time shows nothing about interfaces or

  1   2   >