[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 Michael Muenz changed: What|Removed |Added Resolution|--- |Not A Bug Status|New |Closed --- Comment #20 from Michael Muenz --- Dear Eugene, it seems I did a mistake, I set the sysctl for use_flowid and did the testing, but as it's a default_ sysctl it'll only activate after reboot. This may have changed with 11.X since googling for flowid you can see ppl setting this valua directly with .X.use_flowid where X is interface lagg number. In my ifconfig -v lagg0 I saw lagg options: flags=10 Now I set .. ifconfig lagg0 use_flowid ifconfig lagg1 use_flowid .. and I always get around 15-18 Gbit with each test. Sorry if I wasted your time! Thanks, Michael -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 --- Comment #19 from commit-h...@freebsd.org --- A commit references this bug: Author: eugen Date: Sat Dec 29 00:44:12 UTC 2018 New revision: 342586 URL: https://svnweb.freebsd.org/changeset/base/342586 Log: MFC r342367: ifconfig.8, lagg.4: fix documentation bug: -use_flowid needs to be used to force local hash computation and disable usage of RSS hash provided by driver. PR: 234242 Changes: _U stable/10/ stable/10/sbin/ifconfig/ifconfig.8 stable/10/share/man/man4/lagg.4 -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 --- Comment #18 from commit-h...@freebsd.org --- A commit references this bug: Author: eugen Date: Sat Dec 29 00:42:11 UTC 2018 New revision: 342585 URL: https://svnweb.freebsd.org/changeset/base/342585 Log: MFC r342367: ifconfig.8, lagg.4: fix documentation bug: -use_flowid needs to be used to force local hash computation and disable usage of RSS hash provided by driver. PR: 234242 Changes: _U stable/11/ stable/11/sbin/ifconfig/ifconfig.8 stable/11/share/man/man4/lagg.4 -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 --- Comment #17 from commit-h...@freebsd.org --- A commit references this bug: Author: eugen Date: Sat Dec 29 00:41:21 UTC 2018 New revision: 342584 URL: https://svnweb.freebsd.org/changeset/base/342584 Log: MFC r342367: ifconfig.8, lagg.4: fix documentation bug: -use_flowid needs to be used to force local hash computation and disable usage of RSS hash provided by driver. PR: 234242 Changes: _U stable/12/ stable/12/sbin/ifconfig/ifconfig.8 stable/12/share/man/man4/lagg.4 -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 --- Comment #16 from Michael Muenz --- Dear Eugene, Ubuntu doesn't support a randomization parameter via sysctl, I can only enhance the range for ephemeral port selection. I got a little bit progress: When I higher the parallel streams to 20, every 10th test or so I can reach 18Gbit. No idea how the source port calculation works exactly but it seems it works in general, but not in a real predictable manner. For a backup software working with multiple streams to reach more throughput it's not garantueed to balance evenly. Seems that Linux does it a bit different. I'll install FreeBSD on the clients after holidays to check if it works better. Can I leave this open until final testing? Thanks for your time! :) -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 --- Comment #15 from Eugene Grosbein --- Ports are still not randomized. If you run iperf3 on Linux host, you need to enable randomization there. -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 --- Comment #8 from Michael Muenz --- root@Router:~ # ifconfig -v lagg0 lagg0: flags=8943 metric 0 mtu 1500 options=ed07bb ether 24:8a:07:f7:5b:30 inet6 fe80::268a:7ff:fef7:5b30%lagg0 prefixlen 64 scopeid 0xb inet 10.22.1.1 netmask 0xff00 broadcast 10.22.1.255 nd6 options=21 media: Ethernet autoselect status: active groups: lagg laggproto lacp lagghash l2,l3,l4 lagg options: flags=10 flowid_shift: 16 lagg statistics: active ports: 2 flapping: 0 lag id: [(8000,24-8A-07-F7-5B-30,0172,,), (,24-8A-07-F7-5C-01,000F,,)] laggport: mlxen0 flags=1c state=3d [(8000,24-8A-07-F7-5B-30,0172,8000,0007), (,24-8A-07-F7-5C-01,000F,00FF,0002)] laggport: mlxen1 flags=1c state=3d [(8000,24-8A-07-F7-5B-30,0172,8000,0008), (,24-8A-07-F7-5C-01,000F,00FF,0001)] root@Router:~ # ifconfig -v lagg1 lagg1: flags=8843 metric 0 mtu 1500 options=ed07bb ether 24:8a:07:f7:5f:10 inet6 fe80::268a:7ff:fef7:5f10%lagg1 prefixlen 64 scopeid 0xc inet 10.22.2.1 netmask 0xff00 broadcast 10.22.2.255 nd6 options=21 media: Ethernet autoselect status: active groups: lagg laggproto lacp lagghash l2,l3,l4 lagg options: flags=10 flowid_shift: 16 lagg statistics: active ports: 2 flapping: 0 lag id: [(8000,24-8A-07-F7-5F-10,0192,,), (,24-8A-07-F7-5B-01,000F,,)] laggport: mlxen2 flags=1c state=3d [(8000,24-8A-07-F7-5F-10,0192,8000,0009), (,24-8A-07-F7-5B-01,000F,00FF,0002)] laggport: mlxen3 flags=1c state=3d [(8000,24-8A-07-F7-5F-10,0192,8000,000A), (,24-8A-07-F7-5B-01,000F,00FF,0001)] -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 --- Comment #7 from Eugene Grosbein --- Please show output of commands: ifconfig -v lagg0 ifconfig -v lagg1 Note "-v" flag that enables more details. -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 --- Comment #11 from Michael Muenz --- Dear Eugene, Thanks for the tip with lagghash 4, it's the same result. The reason for trafshow only showing one stream depends on -a 32 as it aggregates per IP. I'll attach 3 screenshots, one showing trafshow without aggregation showing multiple streams, and 2 screenshots showing the output of netstat -hw1 -I One screenshot of the two interfaces of lagg with inbound traffic, where you can see it's splitted across both interfaces (5Gbit each) and one screenshot with the lagg of outbound traffic where the full 10G only on one interface. randomize_ip was also enabled. -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 --- Comment #14 from Michael Muenz --- Created attachment 200394 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=200394=edit lagg outbound -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 --- Comment #12 from Michael Muenz --- Created attachment 200392 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=200392=edit trafshow2 -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 --- Comment #13 from Michael Muenz --- Created attachment 200393 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=200393=edit lagg inbound -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 --- Comment #9 from Eugene Grosbein --- Does it help if you change lagghash to L4 only? ifconfig lagg0 lagghash l4 ifconfig lagg1 lagghash l4 -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 --- Comment #10 from Eugene Grosbein --- By default, FreeBSD kernel does not randomize source ports for application like iperf3 and it may happen that all ports assigned in regular way are hashed to single LACP port. Please enable port randomization using "sysctl net.inet.ip.random_id=1" and retry the test. Also, your screenshot for trafshow shows only single traffic stream in each direction and that's odd. -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 --- Comment #5 from Michael Muenz --- Created attachment 200386 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=200386=edit trafshow -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 --- Comment #6 from Michael Muenz --- The iperf command with option -P 10 creates 10 sim. streams, so MAC, IP and destination port is always the same. There are 10 streams with 10 different source ports to one destination port. When starting a second server instance on a different destination port the balancing works fine. That was my initial question, because for the calcuation of the hash the man page states l4 includes src/dst port, but then it should already be distributed as src port is different. Enclosed is the requested screenshot of trafshow, also the iperf command at 9,GBit and a tcpdump showing different source ports. Again, I'm not sure if it's a bug, a misbehavior or just wrong documentation. Thank you for you time, very appreciated! :) Michael -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 --- Comment #4 from Eugene Grosbein --- While running test between two hosts you have same MAC and IP addresses, so they does not supply any variance and only L4 headers (ports) can add it. Please double-check that your test creates multiple flows: pkg install trafshow trafshow -a 32 -npi lagg0 -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 --- Comment #3 from Michael Muenz --- Dear Eugene, Thanks for taking the time looking into this. I applied the commands but it's still at 9,4Gbit only. root@Router:~ # sysctl -a | egrep 'lagg|lacp' net.link.lagg.lacp.default_strict_mode: 1 net.link.lagg.lacp.debug: 0 net.link.lagg.default_flowid_shift: 16 net.link.lagg.default_use_flowid: 0 net.link.lagg.failover_rx_all: 0 I can also supply screenshots where you can see packets incoming on mlxen0 and mlxen1 and outgoing on mlxen2 only. Best, Michael -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 --- Comment #2 from commit-h...@freebsd.org --- A commit references this bug: Author: eugen Date: Sat Dec 22 11:38:55 UTC 2018 New revision: 342367 URL: https://svnweb.freebsd.org/changeset/base/342367 Log: ifconfig.4, lagg.4: fix documentation bug: -use_flowid needs to be used to force local hash computation and disable usage of RSS hash provided by driver. PR: 234242 MFC after:1 week Changes: head/sbin/ifconfig/ifconfig.8 head/share/man/man4/lagg.4 -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 Eugene Grosbein changed: What|Removed |Added CC||eu...@freebsd.org --- Comment #1 from Eugene Grosbein --- Please do: ifconfig lagg0 -use_flowid ifconfig lagg1 -use_flowid Then repeat your tests. This should fix it. -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
[Bug 234242] LACP l2,l3,l4 load sharing only respects dst port
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=234242 Mark Linimon changed: What|Removed |Added Assignee|b...@freebsd.org|n...@freebsd.org -- You are receiving this mail because: You are the assignee for the bug. ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"
