Re: [OpenWrt-Devel] [Cerowrt-devel] [RFC PATCH] packages: Smart Queue Management for AQM Packet Scheduling and Qos from CeroWrt
Sebastian , Dave, Thanks for these instructions. I just finished a round of 3 months testing this setup on a couple of MyNet N750 ( AR71xx based ) in several locations. The feedback from users is very positive and encouraging - Most of them say that they feel the networks behave a lot snappier than before [ 7.5Mbps Up/ 1Mbps Down]. All I had to do was install the 3 packages over BB 14.07 : ip-full from the OpenWRT BB repository and luci-app-sqm + sam-scripts from the CeroWRT repository. Will the later two packages ever make it to the main OpenWRT package list? or there other packages that on the main OpenWRT distribution that can be used to provide this functionality? ( the 2 CeroWRT packages above make really simple to setup ). Regards, Luis Garcia On Thu, Oct 9, 2014 at 2:59 PM, Sebastian Moeller moell...@gmx.de wrote: Hi Luis, On Oct 9, 2014, at 20:05 , Luis E. Garcia l...@bitamins.net wrote: Please excuse my dumb question or just point me to the right documentation. But is there an easy way to run AQM/Codel on BB 14.07 ?? I'm running BB on a MyNETN750 that looks like it meets the HW requirements. There probably is, I assume you need to install ip-full from the BB repository, and then copy http://snapon.lab.bufferbloat.net/~cero2/cerowrt/wndr/3.10.50-1/packages/luci-app-sqm_3-1_all.ipk and http://snapon.lab.bufferbloat.net/~cero2/cerowrt/wndr/3.10.50-1/packages/sqm-scripts_6-1_all.ipk onto your router and try: opkg install sqm-scripts_6-1_all.ipk and: opkg install luci-app-sqm_3-1_all.ipk You might need to play with opkg options, but in theory it should work… There probably also is a nicer way like adding a stanza similar to: src/gz toronto http://snapon.lab.bufferbloat.net/~cero2/cerowrt/wndr/3.10.50-1/packages to /etc/opkg.conf but I do not know the exact incantation of that, maybe hnyman, or Dave know the correct answer to this.. Best Regards Sebastian Regards, Luis Garcia On Thu, Oct 9, 2014 at 12:57 PM, Sebastian Moeller moell...@gmx.de wrote: Hi Richard, On Oct 9, 2014, at 18:42 , Richard Smith smithb...@gmail.com wrote: On 10/06/2014 03:41 PM, Sebastian Moeller wrote: I have spare routers that I can run OpenWRT or CeroWRt on and I'm setup to test with netperf, netperf-wrapper on my local network ( desktop - router - laptop ) it's Gbit so I can easily saturate the router. That sounds great. I think the first test should be to run SQM under cerowrt, so you get a feel of how things should look. I typically run netperf-wrapper rrul tests (for ipv4 and if available for ipv6) through cerowrt with different settings for SQM. A second step then is to instal SQM-scripts under openwrt and check whether the same settings produce the same results ;) Ok. I'll get my spare WNDR3700v2 up running the latest cerowrt. Should be in the next few days. I'm a bit strapped for time right now. No hurry, I really appreciate your help and there is no time pressure (rather the other way around, I do this for a hobby, and real life leaves almost no time for that ;) ) So just let me know what you are willing/ready to test and we will take it from there okay? (I would already be a happy camper if you could just install the current SQM-scripts on openwrt and just send me the output of “logread” after installing and activating SQM, as well as the output from “tc -d qdisc” before and after enabling SQM, and finally the output of running “/etc/init.d/sqm stop ; /etc/init.d/sqm start” on the router’s console; that hopefully works or at least gives some indication what might be off. If you could throw in a quick netperf-wrapper RRUL test through the router I will be most delighted ;)) Ok. That sounds like a good starter step. First question: Where are the current SQM scripts located and what's the process for installing them? Are they packages or stuff that I scp over and manually install? So the repository lives on: https://github.com/dtaht/ceropackages-3.10 I just followed Dave’s advice and used: git clone g...@github.com:dtaht/ceropackages-3.3.git to get my own version to play around with. Oh, SQM basically is the work of Dave (who wrote the scripts doing the actual AQMQOS work) and Toke you packaged all this nicely and created the GUI for it (all I ever did was shuffling the GUI around a bit). I just started hacking around the files from sqm-scripts and luck-app-sqm on my cerowrt (so I could immediately do some testing), so I never got around building actual packages (I assume you need to be setup to build whole openwrt/cerowrt images and that is outside the scope of my recreational coding), But that said if you copy the files from ceropackages-3.10/net/sqm-scripts/files to the matching directory on your router you should have a working sqm-script. Or just use a cerowrt built as SQM is standard and potentially
Re: [OpenWrt-Devel] [Cerowrt-devel] [RFC PATCH] packages: Smart Queue Management for AQM Packet Scheduling and Qos from CeroWrt
That's great news. Thanks again Dave - I found both SQM packages on the Chaos Calmer files. I'll run some more test with users. Regards, Luis On Thursday, February 12, 2015, Dave Taht dave.t...@gmail.com wrote: sqm-scripts entered the openwrt package repos for chaos calmer quite some time back. On Thu, Feb 12, 2015 at 6:02 PM, Luis E. Garcia l...@bitamins.net javascript:; wrote: Sebastian , Dave, Thanks for these instructions. I just finished a round of 3 months testing this setup on a couple of MyNet N750 ( AR71xx based ) in several locations. The feedback from users is very positive and encouraging - Most of them say that they feel the networks behave a lot snappier than before [ 7.5Mbps Up/ 1Mbps Down]. All I had to do was install the 3 packages over BB 14.07 : ip-full from the OpenWRT BB repository and luci-app-sqm + sam-scripts from the CeroWRT repository. Will the later two packages ever make it to the main OpenWRT package list? or there other packages that on the main OpenWRT distribution that can be used to provide this functionality? ( the 2 CeroWRT packages above make really simple to setup ). Regards, Luis Garcia On Thu, Oct 9, 2014 at 2:59 PM, Sebastian Moeller moell...@gmx.de javascript:; wrote: Hi Luis, On Oct 9, 2014, at 20:05 , Luis E. Garcia l...@bitamins.net javascript:; wrote: Please excuse my dumb question or just point me to the right documentation. But is there an easy way to run AQM/Codel on BB 14.07 ?? I'm running BB on a MyNETN750 that looks like it meets the HW requirements. There probably is, I assume you need to install ip-full from the BB repository, and then copy http://snapon.lab.bufferbloat.net/~cero2/cerowrt/wndr/3.10.50-1/packages/luci-app-sqm_3-1_all.ipk and http://snapon.lab.bufferbloat.net/~cero2/cerowrt/wndr/3.10.50-1/packages/sqm-scripts_6-1_all.ipk onto your router and try: opkg install sqm-scripts_6-1_all.ipk and: opkg install luci-app-sqm_3-1_all.ipk You might need to play with opkg options, but in theory it should work… There probably also is a nicer way like adding a stanza similar to: src/gz toronto http://snapon.lab.bufferbloat.net/~cero2/cerowrt/wndr/3.10.50-1/packages to /etc/opkg.conf but I do not know the exact incantation of that, maybe hnyman, or Dave know the correct answer to this.. Best Regards Sebastian Regards, Luis Garcia On Thu, Oct 9, 2014 at 12:57 PM, Sebastian Moeller moell...@gmx.de javascript:; wrote: Hi Richard, On Oct 9, 2014, at 18:42 , Richard Smith smithb...@gmail.com javascript:; wrote: On 10/06/2014 03:41 PM, Sebastian Moeller wrote: I have spare routers that I can run OpenWRT or CeroWRt on and I'm setup to test with netperf, netperf-wrapper on my local network ( desktop - router - laptop ) it's Gbit so I can easily saturate the router. That sounds great. I think the first test should be to run SQM under cerowrt, so you get a feel of how things should look. I typically run netperf-wrapper rrul tests (for ipv4 and if available for ipv6) through cerowrt with different settings for SQM. A second step then is to instal SQM-scripts under openwrt and check whether the same settings produce the same results ;) Ok. I'll get my spare WNDR3700v2 up running the latest cerowrt. Should be in the next few days. I'm a bit strapped for time right now. No hurry, I really appreciate your help and there is no time pressure (rather the other way around, I do this for a hobby, and real life leaves almost no time for that ;) ) So just let me know what you are willing/ready to test and we will take it from there okay? (I would already be a happy camper if you could just install the current SQM-scripts on openwrt and just send me the output of “logread” after installing and activating SQM, as well as the output from “tc -d qdisc” before and after enabling SQM, and finally the output of running “/etc/init.d/sqm stop ; /etc/init.d/sqm start” on the router’s console; that hopefully works or at least gives some indication what might be off. If you could throw in a quick netperf-wrapper RRUL test through the router I will be most delighted ;)) Ok. That sounds like a good starter step. First question: Where are the current SQM scripts located and what's the process for installing them? Are they packages or stuff that I scp over and manually install? So the repository lives on: https://github.com/dtaht/ceropackages-3.10 I just followed Dave’s advice and used: git clone g...@github.com:dtaht/ceropackages-3.3.git to get my own version to play around with. Oh, SQM basically is the work of Dave (who wrote the scripts doing the actual AQMQOS work) and Toke you packaged all this nicely and created the
Re: [OpenWrt-Devel] [Cerowrt-devel] [RFC PATCH] packages: Smart Queue Management for AQM Packet Scheduling and Qos from CeroWrt
sqm-scripts SQM Scripts (QoS) (PACKAGE_sqm-scripts) [N/m/y/?] (NEW) We got accepted? ___ openwrt-devel mailing list openwrt-devel@lists.openwrt.org https://lists.openwrt.org/cgi-bin/mailman/listinfo/openwrt-devel
Re: [OpenWrt-Devel] [Cerowrt-devel] [RFC PATCH] packages: Smart Queue Management for AQM Packet Scheduling and Qos from CeroWrt
Hi Richard, On Oct 6, 2014, at 18:02 , Richard A. Smith rich...@laptop.org wrote: On 10/02/2014 10:05 AM, Sebastian Moeller wrote: I assume you are talking about the pure routing performance with no firewall/NAT and traffic-shaping involved? I think they pretty much are equal (pretty much the same kernel and most of the cerowrt guts are from openwrt bb trunk). But I have not tested that (I have only one cerowrt/openwrt capable router and that pretty much is my main router). If you are talking about comparing QOS-scripts with SQM-scripts, they also seem to top out at roughly 50-60 Mbps (down- and uplink combined), it seems hfsc (qos-scripts) and HTB (sam-scripts) are equally expensive on MIPS. Now if you are setup to do tests yourself I would love to hear the results. I would be happy to help you getting SQM-scripts to work (so far all people interested disappeared before or just after sharing initial test results). Do you still need testers? I have a bit of an interest here. Oh, sure every little bit of testing is helpful (especially on openwrt, as I am not setup to test openwrt at all). I might be that SQM-scripts will explode spectacularly, but I hope that there is only a little “impedance-mismatch” ;) I have spare routers that I can run OpenWRT or CeroWRt on and I'm setup to test with netperf, netperf-wrapper on my local network ( desktop - router - laptop ) it's Gbit so I can easily saturate the router. That sounds great. I think the first test should be to run SQM under cerowrt, so you get a feel of how things should look. I typically run netperf-wrapper rrul tests (for ipv4 and if available for ipv6) through cerowrt with different settings for SQM. A second step then is to instal SQM-scripts under openwrt and check whether the same settings produce the same results ;) What I don't have is a lot of time but I can do a few runs in the evenings or on weekends. I think all that is needed is testing a few relevant shaping bandwidth combinations (always Downlink/Uplink, 3000Kbps/512Kbps, 16000Kbps/1000Kbps, 5Kbps/1Kbps, 10Kbps/4Kbps, and 0/5Kbps, with a setting of 0 disabling shaping in a particular direction, 0/5Kbps with the ethernet interface set 100Mbps, and with SQM disabled: pick the test set most relevant to your planned deployment to save time) And finally it would be great to test whether the ATM link layer encapsulation also works… Basically that is the set of things to test, but the most important is just testing one of them to see hw SQM-scripts (and luci-app-sqm works under stock openwrt) I also am very out of touch with the latest and greatest QoS vs SQM development and configuration so you will have to feed me test recipes. Oh, happy to help out with this, thanks to Toke’s netperf-wrapper my tests typically look like (for say 3000Kbps/512Kbps): date ; ping -c 10 netperf-eu.bufferbloat.net ; ./netperf-wrapper --ipv4 -l 300 -s 0.4 -H netperf-eu.bufferbloat.net rrul -p all_scaled --disable-log -t IPv4_test_D3000Kbps-U512Kbps followed by: date ; ping -c 10 netperf-eu.bufferbloat.net ; ./netperf-wrapper --ipv6 -l 300 -s 0.4 -H netperf-eu.bufferbloat.net rrul -p all_scaled --disable-log -t IPv6_test_D3000Kbps-U512Kbps for links faster than ~5Mbps or so you can skip the -s 0.4 line and for links slower than 2Mbps you probably need rouse -s 0.8 or even -s 1.0, running for 5 minutes (-l 300) makes sure you can also judge the robustness/stability of the shaping... And then simply load the resulting output files in netperf-wrapper’s GUI to simplify comparison between the different SQM settings (and since these tests work independent of the used shaper you could also run the relevant shaper settings for your own situation through QOS. So you can compare how these two stack up against each other…) It might be a good idea to capture the output of: logread and: tc -d qdisc and tc class show dev ge00 (for cerowrt, “tc class show dev wan” for openwrt, I believe) before each test run on the router (this allows to confirm whether the selected shaper settings actually were applied properly) I also, very unscientifically, ssh into the router while the tests are running and start “top -d 1” and visually monitor the %idle and %sirq (softinterrupts), the first goes to 0% and the second to 90% once you reached the your router’s shaping limit. So just let me know what you are willing/ready to test and we will take it from there okay? (I would already be a happy camper if you could just install the current SQM-scripts on openwrt and just send me the output of “logread” after installing and activating SQM, as well as the output from “tc -d qdisc” before and after enabling SQM, and finally the output of running “/etc/init.d/sqm stop ; /etc/init.d/sqm start” on the router’s console; that hopefully works or at least gives some indication