Re: [OpenWrt-Devel] [Cerowrt-devel] [RFC PATCH] packages: Smart Queue Management for AQM Packet Scheduling and Qos from CeroWrt

2015-02-12 Thread Luis E. Garcia
Sebastian , Dave,
Thanks for these instructions.
I just finished a round of 3 months testing this setup on a couple of MyNet
N750 ( AR71xx based ) in several locations.
The feedback from users is very positive and encouraging - Most of them say
that they feel the networks behave a lot snappier than before [ 7.5Mbps Up/
1Mbps Down].

All I had to do was install the 3 packages over BB 14.07 :
ip-full from the OpenWRT BB repository
and luci-app-sqm + sam-scripts from the CeroWRT repository.

Will the later two packages ever make it to the main OpenWRT package list?
or there other packages that on the main OpenWRT distribution that can be
used to provide this functionality? ( the 2 CeroWRT packages above make
really simple to setup ).

Regards,
Luis Garcia

On Thu, Oct 9, 2014 at 2:59 PM, Sebastian Moeller moell...@gmx.de wrote:

 Hi Luis,


 On Oct 9, 2014, at 20:05 , Luis E. Garcia l...@bitamins.net wrote:

  Please excuse my dumb question or just point me to the right
 documentation.
  But is there an easy way to run AQM/Codel on BB 14.07 ?? I'm running BB
 on a MyNETN750 that looks like it meets the HW requirements.

 There probably is, I assume you need to install ip-full from the
 BB repository, and then copy
 http://snapon.lab.bufferbloat.net/~cero2/cerowrt/wndr/3.10.50-1/packages/luci-app-sqm_3-1_all.ipk
 and
 http://snapon.lab.bufferbloat.net/~cero2/cerowrt/wndr/3.10.50-1/packages/sqm-scripts_6-1_all.ipk
 onto your router and try:
 opkg install sqm-scripts_6-1_all.ipk
 and:
 opkg install luci-app-sqm_3-1_all.ipk

 You might need to play with opkg options, but in theory it should work…
 There probably also is a nicer way like adding a stanza similar to:
 src/gz toronto
 http://snapon.lab.bufferbloat.net/~cero2/cerowrt/wndr/3.10.50-1/packages
 to /etc/opkg.conf
 but I do not know the exact incantation of that, maybe hnyman, or Dave
 know the correct answer to this..

 Best Regards
 Sebastian

 
  Regards,
  Luis Garcia
 
  On Thu, Oct 9, 2014 at 12:57 PM, Sebastian Moeller moell...@gmx.de
 wrote:
  Hi Richard,
 
  On Oct 9, 2014, at 18:42 , Richard Smith smithb...@gmail.com wrote:
 
   On 10/06/2014 03:41 PM, Sebastian Moeller wrote:
  
  
   I have spare routers that I can run OpenWRT or CeroWRt on and I'm
   setup to test with netperf, netperf-wrapper on my local network (
   desktop - router - laptop )  it's Gbit so I can easily saturate
   the router.
  
   That sounds great. I think the first test should be to run SQM under
   cerowrt, so you get a feel of how things should look. I typically run
   netperf-wrapper rrul tests (for ipv4 and if available for ipv6)
   through cerowrt with different settings for SQM. A second step then
   is to instal SQM-scripts under openwrt and check whether the same
   settings produce the same results ;)
  
   Ok.  I'll get my spare WNDR3700v2 up running the latest cerowrt.
 Should be in the next few days.  I'm a bit strapped for time right now.
 
  No hurry, I really appreciate your help and there is no time
 pressure (rather the other way around, I do this for a hobby, and real life
 leaves almost no time for  that ;) )
 
  
   So just let me know what you are willing/ready to test and we will
   take it from there okay? (I would already be a happy camper if you
   could just install the current SQM-scripts on openwrt and just send
   me the output of “logread” after installing and activating SQM, as
   well as the output from “tc -d qdisc” before and after enabling SQM,
   and finally the output of running “/etc/init.d/sqm stop ;
   /etc/init.d/sqm start” on the router’s console; that hopefully works
   or at least gives some indication what might be off. If you could
   throw in a quick netperf-wrapper RRUL test through the router I will
   be most delighted ;))
  
   Ok. That sounds like a good starter step.  First question: Where are
 the current SQM scripts located and what's the process for installing
 them?  Are they packages or stuff that I scp over and manually install?
 
  So the repository lives on:
  https://github.com/dtaht/ceropackages-3.10
   I just followed Dave’s advice and used:
  git clone g...@github.com:dtaht/ceropackages-3.3.git
  to get my own version to play around with. Oh, SQM basically is the work
 of Dave (who wrote the scripts doing the actual AQMQOS work) and Toke you
 packaged all this nicely and created the GUI for it (all I ever did was
 shuffling the GUI around a bit). I just started hacking around the files
 from sqm-scripts and luck-app-sqm on my cerowrt (so I could immediately do
 some testing), so I never got around building actual packages (I assume you
 need to be setup to build whole openwrt/cerowrt images and that is outside
 the scope of my recreational coding), But that said if you copy the files
 from ceropackages-3.10/net/sqm-scripts/files to the matching directory on
 your router you should have a working sqm-script. Or just use a cerowrt
 built as SQM is standard and potentially 

Re: [OpenWrt-Devel] [Cerowrt-devel] [RFC PATCH] packages: Smart Queue Management for AQM Packet Scheduling and Qos from CeroWrt

2015-02-12 Thread Luis E. Garcia
That's great news.
Thanks again Dave - I found both SQM packages on the Chaos Calmer files.
I'll run some more test with users.

Regards,
Luis

On Thursday, February 12, 2015, Dave Taht dave.t...@gmail.com wrote:

 sqm-scripts entered the openwrt package repos for chaos calmer quite
 some time back.

 On Thu, Feb 12, 2015 at 6:02 PM, Luis E. Garcia l...@bitamins.net
 javascript:; wrote:
  Sebastian , Dave,
  Thanks for these instructions.
  I just finished a round of 3 months testing this setup on a couple of
 MyNet
  N750 ( AR71xx based ) in several locations.
  The feedback from users is very positive and encouraging - Most of them
 say
  that they feel the networks behave a lot snappier than before [ 7.5Mbps
 Up/
  1Mbps Down].
 
  All I had to do was install the 3 packages over BB 14.07 :
  ip-full from the OpenWRT BB repository
  and luci-app-sqm + sam-scripts from the CeroWRT repository.
 
  Will the later two packages ever make it to the main OpenWRT package
 list?
  or there other packages that on the main OpenWRT distribution that can be
  used to provide this functionality? ( the 2 CeroWRT packages above make
  really simple to setup ).
 
  Regards,
  Luis Garcia
 
  On Thu, Oct 9, 2014 at 2:59 PM, Sebastian Moeller moell...@gmx.de
 javascript:; wrote:
 
  Hi Luis,
 
 
  On Oct 9, 2014, at 20:05 , Luis E. Garcia l...@bitamins.net
 javascript:; wrote:
 
   Please excuse my dumb question or just point me to the right
   documentation.
   But is there an easy way to run AQM/Codel on BB 14.07 ?? I'm running
 BB
   on a MyNETN750 that looks like it meets the HW requirements.
 
  There probably is, I assume you need to install ip-full from the
  BB repository, and then copy
 
 http://snapon.lab.bufferbloat.net/~cero2/cerowrt/wndr/3.10.50-1/packages/luci-app-sqm_3-1_all.ipk
  and
 
 http://snapon.lab.bufferbloat.net/~cero2/cerowrt/wndr/3.10.50-1/packages/sqm-scripts_6-1_all.ipk
  onto your router and try:
  opkg install sqm-scripts_6-1_all.ipk
  and:
  opkg install luci-app-sqm_3-1_all.ipk
 
  You might need to play with opkg options, but in theory it should work…
  There probably also is a nicer way like adding a stanza similar to:
  src/gz toronto
 
 http://snapon.lab.bufferbloat.net/~cero2/cerowrt/wndr/3.10.50-1/packages
  to /etc/opkg.conf
  but I do not know the exact incantation of that, maybe hnyman, or Dave
  know the correct answer to this..
 
  Best Regards
  Sebastian
 
  
   Regards,
   Luis Garcia
  
   On Thu, Oct 9, 2014 at 12:57 PM, Sebastian Moeller moell...@gmx.de
 javascript:;
   wrote:
   Hi Richard,
  
   On Oct 9, 2014, at 18:42 , Richard Smith smithb...@gmail.com
 javascript:; wrote:
  
On 10/06/2014 03:41 PM, Sebastian Moeller wrote:
   
   
I have spare routers that I can run OpenWRT or CeroWRt on and I'm
setup to test with netperf, netperf-wrapper on my local network (
desktop - router - laptop )  it's Gbit so I can easily saturate
the router.
   
That sounds great. I think the first test should be to run SQM
 under
cerowrt, so you get a feel of how things should look. I typically
 run
netperf-wrapper rrul tests (for ipv4 and if available for ipv6)
through cerowrt with different settings for SQM. A second step then
is to instal SQM-scripts under openwrt and check whether the same
settings produce the same results ;)
   
Ok.  I'll get my spare WNDR3700v2 up running the latest cerowrt.
Should be in the next few days.  I'm a bit strapped for time right
 now.
  
   No hurry, I really appreciate your help and there is no time
   pressure (rather the other way around, I do this for a hobby, and
 real life
   leaves almost no time for  that ;) )
  
   
So just let me know what you are willing/ready to test and we will
take it from there okay? (I would already be a happy camper if you
could just install the current SQM-scripts on openwrt and just send
me the output of “logread” after installing and activating SQM, as
well as the output from “tc -d qdisc” before and after enabling
 SQM,
and finally the output of running “/etc/init.d/sqm stop ;
/etc/init.d/sqm start” on the router’s console; that hopefully
 works
or at least gives some indication what might be off. If you could
throw in a quick netperf-wrapper RRUL test through the router I
 will
be most delighted ;))
   
Ok. That sounds like a good starter step.  First question: Where are
the current SQM scripts located and what's the process for
 installing them?
Are they packages or stuff that I scp over and manually install?
  
   So the repository lives on:
   https://github.com/dtaht/ceropackages-3.10
I just followed Dave’s advice and used:
   git clone g...@github.com:dtaht/ceropackages-3.3.git
   to get my own version to play around with. Oh, SQM basically is the
 work
   of Dave (who wrote the scripts doing the actual AQMQOS work) and
 Toke you
   packaged all this nicely and created the 

Re: [OpenWrt-Devel] [Cerowrt-devel] [RFC PATCH] packages: Smart Queue Management for AQM Packet Scheduling and Qos from CeroWrt

2014-10-20 Thread Weedy
sqm-scripts SQM Scripts
(QoS) (PACKAGE_sqm-scripts) [N/m/y/?] (NEW)

We got accepted?
___
openwrt-devel mailing list
openwrt-devel@lists.openwrt.org
https://lists.openwrt.org/cgi-bin/mailman/listinfo/openwrt-devel


Re: [OpenWrt-Devel] [Cerowrt-devel] [RFC PATCH] packages: Smart Queue Management for AQM Packet Scheduling and Qos from CeroWrt

2014-10-06 Thread Sebastian Moeller
Hi Richard,


On Oct 6, 2014, at 18:02 , Richard A. Smith rich...@laptop.org wrote:

 On 10/02/2014 10:05 AM, Sebastian Moeller wrote:
 
  I assume you are talking about the pure routing performance with no 
 firewall/NAT and traffic-shaping involved? I think they pretty much are 
 equal (pretty much the same kernel and most of the cerowrt guts are from 
 openwrt bb trunk). But I have not tested that (I have only one 
 cerowrt/openwrt capable router and that pretty much is my main router).
  If you are talking about comparing QOS-scripts with SQM-scripts, they 
 also seem to top out at roughly 50-60 Mbps (down- and uplink combined), it 
 seems hfsc (qos-scripts) and HTB (sam-scripts) are equally expensive on MIPS.
  Now if you are setup to do tests yourself I would love to hear the 
 results. I would be happy to help you getting SQM-scripts to work (so far 
 all people interested disappeared before or just after sharing initial test 
 results).
 
 Do you still need testers?  I have a bit of an interest here.

Oh, sure every little bit of testing is helpful (especially on openwrt, 
as I am not setup to test openwrt at all). I might be that SQM-scripts will 
explode spectacularly, but I hope that there is only a little 
“impedance-mismatch” ;)

 
 I have spare routers that I can run OpenWRT or CeroWRt on and I'm setup to 
 test with netperf, netperf-wrapper on my local network
 ( desktop - router - laptop )  it's Gbit so I can easily saturate the 
 router.

That sounds great. I think the first test should be to run SQM under 
cerowrt, so you get a feel of how things should look. I typically run 
netperf-wrapper rrul tests (for ipv4 and if available for ipv6) through cerowrt 
with different settings for SQM. A second step then is to instal SQM-scripts 
under openwrt and check whether the same settings produce the same results ;)

 
 What I don't have is a lot of time but I can do a few runs in the evenings or 
 on weekends.  

I think all that is needed is testing a few relevant shaping bandwidth 
combinations (always Downlink/Uplink, 3000Kbps/512Kbps, 16000Kbps/1000Kbps, 
5Kbps/1Kbps, 10Kbps/4Kbps, and 0/5Kbps, with a setting of 0 
disabling shaping in a particular direction, 0/5Kbps with the ethernet 
interface set 100Mbps, and with SQM disabled: pick the test set most relevant 
to your planned deployment to save time) And finally it would be great to test 
whether the ATM link layer encapsulation also works…
Basically that is the set of things to test, but the most important is 
just testing one of them to see hw SQM-scripts (and luci-app-sqm works under 
stock openwrt)


 I also am very out of touch with the latest and greatest QoS vs SQM 
 development and configuration so you will have to feed me test recipes.

Oh, happy to help out with this, thanks to Toke’s netperf-wrapper my 
tests typically look like (for say 3000Kbps/512Kbps):
date ; ping -c 10 netperf-eu.bufferbloat.net ; ./netperf-wrapper --ipv4 -l 300 
-s 0.4 -H netperf-eu.bufferbloat.net rrul -p all_scaled --disable-log -t 
IPv4_test_D3000Kbps-U512Kbps

followed by:
date ; ping -c 10 netperf-eu.bufferbloat.net ; ./netperf-wrapper --ipv6 -l 300 
-s 0.4 -H netperf-eu.bufferbloat.net rrul -p all_scaled --disable-log -t 
IPv6_test_D3000Kbps-U512Kbps

for links faster than ~5Mbps or so you can skip the -s 0.4 line and for links 
slower than 2Mbps you probably need rouse -s 0.8 or even -s 1.0, running for 5 
minutes (-l 300) makes sure you can also judge the robustness/stability of the 
shaping...
And then simply load the resulting output files in netperf-wrapper’s GUI to 
simplify comparison between the different SQM settings (and since these tests 
work independent of the used shaper you could also run the relevant shaper 
settings for your own situation through QOS. So you can compare how these two 
stack up against each other…)
It might be a good idea to capture the output of:
logread
and:
tc -d qdisc
and
tc class show dev ge00 (for cerowrt, “tc class show dev wan” for openwrt, I 
believe)
before each test run on the router (this allows to confirm whether the selected 
shaper settings actually were applied properly)

I also, very unscientifically, ssh into the router while the tests are running 
and start “top -d 1” and visually monitor the %idle and %sirq (softinterrupts), 
the first goes to 0% and the second to 90% once you reached the your router’s 
shaping limit.

So just let me know what you are willing/ready to test and we will take it from 
there okay? (I would already be a happy camper if you could just install the 
current SQM-scripts on openwrt and just send me the output of “logread” after 
installing and activating SQM, as well as the output from “tc -d qdisc” before 
and after enabling SQM, and finally the output of running “/etc/init.d/sqm stop 
; /etc/init.d/sqm start” on the router’s console; that hopefully works or at 
least gives some indication