I originally put time into this because we had a packet loss problem at the upstream radio of a heavily loaded AF24 link. After multiple days of intermittent analysis, we honed in on Ethernet overruns and indeed, solved the problem when we updated to Netonix firmware 1.4.7 and then turned on flow control.
There's tons of capacity at this site. The path in question is an Edgerouter-Lite feeding a Netonix switch which powers and feeds the upstream AF24. I'm used to problems with radio links but in this case, Smokeping (10 packet bursts every 90 seconds) showed loss at the radio but not at the router. The AF24 is operating at 6x, i.e. ~770 Mbps capacity, and the evening traffic was peaking above 600 Mbps (measured via SNMP at 90 second intervals). Clearly the second-by-second traffic was peaking above 770 Mbps and presumably above the AF24 buffer capacity. In any event, flow control fixed this problem. Thanks, Brough Brough Turner netBlazr Inc. – Free your Broadband! Mobile: 617-285-0433 Skype: brough netBlazr Inc. <http://www.netblazr.com/> | Google+ <https://plus.google.com/102447512447094746687/posts?hl=en> | Twitter <https://twitter.com/#%21/brough> | LinkedIn <http://www.linkedin.com/in/broughturner> | Facebook <http://www.facebook.com/brough.turner> | Blog <http://blogs.broughturner.com/> | Personal website <http://broughturner.com/> On Wed, Feb 21, 2018 at 10:21 AM, RickG <[email protected]> wrote: > Well, my experience has been that it doesn't seem to matter, at least from > what I can tell. You'd think a fiber port with full gig would overrun the > radios however I've got the switches full so the load is distributed out > fairly evenly. I'll start chasing other things. Thanks! > > On Wed, Feb 21, 2018 at 10:09 AM, Brough Turner <[email protected]> > wrote: > >> Rick, >> >> We're not completely consistent there. :( >> The only place where flow control is critical is when you have an >> Ethernet port that can overrun the actual speed of the link. For us, that >> only happens with ports driving radios. >> Some of our guys turn on Flow control on all switch ports. I have never >> seen a problem so I don't insist one way or the other except that radio >> ports must have Flow Control enabled. >> >> Thanks, >> Brough >> >> Brough Turner >> netBlazr Inc. – Free your Broadband! >> Mobile: 617-285-0433 <(617)%20285-0433> Skype: brough >> netBlazr Inc. <http://www.netblazr.com/> | Google+ >> <https://plus.google.com/102447512447094746687/posts?hl=en> | Twitter >> <https://twitter.com/#%21/brough> | LinkedIn >> <http://www.linkedin.com/in/broughturner> | Facebook >> <http://www.facebook.com/brough.turner> | Blog >> <http://blogs.broughturner.com/> | Personal website >> <http://broughturner.com/> >> >> >> >> On Tue, Feb 20, 2018 at 10:11 PM, RickG <[email protected]> wrote: >> >>> " Whenever you have an Ethernet link connected to a wireless bridge >>> that can pass less than the full Ethernet speed, e.g. a 1 Gbps Ethernet >>> connected to an AF24, you need flow control" >>> >>> Brough, Do you turn flow control on for only the port connected to the >>> higher speed Ethernet port or do you turn it on for all ports on that >>> switch regardless of what's connected? >>> >>> On Tue, Feb 20, 2018 at 3:22 PM, Brough Turner <[email protected]> >>> wrote: >>> >>>> Chris, >>>> >>>> There is a known problem with AF24s generating a storm of pause frames >>>> under some (unknown?) circumstances. This screws up any switch. Since >>>> release 1.4.7, Netonix has software that will disable flow control if it >>>> receives such a storm of pause frames. >>>> >>>> In August 2017, we upgraded 123 Netonix switches to release 1.4.7 >>>> firmware and re-enabled flow control. Since then we've had less than a >>>> dozen occasions when flow control has been automatically disabled on a >>>> Netonix port, all associated with AF24 radios. In each case we've >>>> re-enabled flow control and everything has been fine. I don't see a >>>> pattern yet. >>>> >>>> *Flow control:* Whenever you have an Ethernet link connected to a >>>> wireless bridge that can pass less than the full Ethernet speed, e.g. a 1 >>>> Gbps Ethernet connected to an AF24, you need flow control, i.e. you need >>>> Ethernet pause frames so the switch doesn't over run the radio. Without >>>> flow control, you will have packet loss when the link is carrying >>>> significant traffic. >>>> >>>> Thanks, >>>> Brough >>>> >>>> Brough Turner >>>> netBlazr Inc. – Free your Broadband! >>>> Mobile: 617-285-0433 <(617)%20285-0433> Skype: brough >>>> netBlazr Inc. <http://www.netblazr.com/> | Google+ >>>> <https://plus.google.com/102447512447094746687/posts?hl=en> | Twitter >>>> <https://twitter.com/#%21/brough> | LinkedIn >>>> <http://www.linkedin.com/in/broughturner> | Facebook >>>> <http://www.facebook.com/brough.turner> | Blog >>>> <http://blogs.broughturner.com/> | Personal website >>>> <http://broughturner.com/> >>>> >>>> >>>> >>>> On Tue, Feb 20, 2018 at 12:55 PM, Chris J. Ruschmann < >>>> [email protected]> wrote: >>>> >>>>> Switches that have air fibers attached to them…. >>>>> >>>>> >>>>> >>>>> *From:* [email protected] [mailto:ubnt_users-bounces@wis >>>>> pa.org] *On Behalf Of *Jon Langeler >>>>> *Sent:* Monday, February 19, 2018 7:35 PM >>>>> >>>>> *To:* Ubiquiti Users Group <[email protected]> >>>>> *Subject:* Re: [Ubnt_users] MTU >>>>> >>>>> >>>>> >>>>> Are you disabling pause everywhere? Or just Airfiber? >>>>> >>>>> Jon Langeler >>>>> >>>>> Michwave Technologies, Inc. >>>>> >>>>> >>>>> >>>>> >>>>> On Feb 19, 2018, at 9:01 PM, Chris J. Ruschmann <[email protected]> >>>>> wrote: >>>>> >>>>> Have you tried disabling Pause Frames on the Netonix switch? We’ve had >>>>> an issues with Airfibers and that feature on a few sites. >>>>> >>>>> >>>>> >>>>> *From:* [email protected] [mailto:ubnt_users-bounces@wis >>>>> pa.org <[email protected]>] *On Behalf Of *Steve Barnes >>>>> *Sent:* Monday, February 19, 2018 10:56 AM >>>>> *To:* Ubiquiti Users Group <[email protected]> >>>>> *Subject:* Re: [Ubnt_users] MTU >>>>> >>>>> >>>>> >>>>> Yeah everything is on AIRcontrol. Just can figure it out. >>>>> >>>>> >>>>> >>>>> At peak times I can run TCP Btest from PC through CPE to Router on >>>>> Local tower2 and get 45-50 Meg. (10Mhz channel) >>>>> >>>>> >>>>> >>>>> Btest from Router Tower2 to Router tower1 and get 200Meg. (AF5x link >>>>> 250M capacity Only 50-100M used). >>>>> >>>>> >>>>> Tower 1 Connected to GB fiber and can get 700Meg to Dist router at >>>>> Core due to traffic. >>>>> >>>>> >>>>> >>>>> But from PC through all to Dist router I can only get 8 Mbps at >>>>> night. During the morning when traffic is low I can get 45Mbps. So has >>>>> to >>>>> be buffer, retry, MTU, cpu, etc. but I cant pin point it. Ping times stay >>>>> pretty stable. AMQ and AMC really good on this AP, 90%+. >>>>> >>>>> >>>>> >>>>> Giving some serious thought to Preseem. >>>>> >>>>> >>>>> >>>>> *Steve Barnes* >>>>> >>>>> Wireless Operations Manager >>>>> >>>>> *New Lisbon Broadband* >>>>> >>>>> *NLBC.COM <http://NLBC.COM>* >>>>> >>>>> *PCSWIN.COM <http://PCSWIN.COM>* >>>>> >>>>> 765-584-2288 ext:1101 <(765)%20584-2288> >>>>> >>>>> >>>>> >>>>> *From:* [email protected] [mailto:ubnt_users-bounces@wis >>>>> pa.org <[email protected]>] *On Behalf Of *Chris J. >>>>> Ruschmann >>>>> *Sent:* Monday, February 19, 2018 1:34 PM >>>>> *To:* Ubiquiti Users Group <[email protected]> >>>>> *Subject:* Re: [Ubnt_users] MTU >>>>> >>>>> >>>>> >>>>> Are you running air control or anything else that can aggregate the >>>>> performance of your site in some nice easy to read graphs? >>>>> >>>>> >>>>> >>>>> *From:* [email protected] [mailto:ubnt_users-bounces@wis >>>>> pa.org <[email protected]>] *On Behalf Of *Steve Barnes >>>>> *Sent:* Monday, February 19, 2018 7:38 AM >>>>> *To:* Ubiquiti Users Group <[email protected]> >>>>> *Subject:* [Ubnt_users] MTU >>>>> >>>>> >>>>> >>>>> I am trying to get every last drop out of our internet. Most towers >>>>> have a MikroTik Routing, Netonix doing POE and Switching, Fed by AF5x, and >>>>> Rockets or Prism for AP’s. Sometimes seeing some slow downs I cant >>>>> account >>>>> for. Wondering if MTU or Flow control needs adjusted. >>>>> >>>>> >>>>> >>>>> The MTU settings are as follows: >>>>> >>>>> MikroTik MTU: 1500 L2 MTU: 1598 Flow Disabled >>>>> >>>>> Netonix MTU: 1528 Both >>>>> >>>>> AF5x Up to 9600 Auto Flow Disabled >>>>> >>>>> Rocket MTU: 1500 Flow Disabled >>>>> >>>>> Prism MTU: 1500 Flow Disabled >>>>> >>>>> >>>>> >>>>> In your experience should any of these be adjusted? >>>>> >>>>> >>>>> >>>>> *Steve Barnes* >>>>> >>>>> Wireless Operations Manager >>>>> >>>>> *New Lisbon Broadband* >>>>> >>>>> *NLBC.COM <http://NLBC.COM>* >>>>> >>>>> *PCSWIN.COM <http://PCSWIN.COM>* >>>>> >>>>> 765-584-2288 ext:1101 <(765)%20584-2288> >>>>> >>>>> >>>>> >>>>> _______________________________________________ >>>>> Ubnt_users mailing list >>>>> [email protected] >>>>> http://lists.wispa.org/mailman/listinfo/ubnt_users >>>>> >>>>> >>>>> _______________________________________________ >>>>> Ubnt_users mailing list >>>>> [email protected] >>>>> http://lists.wispa.org/mailman/listinfo/ubnt_users >>>>> >>>>> >>>> >>>> _______________________________________________ >>>> Ubnt_users mailing list >>>> [email protected] >>>> http://lists.wispa.org/mailman/listinfo/ubnt_users >>>> >>>> >>> >>> >>> -- >>> -RickG >>> >>> _______________________________________________ >>> Ubnt_users mailing list >>> [email protected] >>> http://lists.wispa.org/mailman/listinfo/ubnt_users >>> >>> >> >> _______________________________________________ >> Ubnt_users mailing list >> [email protected] >> http://lists.wispa.org/mailman/listinfo/ubnt_users >> >> > > > -- > -RickG > > _______________________________________________ > Ubnt_users mailing list > [email protected] > http://lists.wispa.org/mailman/listinfo/ubnt_users > >
_______________________________________________ Ubnt_users mailing list [email protected] http://lists.wispa.org/mailman/listinfo/ubnt_users
