Anyone noticing any odd latency/bandwidth congestion going on in Seattle?

[Brielle]

Hi all,

I've suddenly started showing high latency in Seattle off of CenturyLink 
in Boise going to Comcast in Denver.


Boise fiber to Denver...

traceroute to 50.239.215.xxx (50.239.215.xxx), 30 hops max, 60 byte packets

 4  sea-brdr-02.inet.qwest.net (67.14.41.194)  12.394 ms  12.348 ms 
12.369 ms
 5  be-203-pe02.seattle.wa.ibone.comcast.net (96.87.10.117)  109.073 ms 
 109.530 ms  109.476 ms
 6  be-10847-cr01.seattle.wa.ibone.comcast.net (68.86.86.225)  110.906 
ms  111.427 ms  110.642 ms
 7  be-10820-cr01.champa.co.ibone.comcast.net (68.86.84.206)  125.245 
ms  126.605 ms  126.492 ms

 8  68.86.92.130 (68.86.92.130)  124.478 ms  124.533 ms  124.518 ms
 9  ae-1-rur02.wheatridge.co.denver.comcast.net (162.151.51.18) 
125.846 ms  126.010 ms  126.353 ms
10  ae-11-sur02.wheatridge.co.denver.comcast.net (162.151.51.146) 
125.630 ms  125.480 ms  125.397 ms

11  * * *
12  * * *

Reverse path from Denver Comcast to Boise CenturyLink...

traceroute to x (205.xxx.xx.xx), 30 hops max, 38 byte packets
 
 6  be-12176-pe02.910fifteenth.co.ibone.comcast.net (68.86.83.94) 
0.916 ms  0.983 ms  1.021 ms
 7  dvr3-brdr-01.inet.qwest.net (72.164.247.149)  0.864 ms  8.534 ms 
0.805 ms

 8  *  *  *
 9  63-224-242-xx.dia.static.qwest.net (63.224.242.xx)  125.355 ms 
125.681 ms  125.404 ms

10  63.147.164.xx (63.147.164.xx)  125.006 ms  125.590 ms  125.817 ms
11  *  *  *
12  *  *  *


I've got two CL fiber connections here in Boise - one with BGP for my 
own block, the other with a CL provided IP block.  Both showing same 
results.


Also have a CL fiber connection in Cheyenne, and it does not show any 
issues going to Boise or Denver.


Are we still seeing after-effects from the gaming thing last night?

--
Brielle Bruns
The Summit Open Source Development Group
http://www.sosdg.org/ http://www.ahbl.org

Re: VDSL

[Brielle]

On 10/15/2019 11:37 AM, Matt Harris wrote:


It's not super-widely used in the US today 



Its actually got pretty heavy use in a lot of CenturyLink areas, like 
here in Boise.  Fiber is only now starting to become the norm, so 
everyone is on VDSL2 in single or bonded modes, speeds all the way up to 
around 50mbit down.


--
Brielle Bruns
The Summit Open Source Development Group
http://www.sosdg.org/ http://www.ahbl.org

Re: Comcast outages continue even in areas with PG power restored

[Brandon Martin]

On 10/15/19 11:28 AM, Matt Hoppes wrote:

Except I’m not talking about CPE. I agree that’s the customer’s job.


I was confused based on Masataka's focus on CPE power.


I’m talking about keeping the nodes up and running.


Yep.
--
Brandon Martin

Re: Video Streaming Wars

[Chris Adams]

Once upon a time, Brian J. Murrell  said:
> The video streaming wars are this years version of last years cable
> channel bundling.  Everyone knows the game the cablecos play where they
> bundle 14 channels of crap with one channel that people actually want
> and because it's 15 channels, hey, well that's going to cost
> $20.99/mo., you know, because you are getting 15 channels!  Oh, no,
> sorry, no way to get just that one channel you want for just it's cost.
> You need to buy all 15.

Most of that is at the behest of the content providers, like Disney.
Want to carry Disney Movies?  You have to carry ESPN-U in the same
package.  So... now those very same content providers are trying to cut
out the middle-man of the linear TV (cable, sat, IPTV) providers, and
recreate the same bundling.

-- 
Chris Adams 

Re: VDSL

[Rod Beck]

Both the cable and PTT have wiring in the buildings, but I suspect it is all 
CAT5 or the European equivalent in each apartment. Most of these flats have not 
been renovated in 30 to 50 years and that is usually when the flat is renovated 
that wiring would get upgraded. The cable company will often insist on rewiring 
the flat's own wiring if it has never provided service before.


From: NANOG  on behalf of Rod Beck 

Sent: Tuesday, October 15, 2019 7:55 PM
To: Phil Lavin ; Nanog@nanog.org 
Subject: Re: VDSL

The PTT is limited in 50 megs in this building. However, the cable company just 
upgraded its network and is now offering up to 500. I assume the cable company 
is using coax and may be that gives them an edge when combined with VDSL to get 
up to 500 megs.


From: Phil Lavin 
Sent: Tuesday, October 15, 2019 7:48 PM
To: Rod Beck ; Nanog@nanog.org 

Subject: RE: VDSL

> I discovered that the Budapest cable company was using VDLS to provide 
> services up to 500 megs into the buildings where my flats are located. VDSL 
> is a pretty old standard. I recollect people talking about it back in 1998.

> Is it being heavily deployed in Last Mile networks state side?

DSL on the whole seems pretty unpopular in the USA. VDSL itself is a fairly old 
standard but it's been enhanced over the years to provide bandwidths up to 
300mbit on a single twisted copper pair, albeit over relatively short distances.

DSL (these days, specifically VDSL2) is extremely popular and widely used 
within the UK because almost every home has a single twisted pair going into it 
for a POTS phone line. It made sense to run services over this than to re-cable 
25 million homes. A (very) slow FTTH rollout is under way but what seems to be 
getting more traction is a rollout of G.Fast which currently boasts speeds of 
up to 500mbit over short distances (< 100m), still on a single twisted copper 
pair. This may be what you're getting as VDSL2 won't push to 500mbit over any 
sensible distance.

I can only speculate on why they decided to use DSL in your building - if it 
has legacy POTS infrastructure to each apartment, it would make some sense. If 
not, who knows...

Re: VDSL

[Tim Howe]

That's what I would expect.  A Gfast ONU in the building with fiber
backhaul.  You can use legacy Cat3 pair or coax to get from the Telco
closet to each suite.  That's basically what Gfast is for.

--TimH

On Tue, 15 Oct 2019 17:51:50 +
Rod Beck  wrote:

> These are large 19th century buildings with courtyards. I have seen lots of 
> activity on this street - fiber being pulled from manhole and gear being 
> installed in cable manholes. Corning on the cables.
> 
> Regards,
> 
> Roderick.
> 
> 
> From: NANOG  on behalf of Tim Howe 
> 
> Sent: Tuesday, October 15, 2019 7:47 PM
> To: Nanog@nanog.org 
> Subject: Re: VDSL
> 
> On Tue, 15 Oct 2019 17:24:44 +
> Rod Beck  wrote:
> 
> > Hi,
> >
> > I discovered that the Budapest cable company was using VDLS to
> > provide services up to 500 megs into the buildings where my flats are
> > located. VDSL is a pretty old standard. I recollect people talking
> > about it back in 1998.
> >
> > Is it being heavily deployed in Last Mile networks state side?  
> 
> Sounds more like an in-building Gfast deployment, which
> is /technically/ a kind of DSL.  To get 500Mb on a single pair I think
> you would need a distance shorter than 1000ft.  This is pretty recent
> tech, and a multi dwelling scenario would be the most common deployment
> afaik.
> 
> --TimH

Re: VDSL

[Rod Beck]

The PTT is limited in 50 megs in this building. However, the cable company just 
upgraded its network and is now offering up to 500. I assume the cable company 
is using coax and may be that gives them an edge when combined with VDSL to get 
up to 500 megs.


From: Phil Lavin 
Sent: Tuesday, October 15, 2019 7:48 PM
To: Rod Beck ; Nanog@nanog.org 

Subject: RE: VDSL

> I discovered that the Budapest cable company was using VDLS to provide 
> services up to 500 megs into the buildings where my flats are located. VDSL 
> is a pretty old standard. I recollect people talking about it back in 1998.

> Is it being heavily deployed in Last Mile networks state side?

DSL on the whole seems pretty unpopular in the USA. VDSL itself is a fairly old 
standard but it's been enhanced over the years to provide bandwidths up to 
300mbit on a single twisted copper pair, albeit over relatively short distances.

DSL (these days, specifically VDSL2) is extremely popular and widely used 
within the UK because almost every home has a single twisted pair going into it 
for a POTS phone line. It made sense to run services over this than to re-cable 
25 million homes. A (very) slow FTTH rollout is under way but what seems to be 
getting more traction is a rollout of G.Fast which currently boasts speeds of 
up to 500mbit over short distances (< 100m), still on a single twisted copper 
pair. This may be what you're getting as VDSL2 won't push to 500mbit over any 
sensible distance.

I can only speculate on why they decided to use DSL in your building - if it 
has legacy POTS infrastructure to each apartment, it would make some sense. If 
not, who knows...

Re: Video Streaming Wars

[Brian J. Murrell]

On Tue, 2019-10-15 at 17:12 +, Rod Beck wrote:
> https://www.lightreading.com/video/ott/whats-at-stake-as-the-streaming-battle-builds-/d/d-id/754841?
> [
> https://img.lightreading.com/2019/10/754841/3383.jpg] ?>
> What's at Stake as the Streaming Battle Builds | Light Reading<
> https://www.lightreading.com/video/ott/whats-at-stake-as-the-streaming-battle-builds-/d/d-id/754841
> ?>
> Netflix, Amazon and Hulu have staked out their turf in the
> subscription VoD market, but will they be able to hold that coveted
> ground as Disney, Apple, WarnerMedia and NBCU enter the streaming
> fray?
> www.lightreading.com
> 

The video streaming wars are this years version of last years cable
channel bundling.  Everyone knows the game the cablecos play where they
bundle 14 channels of crap with one channel that people actually want
and because it's 15 channels, hey, well that's going to cost
$20.99/mo., you know, because you are getting 15 channels!  Oh, no,
sorry, no way to get just that one channel you want for just it's cost.
You need to buy all 15.

How many streaming services is the average consumer going to have to
start subscribing to for $10-20/mo. each to get all of the content they
want?

Or, as I (and I am sure others have) predict(ed), while consumers were
willing to pay a modest amount of money for a streaming service or two
to get all of the content they wanted, consumers are going to reject
the skyrocketing costs of the streaming fragmentation and go back to
the same solution they had for the high costs of cable channel
bundling.  Welcome back piracy.

Cheers,
b.



signature.asc
Description: This is a digitally signed message part

Re: Comcast outages continue even in areas with PG power restored

[Michael Thomas]

On 10/14/19 5:58 PM, Brandon Martin wrote:

On 10/14/19 8:26 PM, Michael Thomas wrote:
So when we were working on this 20 years ago at Cisco, there was a 
tremendous amount of effort to deal with the issue of e911 and 
generally battery backup. I'm really surprised to hear that though we 
went through a lot of effort to deal with the CPE, that the cable 
plant was the actual problem. The cable companies should, imo, be 
held to the same standard as the telcos. Maybe even moreso these days 
since IP has taken over everything. The need for reliable e911 hasn't 
gone away just because the bits have turned into IP bit these days.


They get around it, at least in part, by selling it as a "VoIP" 
service rather than "phone service".


AT does the same with U-Verse voice.  You can still buy POTS from 
AT, but it's a separate product with a completely different pricing 
structure from the U-Verse voice product.


Voice over HFC networks is sometimes sold as a POTS-like service. I've 
only heard of this happening in places where the LEC and cable 
provider happen to end up being one-in-the-same.  In those cases, yeah 
uptime is a big deal.



That's what we were working on at Cisco... we partnered with Videotron 
up in Montreal and were trying to boil the entire telco ocean from the 
get-go with all of its features, guarantees, etc. The way it's turned 
out, nobody really cares about 90% of those features so we were wasting 
valuable time to get out an mvp instead. Hindsight, of course.


I never did hear whether all of the elaborate QoS schemes that John 
Chapman and the rest of the docsis folks were working on ended up 
getting used, or whether they really matter much anymore since voice is 
so low bandwidth.


Mike

Re: VDSL

[Rod Beck]

These are large 19th century buildings with courtyards. I have seen lots of 
activity on this street - fiber being pulled from manhole and gear being 
installed in cable manholes. Corning on the cables.

Regards,

Roderick.


From: NANOG  on behalf of Tim Howe 
Sent: Tuesday, October 15, 2019 7:47 PM
To: Nanog@nanog.org 
Subject: Re: VDSL

On Tue, 15 Oct 2019 17:24:44 +
Rod Beck  wrote:

> Hi,
>
> I discovered that the Budapest cable company was using VDLS to
> provide services up to 500 megs into the buildings where my flats are
> located. VDSL is a pretty old standard. I recollect people talking
> about it back in 1998.
>
> Is it being heavily deployed in Last Mile networks state side?

Sounds more like an in-building Gfast deployment, which
is /technically/ a kind of DSL.  To get 500Mb on a single pair I think
you would need a distance shorter than 1000ft.  This is pretty recent
tech, and a multi dwelling scenario would be the most common deployment
afaik.

--TimH

Re: VDSL

[Eric Dugas]

Bell Canada still uses a lot of VDSL2 last-miles in Quebec and Ontario.

Max speed is 100/10 over bonded pairs and 50/10 over a single pair over short 
distances. Generally served from a fiber-fed DSLAM and less than 500 meters.
On Oct 15 2019, at 1:48 pm, Rod Beck  wrote:
> I understand. My recollection is that the distance is like 100 meters. VDSL 
> is what the engineers deploying on the street told me. I think there is a 
> node right outside.
>
>
> Regards,
>
> Roderick.
>
> From: Matt Harris 
> Sent: Tuesday, October 15, 2019 7:37 PM
> To: Rod Beck 
> Cc: Nanog@nanog.org 
> Subject: Re: VDSL
>
>
> On Tue, Oct 15, 2019 at 12:25 PM Rod Beck  (mailto:rod.b...@unitedcablecompany.com)> wrote:
>
>
> > Hi,
> >
> >
> > I discovered that the Budapest cable company was using VDLS to provide 
> > services up to 500 megs into the buildings where my flats are located. VDSL 
> > is a pretty old standard. I recollect people talking about it back in 1998.
> >
> > Is it being heavily deployed in Last Mile networks state side?
>
> Hey Rod,
> Are you sure they're using VDSL (I'm assuming you mean VDSL2 which is still 
> in fairly wide use around the world)? 500mbit VDSL2 would have a very short 
> run limitation afaik. It wouldn't be last mile, more like last meter. :)
>
> It's not super-widely used in the US today since Verizon and others have 
> built out increasing FTTH networks and always had to compete with DOCSIS 
> based services which are very widespread here, though I wouldn't be surprised 
> if it was still frequently the "better than satellite!" service available in 
> some rural areas that aren't too hard to reach with cabling. A decade ago, 
> you would've seen a lot more VDSL2 deployments here in the US, though usually 
> no more than 25 or 50 mbit capacity for the end-user.
>
> https://en.wikipedia.org/wiki/List_of_VDSL_and_VDSL2_deployments has a bunch 
> of interesting details though I can attest to some of them being fairly out 
> of date.

RE: VDSL

[Phil Lavin]

> I discovered that the Budapest cable company was using VDLS to provide 
> services up to 500 megs into the buildings where my flats are located. VDSL 
> is a pretty old standard. I recollect people talking about it back in 1998. 

> Is it being heavily deployed in Last Mile networks state side?

DSL on the whole seems pretty unpopular in the USA. VDSL itself is a fairly old 
standard but it's been enhanced over the years to provide bandwidths up to 
300mbit on a single twisted copper pair, albeit over relatively short distances.

DSL (these days, specifically VDSL2) is extremely popular and widely used 
within the UK because almost every home has a single twisted pair going into it 
for a POTS phone line. It made sense to run services over this than to re-cable 
25 million homes. A (very) slow FTTH rollout is under way but what seems to be 
getting more traction is a rollout of G.Fast which currently boasts speeds of 
up to 500mbit over short distances (< 100m), still on a single twisted copper 
pair. This may be what you're getting as VDSL2 won't push to 500mbit over any 
sensible distance.

I can only speculate on why they decided to use DSL in your building - if it 
has legacy POTS infrastructure to each apartment, it would make some sense. If 
not, who knows...

Re: VDSL

[Rod Beck]

I understand. My recollection is that the distance is like 100 meters. VDSL is 
what the engineers deploying on the street told me. I think there is a node 
right outside.

Regards,

Roderick.


From: Matt Harris 
Sent: Tuesday, October 15, 2019 7:37 PM
To: Rod Beck 
Cc: Nanog@nanog.org 
Subject: Re: VDSL

On Tue, Oct 15, 2019 at 12:25 PM Rod Beck 
mailto:rod.b...@unitedcablecompany.com>> wrote:
Hi,

I discovered that the Budapest cable company was using VDLS to provide services 
up to 500 megs into the buildings where my flats are located. VDSL is a pretty 
old standard. I recollect people talking about it back in 1998.

Is it being heavily deployed in Last Mile networks state side?

Hey Rod,
Are you sure they're using VDSL (I'm assuming you mean VDSL2 which is still in 
fairly wide use around the world)? 500mbit VDSL2 would have a very short run 
limitation afaik. It wouldn't be last mile, more like last meter. :)

It's not super-widely used in the US today since Verizon and others have built 
out increasing FTTH networks and always had to compete with DOCSIS based 
services which are very widespread here, though I wouldn't be surprised if it 
was still frequently the "better than satellite!" service available in some 
rural areas that aren't too hard to reach with cabling. A decade ago, you 
would've seen a lot more VDSL2 deployments here in the US, though usually no 
more than 25 or 50 mbit capacity for the end-user.

https://en.wikipedia.org/wiki/List_of_VDSL_and_VDSL2_deployments has a bunch of 
interesting details though I can attest to some of them being fairly out of 
date.

Re: VDSL

[Tim Howe]

On Tue, 15 Oct 2019 17:24:44 +
Rod Beck  wrote:

> Hi,
> 
> I discovered that the Budapest cable company was using VDLS to
> provide services up to 500 megs into the buildings where my flats are
> located. VDSL is a pretty old standard. I recollect people talking
> about it back in 1998.
> 
> Is it being heavily deployed in Last Mile networks state side?

Sounds more like an in-building Gfast deployment, which
is /technically/ a kind of DSL.  To get 500Mb on a single pair I think
you would need a distance shorter than 1000ft.  This is pretty recent
tech, and a multi dwelling scenario would be the most common deployment
afaik.

--TimH

Re: Comcast outages continue even in areas with PG power restored

[Michael Thomas]

On 10/14/19 6:11 PM, Sean Donelan wrote:

On Mon, 14 Oct 2019, Michael Thomas wrote:
deal with the CPE, that the cable plant was the actual problem. The 
cable companies should, imo, be held to the same standard as the 
telcos. Maybe even moreso these days since IP has taken over 
everything. The need for reliable e911 hasn't gone away just because 
the bits have turned into IP bit these days.



Oh, but they are equal.  The telco's went to the regulators and got 
the FCC and state PUCs to reduce or make backup power a 
customerresponsbility...

Just like the cable companies.

So now they are equal -- in the race to the bottom.

Service providers must "OFFER" customers an OPTION for 8/24-hour 
standby backup power.  The decision to puchase backup power is up to 
the customer.
I assume you read the fine print on the back of your bill or the order 
terms (subject to change at anytime, without notice).




Assuming that this power shutoff in california is the new normal (god 
help us), it would need to be a minimum of 3 days. The wind event itself 
usually lasts a day or two, but then they have to inspect -- completely 
manually from what i can tell -- the entire grid, which takes a day or 
two. Clearly more automation of the inspection is needed (ie, have cams, 
etc, deployed on the grid), and of course that would help with 
prevention which is where pge has fallen completely flat.


It seems to me that if we have to live with unburied power lines, 
cameras and other sensors with some AI-like grinding on the images could 
detect all manner of problems and relay it back to the ops folks for a 
closer look, and/or roll trucks. There are folks at texas a who are 
working on something like this (not sure about the image grinding 
though). Sure it might be expensive, but it's probably cheaper than 
undergrounding, or burning down cities and roasting people alive.


Mike

Re: VDSL

[Matt Harris]

On Tue, Oct 15, 2019 at 12:25 PM Rod Beck 
wrote:

> Hi,
>
> I discovered that the Budapest cable company was using VDLS to provide
> services up to 500 megs into the buildings where my flats are located. VDSL
> is a pretty old standard. I recollect people talking about it back in 1998.
>
> Is it being heavily deployed in Last Mile networks state side?
>

Hey Rod,
Are you sure they're using VDSL (I'm assuming you mean VDSL2 which is still
in fairly wide use around the world)? 500mbit VDSL2 would have a very short
run limitation afaik. It wouldn't be last mile, more like last meter. :)

It's not super-widely used in the US today since Verizon and others have
built out increasing FTTH networks and always had to compete with DOCSIS
based services which are very widespread here, though I wouldn't be
surprised if it was still frequently the "better than satellite!" service
available in some rural areas that aren't too hard to reach with cabling. A
decade ago, you would've seen a lot more VDSL2 deployments here in the US,
though usually no more than 25 or 50 mbit capacity for the end-user.

https://en.wikipedia.org/wiki/List_of_VDSL_and_VDSL2_deployments has a
bunch of interesting details though I can attest to some of them being
fairly out of date.

VDSL

[Rod Beck]

Hi,

I discovered that the Budapest cable company was using VDLS to provide services 
up to 500 megs into the buildings where my flats are located. VDSL is a pretty 
old standard. I recollect people talking about it back in 1998.

Is it being heavily deployed in Last Mile networks state side?



Roderick Beck

VP of Business Development

United Cable Company

www.unitedcablecompany.com

New York City & Budapest

rod.b...@unitedcablecompany.com

36-70-605-5144


[1467221477350_image005.png]

Video Streaming Wars

[Rod Beck]

https://www.lightreading.com/video/ott/whats-at-stake-as-the-streaming-battle-builds-/d/d-id/754841?
[https://img.lightreading.com/2019/10/754841/3383.jpg]
What's at Stake as the Streaming Battle Builds | Light 
Reading
Netflix, Amazon and Hulu have staked out their turf in the subscription VoD 
market, but will they be able to hold that coveted ground as Disney, Apple, 
WarnerMedia and NBCU enter the streaming fray?
www.lightreading.com



Roderick Beck

VP of Business Development

United Cable Company

www.unitedcablecompany.com

New York City & Budapest

rod.b...@unitedcablecompany.com

36-70-605-5144


[1467221477350_image005.png]

Re: lots of traffic starting at 3 a.m. central time

[Jared Mauch]

If you have questions or issues related to this traffic can you ping me off 
list? We can't comment on specific customers but if you are having issues 
please reach out to me or your local friendly Akamai person. 

Sent from my iCar

> On Oct 15, 2019, at 11:48 AM, Phil Lavin  wrote:
> 
> 
> > Anyone else see lots of traffic coming down starting at 3 a.m. central time 
> > ?  all of my internet connections showed strangely larger load for a few 
> > early morning hours.
>  
> Someone, on another list, mentioned a 70% increase in traffic to Akamai which 
> seems to correlate with a new Fortnite release
>  

Re: lots of traffic starting at 3 a.m. central time

[Ben Cannon]

Somebody release a software update?

-Ben

> On Oct 15, 2019, at 9:08 AM, Dan White  wrote:
> 
> Here's a graph of our eyeball network traffic (CDT):
> 
> https://ibb.co/kJQYKMq
> 
> This is an unprecedented increase in traffic for us, day or night, outside
> of DDOS traffic.
> 
> Our traffic monitoring system identifies this a Akamai traffic.
> 
>> On 10/15/19 15:54 +, Luke Guillory wrote:
>> That’s what I’m seeing as well, went  from 2.2G around 2:50AM CST to a peak
> +of 16G.
>> 
>> https://i.imgur.com/en89kyO.png
>> 
>> Luke Guillory
>> Vice President – Technology and Innovation
>> 
>> From: NANOG [mailto:nanog-boun...@nanog.org] On Behalf Of Phil Lavin
>> Sent: Tuesday, October 15, 2019 10:48 AM
>> To: Aaron Gould; Nanog@nanog.org
>> Subject: RE: lots of traffic starting at 3 a.m. central time
>> 
>> > Anyone else see lots of traffic coming down starting at 3 a.m. central
>> > time ?  all of my internet connections showed strangely larger load for a
>> > few early morning hours.
>> >
>> > Someone, on another list, mentioned a 70% increase in traffic to Akamai
>> > which seems to correlate with a new Fortnite release
> 
> 
> -- 
> Dan White
> BTC Broadband
> Network Admin Lead
> Ph  918.366.0248 (direct)   main: (918)366-8000
> Fax 918.366.6610email: dwh...@mybtc.com
> http://www.btcbroadband.com

Re: lots of traffic starting at 3 a.m. central time

[Dan White]

Here's a graph of our eyeball network traffic (CDT):

https://ibb.co/kJQYKMq

This is an unprecedented increase in traffic for us, day or night, outside
of DDOS traffic.

Our traffic monitoring system identifies this a Akamai traffic.

On 10/15/19 15:54 +, Luke Guillory wrote:

That’s what I’m seeing as well, went  from 2.2G around 2:50AM CST to a peak

+of 16G.


https://i.imgur.com/en89kyO.png

Luke Guillory
Vice President – Technology and Innovation

From: NANOG [mailto:nanog-boun...@nanog.org] On Behalf Of Phil Lavin
Sent: Tuesday, October 15, 2019 10:48 AM
To: Aaron Gould; Nanog@nanog.org
Subject: RE: lots of traffic starting at 3 a.m. central time

> Anyone else see lots of traffic coming down starting at 3 a.m. central
> time ?  all of my internet connections showed strangely larger load for a
> few early morning hours.
>
> Someone, on another list, mentioned a 70% increase in traffic to Akamai
> which seems to correlate with a new Fortnite release



--
Dan White
BTC Broadband
Network Admin Lead
Ph  918.366.0248 (direct)   main: (918)366-8000
Fax 918.366.6610email: dwh...@mybtc.com
http://www.btcbroadband.com

Re: lots of traffic starting at 3 a.m. central time

[Aaron]

Fortnite update?

On 10/15/2019 10:54 AM, Luke Guillory wrote:


That’s what I’m seeing as well, went  from 2.2G around 2:50AM CST to a 
peak of 16G.


https://i.imgur.com/en89kyO.png

Luke Guillory
Vice President – Technology and Innovation


Tel:985.536.1212
Fax:985.536.0300
Email:  lguill...@reservetele.com
Web:www.rtconline.com


Reserve Telecommunications
100 RTC Dr
Reserve, LA 70084


*Disclaimer:*
The information transmitted, including attachments, is intended only 
for the person(s) or entity to which it is addressed and may contain 
confidential and/or privileged material which should not disseminate, 
distribute or be copied. Please notify Luke Guilloryimmediately by 
e-mail if you have received this e-mail by mistake and delete this 
e-mail from your system. E-mail transmission cannot be guaranteed to 
be secure or error-free as information could be intercepted, 
corrupted, lost, destroyed, arrive late or incomplete, or contain 
viruses. Luke Guillorytherefore does not accept liability for any 
errors or omissions in the contents of this message, which arise as a 
result of e-mail transmission.


*From:*NANOG [mailto:nanog-boun...@nanog.org] *On Behalf Of *Phil Lavin
*Sent:* Tuesday, October 15, 2019 10:48 AM
*To:* Aaron Gould; Nanog@nanog.org
*Subject:* RE: lots of traffic starting at 3 a.m. central time

> Anyone else see lots of traffic coming down starting at 3 a.m. 
central time ?  all of my internet connections showed strangely larger 
load for a few early morning hours.


Someone, on another list, mentioned a 70% increase in traffic to 
Akamai which seems to correlate with a new Fortnite release




--

Aaron Wendel
Chief Technical Officer
Wholesale Internet, Inc. (AS 32097)
(816)550-9030
http://www.wholesaleinternet.com

RE: lots of traffic starting at 3 a.m. central time

[Luke Guillory]

That’s what I’m seeing as well, went  from 2.2G around 2:50AM CST to a peak of 
16G.


https://i.imgur.com/en89kyO.png








Luke Guillory
Vice President – Technology and Innovation


[cid:imageade5f7.JPG@f6770aff.4fbbcff1] 

Tel:985.536.1212
Fax:985.536.0300
Email:  lguill...@reservetele.com
Web:www.rtconline.com

Reserve Telecommunications
100 RTC Dr
Reserve, LA 70084





Disclaimer:
The information transmitted, including attachments, is intended only for the 
person(s) or entity to which it is addressed and may contain confidential 
and/or privileged material which should not disseminate, distribute or be 
copied. Please notify Luke Guillory immediately by e-mail if you have received 
this e-mail by mistake and delete this e-mail from your system. E-mail 
transmission cannot be guaranteed to be secure or error-free as information 
could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or 
contain viruses. Luke Guillory therefore does not accept liability for any 
errors or omissions in the contents of this message, which arise as a result of 
e-mail transmission.

From: NANOG [mailto:nanog-boun...@nanog.org] On Behalf Of Phil Lavin
Sent: Tuesday, October 15, 2019 10:48 AM
To: Aaron Gould; Nanog@nanog.org
Subject: RE: lots of traffic starting at 3 a.m. central time

> Anyone else see lots of traffic coming down starting at 3 a.m. central time ? 
>  all of my internet connections showed strangely larger load for a few early 
> morning hours.

Someone, on another list, mentioned a 70% increase in traffic to Akamai which 
seems to correlate with a new Fortnite release

RE: lots of traffic starting at 3 a.m. central time

[Phil Lavin]

> Anyone else see lots of traffic coming down starting at 3 a.m. central time ? 
>  all of my internet connections showed strangely larger load for a few early 
> morning hours.

Someone, on another list, mentioned a 70% increase in traffic to Akamai which 
seems to correlate with a new Fortnite release

lots of traffic starting at 3 a.m. central time

[Aaron Gould]

Anyone else see lots of traffic coming down starting at 3 a.m. central time
?  all of my internet connections showed strangely larger load for a few
early morning hours.

 

I have some info that tells me what it was but wanted to hear it from others
too.

 

-Aaron

Re: Comcast outages continue even in areas with PG power restored

[Matt Hoppes]

Except I’m not talking about CPE. I agree that’s the customer’s job. 

I’m talking about keeping the nodes up and running. 

> On Oct 15, 2019, at 7:50 AM, Brandon Martin  wrote:
> 
>> On 10/15/2019 09:42, Matt Hoppes wrote:
>> I disagree with the statement that providers should not be required to 
>> backup their networks while I don't think it should be an FCC 
>> requirement, I do believe the providers have an obligation to do that.
>> That's one of the reasons we generally opt for larger node sizes. Yes, it 
>> does cut down on the total bandwidth you can push out to end users, but in a 
>> disaster its much faster to recover as well as provide backup power that is 
>> up 24x7 vs hundreds of little nodes.
> 
> 
> I'm generally OK with the provider pushing demarc CPE backup power off onto 
> the customer unless they're providing "POTS-like" service.  Aside from POTS, 
> I don't think there's ever been expectation of telecommunications services 
> working during a power outage unless the end user provides backup power.  I'm 
> not even sure residential deployments of ISDN came with power for 
> customer-prem ATAs, etc. unless you made special arrangements, but ISDN was 
> never popular here, so I'm not sure. If you have a T1 PRI, the LEC will 
> probably keep it up to your prem, but you're responsible for keeping whatever 
> you're plugging that T1 into up during a power outage.  Heck, they may not 
> even do that.  I've certainly seen T1 smartjacks hosting real, honest PRIs 
> that were line-powering repeaters without battery on them, so who knows even 
> in that case.
> 
> After all, the user has to keep the equipment they're using up, too. That's 
> certainly not the provider's responsibility.  Telcos aren't power utilities 
> (usually, and when they are it's generally a separate operation).  Yes, I 
> understand that many users have wireless/portable in-home equipment with 
> batteries of their own and are often using all-in-one demarc/routers provided 
> by their provider, nowadays...
> 
> I do think that providers should generally at least offer some basic guidance 
> on how their users might accomplish this even going so far as to provide, 
> install, and maintain such means if paid to do so, but I don't think it's 
> something to be expected when you're buying cable TV or public Internet 
> access service.  Again, POTS-like service is different.
> 
> I do feel that modern IP providers really should strive to keep their end of 
> the network up regardless.  That is, even during a reasonable power outage, 
> providers should be able to deliver usable signal to their customers absent 
> actual damage to plant.  Exceptions made for natural disasters, fuel 
> shortages, and widespread, extended power outages that just overcome the 
> ability to shuttle portable gensets around fast enough to keep batteries 
> charged.  However, unless you're otherwise subject to regulation due to 
> monopoly status, having received ample amounts of build-out subsidy, or 
> providing historically regulated telecommunications services, I'm not sure 
> that regulation is the best way to achieve this.
> 
> --
> Brandon Martin

Re: Comcast outages continue even in areas with PG power restored

[Brandon Martin]

On 10/15/2019 09:42, Matt Hoppes wrote:
I disagree with the statement that providers should not be required to 
backup their networks while I don't think it should be an FCC 
requirement, I do believe the providers have an obligation to do that.


That's one of the reasons we generally opt for larger node sizes. Yes, 
it does cut down on the total bandwidth you can push out to end users, 
but in a disaster its much faster to recover as well as provide backup 
power that is up 24x7 vs hundreds of little nodes.



I'm generally OK with the provider pushing demarc CPE backup power off 
onto the customer unless they're providing "POTS-like" service.  Aside 
from POTS, I don't think there's ever been expectation of 
telecommunications services working during a power outage unless the end 
user provides backup power.  I'm not even sure residential deployments 
of ISDN came with power for customer-prem ATAs, etc. unless you made 
special arrangements, but ISDN was never popular here, so I'm not sure. 
If you have a T1 PRI, the LEC will probably keep it up to your prem, but 
you're responsible for keeping whatever you're plugging that T1 into up 
during a power outage.  Heck, they may not even do that.  I've certainly 
seen T1 smartjacks hosting real, honest PRIs that were line-powering 
repeaters without battery on them, so who knows even in that case.


After all, the user has to keep the equipment they're using up, too. 
That's certainly not the provider's responsibility.  Telcos aren't power 
utilities (usually, and when they are it's generally a separate 
operation).  Yes, I understand that many users have wireless/portable 
in-home equipment with batteries of their own and are often using 
all-in-one demarc/routers provided by their provider, nowadays...


I do think that providers should generally at least offer some basic 
guidance on how their users might accomplish this even going so far as 
to provide, install, and maintain such means if paid to do so, but I 
don't think it's something to be expected when you're buying cable TV or 
public Internet access service.  Again, POTS-like service is different.


I do feel that modern IP providers really should strive to keep their 
end of the network up regardless.  That is, even during a reasonable 
power outage, providers should be able to deliver usable signal to their 
customers absent actual damage to plant.  Exceptions made for natural 
disasters, fuel shortages, and widespread, extended power outages that 
just overcome the ability to shuttle portable gensets around fast enough 
to keep batteries charged.  However, unless you're otherwise subject to 
regulation due to monopoly status, having received ample amounts of 
build-out subsidy, or providing historically regulated 
telecommunications services, I'm not sure that regulation is the best 
way to achieve this.


--
Brandon Martin

Re: Comcast outages continue even in areas with PG power restored

[Matt Hoppes]

I disagree with the statement that providers should not be required to  
backup their networks while I don't think it should be an FCC  
requirement, I do believe the providers have an obligation to do that.


That's one of the reasons we generally opt for larger node sizes.  Yes,  
it does cut down on the total bandwidth you can push out to end users,  
but in a disaster its much faster to recover as well as provide backup  
power that is up 24x7 vs hundreds of little nodes.

Re: Request comment: list of IPs to block outbound

[Saku Ytti]

On Mon, 14 Oct 2019 at 09:30, Vincent Bernat  wrote:

> How much performance impact should we expect with uRPF?

Depends on the platform, but often it's 2nd lookup. So potentially 50%
decrease in performance. Some platforms it means FIB duplication. And
ultimately it doesn't really offer anything over ACL, which is, in
comparison, much cheaper feature.
I would encourage people to toolise this, then the ACL generation is
no cost or complexity. And you can use ACL for many BGP customers too,
as you create 'perfect' prefix-list for customer, you can reference to
same prefix-list in ACL, without actually needing customer to announce
that prefix, as it's entirely valid to originate traffic from
allowable prefix without advertising the prefix (to you).





-- 
  ++ytti

Problems sending emails to AT

[Grzegorz Janoszka]

Hi,

Whenever I try to send something to emails in @att.net I get a reply:

host ff-ip4-mx-vip1.prodigy.net[144.160.159.21] said:
553 5.3.0 flph831 DNSBL:RBL 521< MY.IP4.ADD.RES >_is_blocked.For 
assistance

forward this error to abuse_...@abuse-att.net (in reply to MAIL FROM
command)

Of course emails to abuse_rbl go unanswered.

My IP turns clean on https://www.dnsbl.info/ (all green and one blue 
timeout).


Anyone had such issues? Any working contacts to AT email?

Any help appreciated.

--
Grzegorz Janoszka

Re: Comcast outages continue even in areas with PG power restored

[Masataka Ohta]

Sean Donelan wrote:

Given that providers can't supply power to mobile phones,
that sending power over fiber is extremely eye unsafe
and that most CPEs are routers which themselves are
useless without end systems, it is reasonable that
providers are not required to supply power to home.

But,


The FCC is looking at standby power for cellular towers, but hasn't
been paying attention to wireline and cable systems outside plant
power.


why they are not equal?

Masataka Ohta