Re: akamai yesterday - what in the world was that

[Jared Mauch]

Apple did this with the original iPhone. Turned out even in their ecosystem 
they didn't get it right. The full restore images have always been there and 
diffs didn't reappear until you could "OTA" the device (WiFi)

I can't imagine how hard a console would be with every random app writing data 
wherever. 

Sandboxes and jails have been escaped as long as they have been around as well 
so they can help but are far from perfect 

Sent from my iCar

> On Jan 23, 2020, at 6:21 PM, Mike Hammett  wrote:
> 
> 
> If true (not arguing), that's really dumb.
> 
> 
> 
> -
> Mike Hammett
> Intelligent Computing Solutions
> http://www.ics-il.com
> 
> Midwest-IX
> http://www.midwest-ix.com
> 
> From: "Brandon Martin" 
> To: nanog@nanog.org
> Sent: Thursday, January 23, 2020 10:23:24 AM
> Subject: Re: akamai yesterday - what in the world was that
> 
> On 1/23/20 11:13 AM, Bryan Holloway wrote:
> > This echoed events a month or so ago, and I'm curious as to what is 
> > making these releases more, uh, network-impacting.
> 
> My understanding is that, in addition to factors others have mentioned 
> (games are larger, more network based delivery, etc.), that there's a 
> move AWAY from differential patching, to the extent it was previously 
> being used, toward simply delivering an entire new copy of the game, 
> including assets that completely duplicate those that someone may 
> already have.
> 
> Apparently the rationale is that this is easier on the publisher and 
> those preparing the release, which allows them to get things out sooner, 
> since they don't have to come up with a decent differential patcher and 
> can just make use of the delivery mechanisms already present on the 
> content platform the user is already using.
> 
> When you've got 100GB games with huge market penetration and each 
> "patch" is an entirely new copy of said 100GB game, that's a lot of traffic.
> -- 
> Brandon Martin
> 

Re: akamai yesterday - what in the world was that

[Mike Hammett]

If true (not arguing), that's really dumb. 




- 
Mike Hammett 
Intelligent Computing Solutions 
http://www.ics-il.com 

Midwest-IX 
http://www.midwest-ix.com 

- Original Message -

From: "Brandon Martin"  
To: nanog@nanog.org 
Sent: Thursday, January 23, 2020 10:23:24 AM 
Subject: Re: akamai yesterday - what in the world was that 

On 1/23/20 11:13 AM, Bryan Holloway wrote: 
> This echoed events a month or so ago, and I'm curious as to what is 
> making these releases more, uh, network-impacting. 

My understanding is that, in addition to factors others have mentioned 
(games are larger, more network based delivery, etc.), that there's a 
move AWAY from differential patching, to the extent it was previously 
being used, toward simply delivering an entire new copy of the game, 
including assets that completely duplicate those that someone may 
already have. 

Apparently the rationale is that this is easier on the publisher and 
those preparing the release, which allows them to get things out sooner, 
since they don't have to come up with a decent differential patcher and 
can just make use of the delivery mechanisms already present on the 
content platform the user is already using. 

When you've got 100GB games with huge market penetration and each 
"patch" is an entirely new copy of said 100GB game, that's a lot of traffic. 
-- 
Brandon Martin 

Re: akamai yesterday - what in the world was that

[Jon Lewis]

On Thu, 23 Jan 2020, Tom Deligiannis wrote:


In this scenario, which mechanism controls the download speed? I hear many 
users complain that their gigabit
internet connection is not maxing out and the update is taking forever. I would 
never expect a gigabit internet
connection to be saturated during a game update, but I'm curious how the 
throttling works.


Speaking from my CDN and service provider hats, I'd say upstream 
congestion.  If you're an end user with a gigabit internet connection, on 
a service that presumably has lots of customers with similarly large 
connections, it's a safe bet nothing upstream of you is provisioned with 
enough capacity to serve everyone running full speed.  Whether it's 
peering with the CDN, backhaul on your provider's network from the peering 
point to whereever you are, etc.  Something, or multiple something's, will 
run out of pipe in a traffic event like yesterday's.


--
 Jon Lewis, MCP :)   |  I route
 StackPath, Sr. Neteng   |  therefore you are
_ http://www.lewis.org/~jlewis/pgp for PGP public key_

Re: akamai yesterday - what in the world was that

[Filip Hruska]

Game updates are generally compressed chunks and the client does live 
decompression on the data.


As such, insufficient CPU or IO performance will result in lower overall 
speeds, since it can't keep up with the incoming stream of data.


Regards,
Filip

On 1/23/20 9:11 PM, Tom Deligiannis wrote:


I get annoyed when I'm chatting with friends, waiting to play some
game
we decided to download, and it's ONLY downloading at 300 megabits per
second! :P 



In this scenario, which mechanism controls the download speed? I hear 
many users complain that their gigabit internet connection is not 
maxing out and the update is taking forever. I would never expect a 
gigabit internet connection to be saturated during a game update, but 
I'm curious how the throttling works.


Thanks.

Re: akamai yesterday - what in the world was that

[bzs]

On January 23, 2020 at 19:52 p...@nashnetworks.ca (Paul Nash) wrote:
 > > While it makes me feel old, it’s also something that I marvel about 
 > > periodically.
 > 
 > A bit of perspective on bandwidth and feeling old.  The first non-academic 
 > connection from Africa (Usenet and Email, pre-Internet) ran at about 9600 
 > bps over a Telebit Trailblazer in my living room.
 > 
 > The first non-academic IP connection was a satellite connection (64Kbps 
 > IIRC, not in my living room :-)).

Someone asked about Antarctica recently.

I remember the day in the 80s when they, I'm pretty sure McMurdo
Station, got its first "internet" connection. It was announced on
lists like this one.

It was a satellite which was good for only so many minutes per day as
it flew in and out of sight and exchanged batched email etc via Kermit
at probably around 9600bps if that, probably variable depending on
conditions.

If I may...which also reminds me of a project in Africa which used
some sort of wireless link (probably packet-radio) on top of buses.

People with the right equipment could get a batch exchange as a bus
drove by. I'm pretty certain that really was implemented and used.

No idea what the bandwidth was, I think packet-radio in that era
generally was glad to achieve around 1200bps.

Moral: Really, really, bad connectivity is a zillion times better than
no connectivity.

-- 
-Barry Shein

Software Tool & Die| b...@theworld.com | http://www.TheWorld.com
Purveyors to the Trade | Voice: +1 617-STD-WRLD   | 800-THE-WRLD
The World: Since 1989  | A Public Information Utility | *oo*

Re: akamai yesterday - what in the world was that

[Tom Deligiannis]

>
> I get annoyed when I'm chatting with friends, waiting to play some game
> we decided to download, and it's ONLY downloading at 300 megabits per
> second! :P


In this scenario, which mechanism controls the download speed? I hear many
users complain that their gigabit internet connection is not maxing out and
the update is taking forever. I would never expect a gigabit internet
connection to be saturated during a game update, but I'm curious how the
throttling works.

Thanks.


>

On Thu, Jan 23, 2020 at 1:22 PM Chris Adams  wrote:

> Once upon a time, Hugo Slabbert  said:
> > > This just follows the same rules as networks have always seemed to; If
> > you build it, they will come, and you'll have to build more. :)
> >
> > https://en.m.wikipedia.org/wiki/Induced_demand
>
> Yep, just like your disk space requirements will always grow to 110% of
> available space.
>
> I get annoyed when I'm chatting with friends, waiting to play some game
> we decided to download, and it's ONLY downloading at 300 megabits per
> second! :P
> --
> Chris Adams 
>

Prefixes blocked by Verisign, can’t reach Root DNS Server?

[Nandipati, Naveen via NANOG]

Hi Kushal,

As discussed privately this was resolved by forwarding traffic through an 
alternate upstream carrier. The issue arose due to lack of return path from 
Verisign to your network through the common peer and can also be resolved by 
announcing all your internal prefixes to our common peering partner. Feel free 
to reach out for any further support from Verisign.
--
Thanks
Naveen

Re: akamai yesterday - what in the world was that

[Brian K Miller]

It was a 48GB for PC, or 12GB+ XBOX/PS4 update for Call of Duty.

Traffic doubled to our dorms after 4pm, and I had to shift traffic around for 
multiple R members last night.  My weathermap doesn’t turn orange or red 
often, but it did yesterday.

Brian Miller
Clemson University/C-Light
Network Services

From: NANOG  on behalf of james jones 

Date: Thursday, January 23, 2020 at 10:38 AM
To: NANOG list 
Subject: Re: akamai yesterday - what in the world was that

  Fornite update?

On Thu, Jan 23, 2020 at 10:22 AM Jared Mauch 
mailto:ja...@puck.nether.net>> wrote:


> On Jan 23, 2020, at 10:16 AM, Kaiser, Erich 
> mailto:er...@gotfusion.net>> wrote:
>
> Yeah we saw that as well. Must be a game release or something.

Yes, that’s my understanding as well.

- Jared

Re: akamai yesterday - what in the world was that

[Jared Mauch]

> On Jan 23, 2020, at 2:21 PM, Kaiser, Erich  wrote:
> 
> Except the CDN providing the content did not anticipate this type of influx 
> (How come I am not sure probably more concerned about new business revenue 
> and not thinking about the backend infrastructure) and has pushed over costly 
> peers for most of us.  BTW, we are still waiting for our PNIs with them.
> Very frustrating…

Can be for large orgs that are dysfunctional as well.  This is somewhat typical 
of large companies and we usually try to not air all our internal drama in 
public.

It’s entirely possible there’s numerous problems with blame to go around.

It can also take longer than we’d like to get things done as well.

I can assure you everyone is acting in good faith here, even if it doesn’t seem 
that way.  Sometimes errors aren’t caught immediately and sometimes people go 
on leave, etc..  The rest of the dialogue should happen off-list though.

- Jared

Re: Prefixes blocked by Verisign, can’t reach Root DNS Server?

[Kushal R. via NANOG]

Someone contacted off the list and got this sorted.

--

Kushal R. | Management
Office: +1-8557374335 (Global) | +91-8080807931 (India)

WhatsApp: +1-3104050010 (Global) | +91-9834801976 (India)

host4geeks.com
host4geeks.in



On 23 Jan 2020, 11:20 PM +0530, "Kushal R." , wrote:
> Hi all,
>
> Anyone from Verisign available here and can contact off the list?
>
> It appears that a couple of our prefixes are being blocked from reaching a 
> root DNS server hosted there.
>
> Thanks.
>
> --
>
> Kushal R. | Management
> Office: +1-8557374335 (Global) | +91-8080807931 (India)
>
> WhatsApp: +1-3104050010 (Global) | +91-9834801976 (India)
>
> host4geeks.com
> host4geeks.in
>
>
>

Re: akamai yesterday - what in the world was that

[Paul Nash]

> I find it both happy and disturbing.  I remember the first 2.4/2.5g links I 
> turned up as well as the first 10g and (eventually) the first 100g links.
> 
> I was leaving the house earlier this week thinking about how it used to be 
> Mbps of traffic that was a lot and now it’s Gbps and how that’s shifted to 
> Tbps.
> 
> While it makes me feel old, it’s also something that I marvel about 
> periodically.

A bit of perspective on bandwidth and feeling old.  The first non-academic 
connection from Africa (Usenet and Email, pre-Internet) ran at about 9600 bps 
over a Telebit Trailblazer in my living room.

The first non-academic IP connection was a satellite connection (64Kbps IIRC, 
not in my living room :-)).

Now we have a bajillion Gbps over submarine fibre landing pretty much 
everywhere, and my guess is that it is not enough bandwidth.

All this to bring such vital resources as Facebook and Netflix :-)

paul

Re: Spectrum technical contact

[Josh Luthman]

Just saw this (dealing with a different issue) and thought I would keep all
the information in one conversation.

I now have to use the community: 7843:666 to black hole.  I peer with 10796.

I don't know where the line is, but since there are multiple ASNs with
"Spectrum" or whatever company you want to call it.  My billing and
administration is all Charter, circuit id is TWCC.

Josh Luthman
Office: 937-552-2340
Direct: 937-552-2343
1100 Wayne St
Suite 1337
Troy, OH 45373


On Sun, Dec 23, 2018 at 12:13 PM Aaron1  wrote:

> I’m glad you got it figured out with the right people at spectrum.  When I
> was sitting up ddos rtbh with my 3 isp’s , I remember spectrum (fka
> twc/charter) was difficult to get the right person on the phone to help me
> understand what I needed to do.  I had to go through layers of phone
> attendants and groups to get to someone who knew about ddos rtbh.
>
> Btw, I’ve wondered about using sp-neutral(agnostic) forms of ddos rtbh...
> maybe cymru utrs combined with fastnetmon for immediate mitigation without
> human intervention.  I’d really like to get there.
>
> Aaron
>
> On Dec 23, 2018, at 1:28 AM, Josh Luthman 
> wrote:
>
> Got a hold of someone, finally!  All you have to do, if it's done through
> BGP, is set a community to 10796:666
>
> This was setup as Time Warner Cable but is Spectrum today.  The people I
> spoke with had been with Time Warner Cable for years before the
> acquisition/name change.
>
> Josh Luthman
> Office: 937-552-2340
> Direct: 937-552-2343
> 1100 Wayne St
> Suite 1337
> Troy, OH 45373
>
>
> On Sun, Dec 23, 2018 at 12:53 AM Josh Luthman 
> wrote:
>
>> Attack is back on.  If there's anyone out there that works at Spectrum
>> and can do a route change and hopefully share some info on BGP communities
>> I would greatly appreciate hearing from you.
>>
>> Josh Luthman
>> Office: 937-552-2340
>> Direct: 937-552-2343
>> 1100 Wayne St
>> Suite 1337
>> Troy, OH 45373
>>
>> On Sun, Dec 23, 2018, 12:12 AM Tim Warnock >
>>> > That’s where you confuse me Josh, if you do BGP with them wouldn’t it
>>> be
>>> > your advertisement to them that’s causing them to route to you.  In
>>> other
>>> > words, aren’t they only routing packets to you for prefixes that you
>>> advertise
>>> > via BGP to them?
>>>
>>> Unless of course the point-to-point between spectrum and Josh is under
>>> attack...?
>>>
>>

Re: akamai yesterday - what in the world was that

[Töma Gavrichenkov]

Peace,

On Thu, Jan 23, 2020 at 8:58 PM Kevin McCormick  wrote:

> Just found the size of the updates, 48 GB on PC, 13 GB on PS4, and 18 GB
> on Xbox One.
>

Whoa.

We used to rack our brains with P2P protocols in the past in order to
server just 1/20th of that.  It's been a long decade indeed.

--
Töma

Re: akamai yesterday - what in the world was that

[Kaiser, Erich]

Except the CDN providing the content did not anticipate this type of influx
(How come I am not sure probably more concerned about new business revenue
and not thinking about the backend infrastructure) and has pushed over
costly peers for most of us.  BTW, we are still waiting for our PNIs with
them.Very frustrating...


Erich Kaiser
The Fusion Network



On Thu, Jan 23, 2020 at 11:45 AM Hugo Slabbert  wrote:

> > This just follows the same rules as networks have always seemed to; If
> you build it, they will come, and you'll have to build more. :)
>
> https://en.m.wikipedia.org/wiki/Induced_demand
>
> :-)
>
>
> On Thu., Jan. 23, 2020, 09:40 Tom Beecher  wrote:
>
>> I think this is a tribute to how we’ve built and upgraded networks for
>>> capacity and speed.
>>>
>>
>> I think it's spot on.
>>
>> In years past it made more sense to distribute smaller , incremental
>> patches. More work on the software side, but it was likely a better option
>> than getting blasted on Twitter because "OMG I WANT TO PLAY AND MY DOWNLOAD
>> IS TAKING 8 HOURS".
>>
>> This just follows the same rules as networks have always seemed to; If
>> you build it, they will come, and you'll have to build more. :)
>>
>> On Thu, Jan 23, 2020 at 11:57 AM Jared Mauch 
>> wrote:
>>
>>>
>>>
>>> > On Jan 23, 2020, at 11:52 AM, Valdis Klētnieks <
>>> valdis.kletni...@vt.edu> wrote:
>>> >
>>> > On Thu, 23 Jan 2020 17:13:15 +0100, Bryan Holloway said:
>>> >
>>> >> Game releases are hardly a new thing, but these last two events seem
>>> to
>>> >> be almost an order of magnitude higher than what we're used to (at
>>> least
>>> >> on our predominantly eyeball network.)
>>> >>
>>> >> Any thoughts from the community? We're taking steps to accommodate,
>>> but
>>> >> from a capacity-planning perspective, this seems non-linear to me.
>>> >
>>> > Be prepared for an entire new world of hurt this holiday season. Sony
>>> has already
>>> > confirmed that PS5 releases will ship on 100Gbyte blu-ray disks.
>>> Which means that
>>> > download sizes will be comparable…
>>>
>>> There’s also the “we will stream you all the data things” I keep hearing
>>> about like the
>>> Consoles without discs or some other thing I can’t remember the name of.
>>>
>>> I think this is a tribute to how we’ve built and upgraded networks for
>>> capacity and speed.
>>>
>>> - Jared
>>>
>>>

Re: akamai yesterday - what in the world was that

[Chris Adams]

Once upon a time, Hugo Slabbert  said:
> > This just follows the same rules as networks have always seemed to; If
> you build it, they will come, and you'll have to build more. :)
> 
> https://en.m.wikipedia.org/wiki/Induced_demand

Yep, just like your disk space requirements will always grow to 110% of
available space.

I get annoyed when I'm chatting with friends, waiting to play some game
we decided to download, and it's ONLY downloading at 300 megabits per
second! :P
-- 
Chris Adams 

Re: akamai yesterday - what in the world was that

[Jared Mauch]

> On Jan 23, 2020, at 1:25 PM, Warren Kumari  wrote:
> 
> On Thu, Jan 23, 2020 at 12:45 PM Hugo Slabbert  wrote:
>> 
>>> This just follows the same rules as networks have always seemed to; If you 
>>> build it, they will come, and you'll have to build more. :)
>> 
>> https://en.m.wikipedia.org/wiki/Induced_demand
>> 
> 
> Yup, there is also (in networking at least) suppressed demand -- I'm
> sure we've all seen capacity planning discussions along the lines of:
> "My 1GE is running at 95% capacity - I'm replacing it with a 10GE and
> it will be around 10% used... wait?! What?! It's now at 7Gbps?! How
> the hell did that happen?!" scenarios. They usedto be funny, but these
> days I just find it depressing...

I find it both happy and disturbing.  I remember the first 2.4/2.5g links I 
turned up as well as the first 10g and (eventually) the first 100g links.

I was leaving the house earlier this week thinking about how it used to be Mbps 
of traffic that was a lot and now it’s Gbps and how that’s shifted to Tbps.

While it makes me feel old, it’s also something that I marvel about 
periodically.

- jared

Re: akamai yesterday - what in the world was that

[Warren Kumari]

On Thu, Jan 23, 2020 at 12:45 PM Hugo Slabbert  wrote:
>
> > This just follows the same rules as networks have always seemed to; If you 
> > build it, they will come, and you'll have to build more. :)
>
> https://en.m.wikipedia.org/wiki/Induced_demand
>

Yup, there is also (in networking at least) suppressed demand -- I'm
sure we've all seen capacity planning discussions along the lines of:
"My 1GE is running at 95% capacity - I'm replacing it with a 10GE and
it will be around 10% used... wait?! What?! It's now at 7Gbps?! How
the hell did that happen?!" scenarios. They usedto be funny, but these
days I just find it depressing...

W

> :-)
>
>
> On Thu., Jan. 23, 2020, 09:40 Tom Beecher  wrote:
>>>
>>> I think this is a tribute to how we’ve built and upgraded networks for 
>>> capacity and speed.
>>
>>
>> I think it's spot on.
>>
>> In years past it made more sense to distribute smaller , incremental 
>> patches. More work on the software side, but it was likely a better option 
>> than getting blasted on Twitter because "OMG I WANT TO PLAY AND MY DOWNLOAD 
>> IS TAKING 8 HOURS".
>>
>> This just follows the same rules as networks have always seemed to; If you 
>> build it, they will come, and you'll have to build more. :)
>>
>> On Thu, Jan 23, 2020 at 11:57 AM Jared Mauch  wrote:
>>>
>>>
>>>
>>> > On Jan 23, 2020, at 11:52 AM, Valdis Klētnieks  
>>> > wrote:
>>> >
>>> > On Thu, 23 Jan 2020 17:13:15 +0100, Bryan Holloway said:
>>> >
>>> >> Game releases are hardly a new thing, but these last two events seem to
>>> >> be almost an order of magnitude higher than what we're used to (at least
>>> >> on our predominantly eyeball network.)
>>> >>
>>> >> Any thoughts from the community? We're taking steps to accommodate, but
>>> >> from a capacity-planning perspective, this seems non-linear to me.
>>> >
>>> > Be prepared for an entire new world of hurt this holiday season. Sony has 
>>> > already
>>> > confirmed that PS5 releases will ship on 100Gbyte blu-ray disks.  Which 
>>> > means that
>>> > download sizes will be comparable…
>>>
>>> There’s also the “we will stream you all the data things” I keep hearing 
>>> about like the
>>> Consoles without discs or some other thing I can’t remember the name of.
>>>
>>> I think this is a tribute to how we’ve built and upgraded networks for 
>>> capacity and speed.
>>>
>>> - Jared
>>>


-- 
I don't think the execution is relevant when it was obviously a bad
idea in the first place.
This is like putting rabid weasels in your pants, and later expressing
regret at having chosen those particular rabid weasels and that pair
of pants.
   ---maf

RE: akamai yesterday - what in the world was that

[Kevin McCormick]

Just found the size of the updates, 48 GB on PC, 13 GB on PS4, and 18 GB on 
Xbox One. Makes sense why the college residence halls we supply internet to 
were pulling so much data. All those systems if left on would pull a lot of 
data.

Thank you,

Kevin McCormick

From: NANOG  On Behalf Of Todd Baumgartner
Sent: Thursday, January 23, 2020 9:30 AM
To: Jared Mauch 
Cc: NANOG list 
Subject: Re: akamai yesterday - what in the world was that

Call of Duty Modern Warfare Update came out yesterday.


https://dotesports.com/call-of-duty/news/cod-mw-update-version-1-13

On Thu, 23 Jan 2020 at 10:21, Jared Mauch 
mailto:ja...@puck.nether.net>> wrote:


> On Jan 23, 2020, at 10:16 AM, Kaiser, Erich 
> mailto:er...@gotfusion.net>> wrote:
>
> Yeah we saw that as well. Must be a game release or something.

Yes, that’s my understanding as well.

- Jared

Prefixes blocked by Verisign, can’t reach Root DNS Server?

[Kushal R. via NANOG]

Hi all,

Anyone from Verisign available here and can contact off the list?

It appears that a couple of our prefixes are being blocked from reaching a root 
DNS server hosted there.

Thanks.

--

Kushal R. | Management
Office: +1-8557374335 (Global) | +91-8080807931 (India)

WhatsApp: +1-3104050010 (Global) | +91-9834801976 (India)

host4geeks.com
host4geeks.in

Re: akamai yesterday - what in the world was that

[Hugo Slabbert]

> This just follows the same rules as networks have always seemed to; If
you build it, they will come, and you'll have to build more. :)

https://en.m.wikipedia.org/wiki/Induced_demand

:-)


On Thu., Jan. 23, 2020, 09:40 Tom Beecher  wrote:

> I think this is a tribute to how we’ve built and upgraded networks for
>> capacity and speed.
>>
>
> I think it's spot on.
>
> In years past it made more sense to distribute smaller , incremental
> patches. More work on the software side, but it was likely a better option
> than getting blasted on Twitter because "OMG I WANT TO PLAY AND MY DOWNLOAD
> IS TAKING 8 HOURS".
>
> This just follows the same rules as networks have always seemed to; If you
> build it, they will come, and you'll have to build more. :)
>
> On Thu, Jan 23, 2020 at 11:57 AM Jared Mauch 
> wrote:
>
>>
>>
>> > On Jan 23, 2020, at 11:52 AM, Valdis Klētnieks 
>> wrote:
>> >
>> > On Thu, 23 Jan 2020 17:13:15 +0100, Bryan Holloway said:
>> >
>> >> Game releases are hardly a new thing, but these last two events seem to
>> >> be almost an order of magnitude higher than what we're used to (at
>> least
>> >> on our predominantly eyeball network.)
>> >>
>> >> Any thoughts from the community? We're taking steps to accommodate, but
>> >> from a capacity-planning perspective, this seems non-linear to me.
>> >
>> > Be prepared for an entire new world of hurt this holiday season. Sony
>> has already
>> > confirmed that PS5 releases will ship on 100Gbyte blu-ray disks.  Which
>> means that
>> > download sizes will be comparable…
>>
>> There’s also the “we will stream you all the data things” I keep hearing
>> about like the
>> Consoles without discs or some other thing I can’t remember the name of.
>>
>> I think this is a tribute to how we’ve built and upgraded networks for
>> capacity and speed.
>>
>> - Jared
>>
>>

RE: akamai yesterday - what in the world was that

[jdambrosia]

Love it Love it Love it

 

I have been telling people that the IEEE 802.3 Ethernet Working Group needs to 
start looking beyond 400 Gb/s Ethernet.  It’s only a matter of time where we 
will need it!

 

From: NANOG  On Behalf Of Tom Beecher
Sent: Thursday, January 23, 2020 6:39 PM
To: Jared Mauch 
Cc: NANOG list 
Subject: Re: akamai yesterday - what in the world was that

 

I think this is a tribute to how we’ve built and upgraded networks for capacity 
and speed.

 

I think it's spot on. 

 

In years past it made more sense to distribute smaller , incremental patches. 
More work on the software side, but it was likely a better option than getting 
blasted on Twitter because "OMG I WANT TO PLAY AND MY DOWNLOAD IS TAKING 8 
HOURS". 

 

This just follows the same rules as networks have always seemed to; If you 
build it, they will come, and you'll have to build more. :) 

 

On Thu, Jan 23, 2020 at 11:57 AM Jared Mauch mailto:ja...@puck.nether.net> > wrote:



> On Jan 23, 2020, at 11:52 AM, Valdis Klētnieks   > wrote:
> 
> On Thu, 23 Jan 2020 17:13:15 +0100, Bryan Holloway said:
> 
>> Game releases are hardly a new thing, but these last two events seem to
>> be almost an order of magnitude higher than what we're used to (at least
>> on our predominantly eyeball network.)
>> 
>> Any thoughts from the community? We're taking steps to accommodate, but
>> from a capacity-planning perspective, this seems non-linear to me.
> 
> Be prepared for an entire new world of hurt this holiday season. Sony has 
> already
> confirmed that PS5 releases will ship on 100Gbyte blu-ray disks.  Which means 
> that
> download sizes will be comparable…

There’s also the “we will stream you all the data things” I keep hearing about 
like the
Consoles without discs or some other thing I can’t remember the name of.

I think this is a tribute to how we’ve built and upgraded networks for capacity 
and speed.

- Jared

Re: akamai yesterday - what in the world was that

[Tom Beecher]

>
> I think this is a tribute to how we’ve built and upgraded networks for
> capacity and speed.
>

I think it's spot on.

In years past it made more sense to distribute smaller , incremental
patches. More work on the software side, but it was likely a better option
than getting blasted on Twitter because "OMG I WANT TO PLAY AND MY DOWNLOAD
IS TAKING 8 HOURS".

This just follows the same rules as networks have always seemed to; If you
build it, they will come, and you'll have to build more. :)

On Thu, Jan 23, 2020 at 11:57 AM Jared Mauch  wrote:

>
>
> > On Jan 23, 2020, at 11:52 AM, Valdis Klētnieks 
> wrote:
> >
> > On Thu, 23 Jan 2020 17:13:15 +0100, Bryan Holloway said:
> >
> >> Game releases are hardly a new thing, but these last two events seem to
> >> be almost an order of magnitude higher than what we're used to (at least
> >> on our predominantly eyeball network.)
> >>
> >> Any thoughts from the community? We're taking steps to accommodate, but
> >> from a capacity-planning perspective, this seems non-linear to me.
> >
> > Be prepared for an entire new world of hurt this holiday season. Sony
> has already
> > confirmed that PS5 releases will ship on 100Gbyte blu-ray disks.  Which
> means that
> > download sizes will be comparable…
>
> There’s also the “we will stream you all the data things” I keep hearing
> about like the
> Consoles without discs or some other thing I can’t remember the name of.
>
> I think this is a tribute to how we’ve built and upgraded networks for
> capacity and speed.
>
> - Jared
>
>

Re: akamai yesterday - what in the world was that

[Jared Mauch]

> On Jan 23, 2020, at 11:52 AM, Valdis Klētnieks  
> wrote:
> 
> On Thu, 23 Jan 2020 17:13:15 +0100, Bryan Holloway said:
> 
>> Game releases are hardly a new thing, but these last two events seem to
>> be almost an order of magnitude higher than what we're used to (at least
>> on our predominantly eyeball network.)
>> 
>> Any thoughts from the community? We're taking steps to accommodate, but
>> from a capacity-planning perspective, this seems non-linear to me.
> 
> Be prepared for an entire new world of hurt this holiday season. Sony has 
> already
> confirmed that PS5 releases will ship on 100Gbyte blu-ray disks.  Which means 
> that
> download sizes will be comparable…

There’s also the “we will stream you all the data things” I keep hearing about 
like the
Consoles without discs or some other thing I can’t remember the name of.

I think this is a tribute to how we’ve built and upgraded networks for capacity 
and speed.

- Jared

Re: akamai yesterday - what in the world was that

[Valdis Klētnieks]

On Thu, 23 Jan 2020 17:13:15 +0100, Bryan Holloway said:

> Game releases are hardly a new thing, but these last two events seem to
> be almost an order of magnitude higher than what we're used to (at least
> on our predominantly eyeball network.)
>
> Any thoughts from the community? We're taking steps to accommodate, but
> from a capacity-planning perspective, this seems non-linear to me.

Be prepared for an entire new world of hurt this holiday season. Sony has 
already
confirmed that PS5 releases will ship on 100Gbyte blu-ray disks.  Which means 
that
download sizes will be comparable...


pgpnh34uf9O1n.pgp
Description: PGP signature

Re: akamai yesterday - what in the world was that

[Brandon Martin]

On 1/23/20 11:13 AM, Bryan Holloway wrote:
This echoed events a month or so ago, and I'm curious as to what is 
making these releases more, uh, network-impacting.


My understanding is that, in addition to factors others have mentioned 
(games are larger, more network based delivery, etc.), that there's a 
move AWAY from differential patching, to the extent it was previously 
being used, toward simply delivering an entire new copy of the game, 
including assets that completely duplicate those that someone may 
already have.


Apparently the rationale is that this is easier on the publisher and 
those preparing the release, which allows them to get things out sooner, 
since they don't have to come up with a decent differential patcher and 
can just make use of the delivery mechanisms already present on the 
content platform the user is already using.


When you've got 100GB games with huge market penetration and each 
"patch" is an entirely new copy of said 100GB game, that's a lot of traffic.

--
Brandon Martin

Re: akamai yesterday - what in the world was that

[james jones]

People have faster connections these days?

On Thu, Jan 23, 2020 at 11:14 AM Bryan Holloway  wrote:

> This echoed events a month or so ago, and I'm curious as to what is
> making these releases more, uh, network-impacting.
>
> Game releases are hardly a new thing, but these last two events seem to
> be almost an order of magnitude higher than what we're used to (at least
> on our predominantly eyeball network.)
>
> Any thoughts from the community? We're taking steps to accommodate, but
> from a capacity-planning perspective, this seems non-linear to me.
>
> Or is it just in my head?
>
>
> On 1/23/20 9:20 AM, Jared Mauch wrote:
> >
> >
> >> On Jan 23, 2020, at 10:16 AM, Kaiser, Erich 
> wrote:
> >>
> >> Yeah we saw that as well. Must be a game release or something.
> >
> > Yes, that’s my understanding as well.
> >
> > - Jared
> >
>

Re: akamai yesterday - what in the world was that

[Todd Baumgartner]

Call of Duty Modern Warfare Update came out yesterday.


https://dotesports.com/call-of-duty/news/cod-mw-update-version-1-13

On Thu, 23 Jan 2020 at 10:21, Jared Mauch  wrote:

>
>
> > On Jan 23, 2020, at 10:16 AM, Kaiser, Erich  wrote:
> >
> > Yeah we saw that as well. Must be a game release or something.
>
> Yes, that’s my understanding as well.
>
> - Jared

Re: akamai yesterday - what in the world was that

[Chris Adams]

Once upon a time, Bryan Holloway  said:
> Game releases are hardly a new thing, but these last two events seem
> to be almost an order of magnitude higher than what we're used to
> (at least on our predominantly eyeball network.)

Games are bigger now, and more people are downloading (rather than
buying discs)?  I have games on my Xbox that are over 100G.
-- 
Chris Adams 

Re: akamai yesterday - what in the world was that

[Bryan Holloway]

This echoed events a month or so ago, and I'm curious as to what is 
making these releases more, uh, network-impacting.


Game releases are hardly a new thing, but these last two events seem to 
be almost an order of magnitude higher than what we're used to (at least 
on our predominantly eyeball network.)


Any thoughts from the community? We're taking steps to accommodate, but 
from a capacity-planning perspective, this seems non-linear to me.


Or is it just in my head?


On 1/23/20 9:20 AM, Jared Mauch wrote:




On Jan 23, 2020, at 10:16 AM, Kaiser, Erich  wrote:

Yeah we saw that as well. Must be a game release or something.


Yes, that’s my understanding as well.

- Jared

Re: akamai yesterday - what in the world was that

[james jones]

  Fornite update?

On Thu, Jan 23, 2020 at 10:22 AM Jared Mauch  wrote:

>
>
> > On Jan 23, 2020, at 10:16 AM, Kaiser, Erich  wrote:
> >
> > Yeah we saw that as well. Must be a game release or something.
>
> Yes, that’s my understanding as well.
>
> - Jared

Re: akamai yesterday - what in the world was that

[Ahmed Borno]

Bezos phone sending Videos to MBS :) What a S Show.

On Thu, Jan 23, 2020 at 7:22 AM Jared Mauch  wrote:
>
>
>
> > On Jan 23, 2020, at 10:16 AM, Kaiser, Erich  wrote:
> >
> > Yeah we saw that as well. Must be a game release or something.
>
> Yes, that’s my understanding as well.
>
> - Jared

RE: akamai yesterday - what in the world was that

[Luke Guillory]

Modern Warfare update is what I'm being told. 

I did around 4Gpbs from the Xbox network and 1.5Gbps via PS. 



-Original Message-
From: NANOG  On Behalf Of Jared Mauch
Sent: Thursday, January 23, 2020 9:21 AM
To: Kaiser, Erich 
Cc: NANOG list 
Subject: Re: akamai yesterday - what in the world was that

*External Email: Use Caution*

> On Jan 23, 2020, at 10:16 AM, Kaiser, Erich  wrote:
>
> Yeah we saw that as well. Must be a game release or something.

Yes, that’s my understanding as well.

- Jared

Re: akamai yesterday - what in the world was that

[Jared Mauch]

> On Jan 23, 2020, at 10:16 AM, Kaiser, Erich  wrote:
> 
> Yeah we saw that as well. Must be a game release or something.

Yes, that’s my understanding as well.

- Jared

Re: akamai yesterday - what in the world was that

[Kaiser, Erich]

Yeah we saw that as well. Must be a game release or something.


Erich Kaiser
The Fusion Network



On Thu, Jan 23, 2020 at 9:14 AM Aaron Gould  wrote:

> My gosh, what in the word was that coming out of my local Akamai aanp
> servers yesterday !?  starting at about 12:00 noon central time lasting
> several hours ?
>
>
>
> -Aaron
>

akamai yesterday - what in the world was that

[Aaron Gould]

My gosh, what in the word was that coming out of my local Akamai aanp
servers yesterday !?  starting at about 12:00 noon central time lasting
several hours ?

 

-Aaron

Re: Equinix Dallas IXP ? Down ?

[Faisal Imtiaz]

Thank you ..looks like a localized issue only affecting out port.


Regards,

Faisal Imtiaz
fai...@snappytelecom.net
Tel: 305-663-5518 ext 232

(sent from mobile device)


From: Kaiser, Erich 
Sent: Thursday, January 23, 2020 9:59:21 AM
To: Tom Beecher 
Cc: Faisal Imtiaz ; nanog@nanog.org 
Subject: Re: Equinix Dallas IXP ? Down ?

No issues here.

Erich Kaiser
The Fusion Network



On Thu, Jan 23, 2020 at 8:48 AM Tom Beecher  wrote:
I see no issues on 2 separate Equinix Dallas connections.

On Thu, Jan 23, 2020 at 9:16 AM Faisal Imtiaz 
mailto:fai...@snappytelecom.net>> wrote:
Hello,
Quick question, is there known issue with Equinix Dallas IXP ?
(Or it is just our connection ?  Seeing all peers down).

Thanks.
Regards.

Faisal Imtiaz
Snappy Internet & Telecom
http://www.snappytelecom.net

Tel: 305 663 5518 x 232

Help-desk: (305)663-5518 Option 2 or Email: 
supp...@snappytelecom.net>

Re: Equinix Dallas IXP ? Down ?

[Kaiser, Erich]

No issues here.

Erich Kaiser
The Fusion Network



On Thu, Jan 23, 2020 at 8:48 AM Tom Beecher  wrote:

> I see no issues on 2 separate Equinix Dallas connections.
>
> On Thu, Jan 23, 2020 at 9:16 AM Faisal Imtiaz 
> wrote:
>
>> Hello,
>> Quick question, is there known issue with Equinix Dallas IXP ?
>> (Or it is just our connection ?  Seeing all peers down).
>>
>> Thanks.
>> Regards.
>>
>> Faisal Imtiaz
>> Snappy Internet & Telecom
>> http://www.snappytelecom.net
>>
>> Tel: 305 663 5518 x 232
>>
>> Help-desk: (305)663-5518 Option 2 or Email: supp...@snappytelecom.net
>> 
>>
>>

Re: Equinix Dallas IXP ? Down ?

[Tom Beecher]

I see no issues on 2 separate Equinix Dallas connections.

On Thu, Jan 23, 2020 at 9:16 AM Faisal Imtiaz 
wrote:

> Hello,
> Quick question, is there known issue with Equinix Dallas IXP ?
> (Or it is just our connection ?  Seeing all peers down).
>
> Thanks.
> Regards.
>
> Faisal Imtiaz
> Snappy Internet & Telecom
> http://www.snappytelecom.net
>
> Tel: 305 663 5518 x 232
>
> Help-desk: (305)663-5518 Option 2 or Email: supp...@snappytelecom.net
> 
>
>

Equinix Dallas IXP ? Down ?

[Faisal Imtiaz]

Hello,
Quick question, is there known issue with Equinix Dallas IXP ?
(Or it is just our connection ?  Seeing all peers down).

Thanks.
Regards.

Faisal Imtiaz
Snappy Internet & Telecom
http://www.snappytelecom.net

Tel: 305 663 5518 x 232

Help-desk: (305)663-5518 Option 2 or Email: 
supp...@snappytelecom.net