Re: Centurylink having a bad morning? [EXTERNAL]

[Hank Nussbacher]

  
  
On 30/08/2020 18:22, Joseph Jenkins
  wrote:


  
  Well at least it looks like the issue is starting
to resolve  and stuff is coming back up.
  
  
On Sun, Aug 30, 2020 at 8:21
  AM Matt Hoppes 
  wrote:

Is
  this what happens when your entire network is database driven?

  



See:
https://status.ctl.io/
and specifically:
https://status.ctl.io/history/f19a0555-abbd-4038-91cb-b55a7645c1f5


Regards,
  Hank
Caveat: The views expressed above are solely my own and do not
  express the views or opinions of my employer 

  

Re: Centurylink having a bad morning? [EXTERNAL]

[Joseph Jenkins]

Well at least it looks like the issue is starting to resolve  and stuff is
coming back up.

On Sun, Aug 30, 2020 at 8:21 AM Matt Hoppes <
mattli...@rivervalleyinternet.net> wrote:

> Is this what happens when your entire network is database driven?
>

Re: Centurylink having a bad morning? [EXTERNAL]

[Matt Hoppes]

Is this what happens when your entire network is database driven?

RE: Centurylink having a bad morning? [EXTERNAL]

[Romeo Czumbil]

Their route-servers just can’t keep up.
They are not getting our community-string  announcements at all


From: NANOG  On Behalf Of 
Drew Weaver
Sent: Sunday, August 30, 2020 8:38 AM
To: 'David Hubbard' ; 'nanog@nanog.org' 

Subject: RE: Centurylink having a bad morning? [EXTERNAL]

Yeah, I am still seeing them announce our Ips even though we’ve shut down our 
sessions with them.


From: NANOG 
mailto:nanog-bounces+drew.weaver=thenap@nanog.org>>
 On Behalf Of David Hubbard
Sent: Sunday, August 30, 2020 8:28 AM
To: nanog@nanog.org<mailto:nanog@nanog.org>
Subject: Re: Centurylink having a bad morning?

Same.  Also, as reported on outages list, what’s even worse is that they appear 
to be continuing to propagate advertisements from circuits whose sessions have 
been turned down.  I validated ours still were via a couple looking glass 
portals.  Down Detector shows nearly every major service provider impacted.

They’re not reachable so who knows if they’re even working on it.  I feel like 
they’ve been cutting heavily on the network ops side in recent years…

From: NANOG 
mailto:nanog-bounces+dhubbard=dino.hostasaurus@nanog.org>>
 on behalf of Drew Weaver via NANOG mailto:nanog@nanog.org>>
Reply-To: Drew Weaver mailto:drew.wea...@thenap.com>>
Date: Sunday, August 30, 2020 at 8:23 AM
To: "nanog@nanog.org<mailto:nanog@nanog.org>" 
mailto:nanog@nanog.org>>
Subject: Centurylink having a bad morning?

Hello,

Woke up this morning to a bunch of reports of issues with connectivity had to 
shut down some Level3/CTL connections to get it to return to normal.

As of right now their support portal won’t load: 
https://urldefense.com/v3/__https://www.centurylink.com/business/login/__;!!LG9nLpOADg!HY5bCa8KrN15HDakrv4TyH42jTlzeKVruHiQ0XUOnXr76N501izj2Mea7P2E$
 
<https://urldefense.com/v3/__https:/www.centurylink.com/business/login/__;!!LG9nLpOADg!E2yXBny8w6y2EZDXg_JjgIblaMZT433ZEZ_TDTcM3yhU2taQo_Gk4NRDVBCFBl9JiUeoEw$>

Just wondering what others are seeing.