Re: qwest outage no notice

2010-01-09 Thread Paul Wall
On Thu, Jan 7, 2010 at 5:04 AM, Mike mike-na...@tiedyenetworks.com wrote: We just had a qwest outage of about 2 mins at 1:41am pst. When I called to report it I was told it was a 200+ emergency software upgrade due to a security concern, and that we will get a notice later after the fact.

Re: qwest outage no notice

2010-01-09 Thread Mike
Paul Wall wrote: On Thu, Jan 7, 2010 at 5:04 AM, Mike mike-na...@tiedyenetworks.com wrote: We just had a qwest outage of about 2 mins at 1:41am pst. When I called to report it I was told it was a 200+ emergency software upgrade due to a security concern, and that we will get a notice later

Re: qwest outage no notice

2010-01-09 Thread Bob Bradlee
On Sat, 09 Jan 2010 07:00:42 -0800, Mike wrote: Qwest NEVER EVER provides SLA adjustments, no longer how long it's down or what their own role in it being down is. They toss it from department If they honored every SLA adjustment they would not be able to pay the current stockholders a 6.8%

Re: qwest outage no notice

2010-01-09 Thread Martin Hannigan
On Sat, Jan 9, 2010 at 9:37 AM, Paul Wall pauldotw...@gmail.com wrote: On Thu, Jan 7, 2010 at 5:04 AM, Mike mike-na...@tiedyenetworks.com wrote: We just had a qwest outage of about 2 mins at 1:41am pst. When I called to report it I was told it was a 200+ emergency software upgrade due to a

Re: qwest outage no notice

2010-01-09 Thread virendra rode
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi, Martin Hannigan wrote: On Sat, Jan 9, 2010 at 9:37 AM, Paul Wall pauldotw...@gmail.com wrote: On Thu, Jan 7, 2010 at 5:04 AM, Mike mike-na...@tiedyenetworks.com wrote: We just had a qwest outage of about 2 mins at 1:41am pst. When I

Re: qwest outage no notice

2010-01-08 Thread Jack Bates
Scott Weeks wrote: Try no notice at all and 4 GigEs of upstream bandwidth down at 1:30am. :-( Honestly, I feel for them. They probably left it up to the account reps, which means the smaller circuits probably got notified and the HUGE wholesale accounts were not. Oh, well. That's why we

Re: qwest outage no notice

2010-01-07 Thread Steve Ryan
Any other specifics? Got a trouble ticket ID? I'm located in the NW (Talent, Oregon, just over CA border..) and we have a few customers on Qwest T1's and the like. We also have a customer who gets MPLS directly from Q. We've yet to hear of any outages for our customers - but I suppose the

Re: qwest outage no notice

2010-01-07 Thread sthaug
We just had a qwest outage of about 2 mins at 1:41am pst. When I called to report it I was told it was a 200+ emergency software upgrade due to a security concern, and that we will get a notice later after the fact. Normally we get notices in advance, even for software upgrades due to

RE: qwest outage no notice

2010-01-07 Thread Jason Shearer
Notices were left at the discretion of Qwest account teams. There was no mass notification. Jason -Original Message- From: Mike [mailto:mike-na...@tiedyenetworks.com] Sent: Thursday, January 07, 2010 4:04 AM To: NANOG list Subject: qwest outage no notice We just had a qwest outage of

Re: qwest outage no notice

2010-01-07 Thread Jeremy Rossi
Give the nature of the issue from juniper I am guessing that a large number of companies were doing upgrades over the last few days as fast as they could. http://j.mp/8XaReK has the details I know of now. On Jan 7, 2010, at 5:14 AM, Steve Ryan wrote: Any other specifics? Got a trouble

Re: qwest outage no notice

2010-01-07 Thread Chris Adams
Once upon a time, Mike mike-na...@tiedyenetworks.com said: We just had a qwest outage of about 2 mins at 1:41am pst. When I called to report it I was told it was a 200+ emergency software upgrade due to a security concern, and that we will get a notice later after the fact. Normally we get

Re: qwest outage no notice

2010-01-07 Thread Steven Saner
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Jan 7, 2010, at 4:04 AM, Mike wrote: We just had a qwest outage of about 2 mins at 1:41am pst. When I called to report it I was told it was a 200+ emergency software upgrade due to a security concern, and that we will get a notice later

Re: qwest outage no notice

2010-01-07 Thread JoeSox
On Thu, Jan 7, 2010 at 4:06 AM, sth...@nethelp.no wrote: We just had a qwest outage of about 2 mins at 1:41am pst. When I called to report it I was told it was a 200+ emergency software upgrade due to a security concern, and that we will get a notice later after the fact. Normally we get

RE: qwest outage no notice

2010-01-07 Thread Matlock, Kenneth L
to me. Ken Matlock Network Analyst Exempla Healthcare (303) 467-4671 matlo...@exempla.org -Original Message- From: JoeSox [mailto:joe...@gmail.com] Sent: Thursday, January 07, 2010 8:25 AM To: nanog@nanog.org Subject: Re: qwest outage no notice My QWest account manager called three

Re: qwest outage no notice

2010-01-07 Thread Mike
Yeah, they refused to notify due to security concerns from what they told me last night. Notification was performed after maintenance was complete. Ok, so the next question is, what harm would a simple advance notice of 'emergency maintenance' caused, vs the very real hassle and

RE: qwest outage no notice

2010-01-07 Thread Richey
That should read... Yeah, they refused to notify due to [marketing] concerns from what they Richey -Original Message- From: Mike [mailto:mike-na...@tiedyenetworks.com] Sent: Thursday, January 07, 2010 12:04 PM Cc: nanog@nanog.org Subject: Re: qwest outage no notice Yeah

Re: qwest outage no notice

2010-01-07 Thread Chris De Young
Mike wrote: We just had a qwest outage of about 2 mins at 1:41am pst. When I called to report it I was told it was a 200+ emergency software upgrade due to a security concern, and that we will get a notice later after the fact. Hmm - I got notice in advance. I'll have to go search for the

RE: qwest outage no notice

2010-01-07 Thread Greg Olson
Probably related to this: http://www.theregister.co.uk/2010/01/07/juniper_critical_router_bug/ -Original Message- From: Chris De Young [mailto:c...@arizona.edu] Sent: Thursday, January 07, 2010 9:32 AM To: Mike Cc: NANOG list Subject: Re: qwest outage no notice Mike wrote: We just

Re: qwest outage no notice

2010-01-07 Thread Scott Weeks
--- mike-na...@tiedyenetworks.com wrote: From: Mike mike-na...@tiedyenetworks.com Ok, so the next question is, what harm would a simple advance notice of 'emergency maintenance' caused, vs the very real hassle and inconvenience that DS3-down in the middle of the night caused for operations