[Nanog-futures] NANOG 50

2010-09-23 Thread Don Welch
NANOG Community: Merit has issued the following press release celebrating NANOG’s upcoming 50th meeting and noting the proposed charter amendment that will pave the way for the transition to NewNOG. If you are an eligible voter I urge you to review the charter amendment and to vote in the

RE: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Paul Stewart
Over on the outages list there is a lot of discussion... I believe everyone is effected - we are peered with them in several locations and cannot reach them. Paul -Original Message- From: Ernie Rubi [mailto:erne...@cs.fiu.edu] Sent: Thursday, September 23, 2010 3:39 PM To:

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread chaim rieger
Yes tis down. Watch productivity go up --Original Message-- From: Ernie Rubi To: nanog@nanog.org Subject: Facebook Issues/Outage in Southeast? Sent: Sep 23, 2010 12:39 Anyone else having trouble? We're colo'ed at the NOTA in Miami and directly peer with them - even though our session

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread andrew.wallace
Over the last 30 minutes or more (UK) Andrew - Original Message From: Ernie Rubi erne...@cs.fiu.edu To: nanog@nanog.org Sent: Thu, 23 September, 2010 20:39:15 Subject: Facebook Issues/Outage in Southeast? Anyone else having trouble? We're colo'ed at the NOTA in Miami and directly

RE: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Justin Horstman
Via http://downforeveryoneorjustme.com/facebook.com It's not just you! http://facebook.com looks down from here. Also down from LA, qwest has been having issues today as well, not sure if its related. -Original Message- From: Ernie Rubi [mailto:erne...@cs.fiu.edu] Sent:

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Steven Bellovin
On Sep 23, 2010, at 3:40 59PM, Paul Stewart wrote: Over on the outages list there is a lot of discussion... I believe everyone is effected - we are peered with them in several locations and cannot reach them. http://blogs.wsj.com/digits/2010/09/22/facebook-goes-down-for-some-users/

RE: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Justin Horstman
Productivity grinds to a hault as everyone goes onto twitter to talk about facebook being down -Original Message- From: chaim rieger [mailto:chaim.rie...@gmail.com] Sent: Thursday, September 23, 2010 12:41 PM To: Ernie Rubi; nanog@nanog.org Subject: Re: Facebook Issues/Outage in

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread James Grace
Which outages list? James On Sep 23, 2010, at 3:40 PM, Paul Stewart wrote: Over on the outages list there is a lot of discussion... I believe everyone is effected - we are peered with them in several locations and cannot reach them. Paul -Original Message- From: Ernie Rubi

RE: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Jay Nugent
Greetings, On Thu, 23 Sep 2010, Justin Horstman wrote: Via http://downforeveryoneorjustme.com/facebook.com It's not just you! http://facebook.com looks down from here. Also down from LA, qwest has been having issues today as well, not sure if its related. About 45 minutes ago

RE: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Paul Stewart
outa...@outages.org ;) -Original Message- From: James Grace [mailto:ja...@cs.fiu.edu] Sent: Thursday, September 23, 2010 3:58 PM To: Paul Stewart Cc: Ernie Rubi; nanog@nanog.org Subject: Re: Facebook Issues/Outage in Southeast? Which outages list? James On Sep 23, 2010, at 3:40 PM,

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Jeroen van Aart
(apologies for cross posting) Ernie Rubi wrote: Anyone else having trouble? We're colo'ed at the NOTA in Miami and directly peer with them - even though our session hasn't gone down we still can't reach them. It will be interesting to see if global spam traffic goes down as well? Since

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Warren Bailey
We have our guys here in Alaska checking SIX in Seattle now. Sent from a mobile phone with a small keyboard, please excuse my mistakes. On Sep 23, 2010, at 11:59 AM, deles...@gmail.com deles...@gmail.com wrote: Having issues from the north east as well. --Original Message-- From:

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Jon Lewis
On Thu, 23 Sep 2010, Steven Bellovin wrote: On Sep 23, 2010, at 3:40 59PM, Paul Stewart wrote: Over on the outages list there is a lot of discussion... I believe everyone is effected - we are peered with them in several locations and cannot reach them.

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Dennis
It's up in the PNW for me. Then again we peer with them at the six...

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Heath Jones
I can ping them but not access them over Cogent here in Tysons Corner, Virginia - looks like a server issue to me. Want to see something funnier: http://downrightnow.com/ Exactly the same as what your seeing for facebook. Working icmp, broken http. I wonder if 10^234 people are all trying to

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Greg Whynott
productivity in NA just sky rocketed! -g On Sep 23, 2010, at 3:39 PM, Ernie Rubi wrote: Anyone else having trouble? We're colo'ed at the NOTA in Miami and directly peer with them - even though our session hasn't gone down we still can't reach them. Ernesto M. Rubi Sr. Network Engineer

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Randy Bush
fb is looking good from nevis. dunno about st kitts. randy

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread bret clark
Whoa...there is clairvoyance for you...that article is from yesterday...wonder if the author provides stock tips??? Facebook down...where is the Like button? On 9/23/2010 3:46 PM, Steven Bellovin wrote: http://blogs.wsj.com/digits/2010/09/22/facebook-goes-down-for-some-users/

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Harry Strongburg
On Thu, Sep 23, 2010 at 12:43:44PM -0700, Justin Horstman wrote: Via http://downforeveryoneorjustme.com/facebook.com It's not just you! http://facebook.com looks down from here. That tool is very inefficient and often incorrect. It's up for me in the North-East. Should be back now, I hope.

Re: facebook outrage

2010-09-23 Thread Rudolph Daniel
Facebook from the Caribbean Service Unavailable - DNS failureThe server is temporarily unable to service your request. Please try again later. Reference #11.1d9c1160.1285272538.81cae85 RD On Thu, Sep 23, 2010 at 3:46 PM, nanog-requ...@nanog.org wrote: Send NANOG mailing list submissions to

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Seth Mattinen
On 9/23/2010 12:43, Justin Horstman wrote: Via http://downforeveryoneorjustme.com/facebook.com It's not just you! http://facebook.com looks down from here. Also down from LA, qwest has been having issues today as well, not sure if its related. However, www.v6.facebook.com works

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Jeff Cornejo
http://developers.facebook.com/live_status They are having a major API latency issue. http://developers.facebook.com/live_status Jeff Cornejo Blue Ridge InternetWorks 321 East Main St | Suite 200 | Charlottesville, VA | 22902 +1.434.817.0707 office +1.434.531.4141 mobile On Sep 23, 2010, at

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Jorge Amodio
Looks that it came back up now ... r...@tango:/var/cache/bind# ping -c 10 www.facebook.com PING a1254.g.akamai.net (209.18.43.169) 56(84) bytes of data. 64 bytes from 209-18-43-169.dfw10.tbone.rr.com (209.18.43.169): icmp_seq=1 ttl=57 time=15.8 ms 64 bytes from 209-18-43-169.dfw10.tbone.rr.com

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread JC Dill
Justin Horstman wrote: Via http://downforeveryoneorjustme.com/facebook.com It's not just you! http://facebook.com looks down from here. Is downforeveryoneorjustme.com down for everyone, or just me? Error: Server Error The server encountered an error and could not complete your request. If

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Marshall Eubanks
On Sep 23, 2010, at 4:01 PM, Jon Lewis wrote: On Thu, 23 Sep 2010, Steven Bellovin wrote: On Sep 23, 2010, at 3:40 59PM, Paul Stewart wrote: Over on the outages list there is a lot of discussion... I believe everyone is effected - we are peered with them in several locations and

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Beavis
are they down coz of DDoS? On Thu, Sep 23, 2010 at 2:04 PM, Cameron Byrne cb.li...@gmail.com wrote: IPv6 seems to be working fine for me www.v6.facebook.com :) Cameron == http://groups.google.com/group/tmoipv6beta === -- ()  ascii ribbon campaign - against html e-mail

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread david raistrick
Want to see something funnier: http://downrightnow.com/ Exactly the same as what your seeing for facebook. Working icmp, broken http. downforeveryoneorjustme.com is/was returning intermittent 500 errors, too. fun day. ..d (twiddling his thumbs waiting to test newly built servers that

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Scott Weeks
--- jer...@mompl.net wrote: From: Jeroen van Aart jer...@mompl.net (apologies for cross posting) -- Then don't. Number 3: http://www.nanog.org/mailinglist scott

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Atticus
Forgot to CC my last reply. Managed to load over v6 once, then shot me the finger and said no more. Somebody forget to pay the internet bill this month? -- Byron Grobe

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Seth Mattinen
On 9/23/2010 13:04, Cameron Byrne wrote: IPv6 seems to be working fine for me www.v6.facebook.com :) Yep, works great. You guys should really upgrade your networks to something that works. ;) ~Seth

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Joe Abley
On 2010-09-23, at 15:43, Justin Horstman wrote: Via http://downforeveryoneorjustme.com/facebook.com downforeveryoneorjustme.com is down for me. How about everybody else? :-)

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Mikhail Strizhov
Are they switching to Akamai ? From Northern Colorado: $ traceroute www.facebook.com traceroute to www.facebook.com (129.19.157.16), 30 hops max, 60 byte packets 3 129.82.2.9 (129.82.2.9) 6.284 ms 6.257 ms 6.229 ms 4 l3-gw-1-vl804.frgp.net (192.43.217.225) 6.201 ms 6.178 ms 6.155 ms

RE: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Warren Bailey
Here in Alaska, we have fiber going from Anchorage down to Seattle - where we peer with Facebook via SIX. We also host localized content for akamai, who in turn caches data for facebook. Our requests to facebook.com (dns wise) are handled through the akamai cluster on our internal 10 gig link -

RE: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Warren Bailey
We've always been able to ping facebook, it seems the people with the most trouble are hitting akamai's caching. The 209.165.150.24 is local to us, as we host akamai for facebook in Alaska. ping www.facebook.com Pinging a1254.g.akamai.net [209.165.150.24] with 32 bytes of data: Reply from

LISP Works - Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Jared Mauch
It's working over LISP: http://www.lisp4.facebook.com/ On Sep 23, 2010, at 3:39 PM, Ernie Rubi wrote: Anyone else having trouble? We're colo'ed at the NOTA in Miami and directly peer with them - even though our session hasn't gone down we still can't reach them. Ernesto M. Rubi Sr.

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread andrew.wallace
Up in United Kingdom. Andrew - Original Message From: Harry Strongburg harry.na...@harry.lu To: nanog@nanog.org Sent: Thu, 23 September, 2010 21:08:48 Subject: Re: Facebook Issues/Outage in Southeast? It's up for me in the North-East. Should be back now, I hope.

Re: LISP Works - Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Scott Weeks
--- ja...@puck.nether.net wrote: From: Jared Mauch ja...@puck.nether.net It's working over LISP: http://www.lisp4.facebook.com/ - LISP as in Locator/ID Separation Protocol? scott

Re: LISP Works - Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Jared Mauch
Yes. Jared Mauch On Sep 23, 2010, at 5:50 PM, Scott Weeks sur...@mauigateway.com wrote: --- ja...@puck.nether.net wrote: From: Jared Mauch ja...@puck.nether.net It's working over LISP: http://www.lisp4.facebook.com/ - LISP as in

Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Bill Blackford
yes, and Qwest is no longer experiencing issues according to IHR. -b -- Bill Blackford Network Engineer Logged into reality and abusing my sudo privileges.

Re: LISP Works - Re: Facebook Issues/Outage in Southeast?

2010-09-23 Thread Cameron Byrne
On Thu, Sep 23, 2010 at 5:33 PM, Scott Weeks sur...@mauigateway.com wrote: On Sep 23, 2010, at 5:50 PM, Scott Weeks sur...@mauigateway.com wrote: --- ja...@puck.nether.net wrote: It's working over LISP: http://www.lisp4.facebook.com/ - LISP as in

Facebook Engineering on today's outage

2010-09-23 Thread Jay R. Ashworth
http://www.facebook.com/notes/facebook-engineering/more-details-on-todays-outage/431441338919 Apparently, our surmise about Akamai notwithstanding, the problem was actually internal to their app-specific caching facilities, which went into Sorcerer's Apprentice mode, and they had to kill them all