Re: Outage between GBLX and HE?
* Brielle Bruns br...@2mbit.com [2010-11-17 04:34]: Hey All, Sorry to bother the list, but I'm noticing that I've got no connectivity to Hurricane Electric through GBLX from my Qwest DSL. In this case, I'm trying to get to tunnelbroker.net: ... 3 184-99-65-41.boid.qwest.net (184.99.65.41) 38.438 ms 49.250 ms 38.459 ms 4 sea-brdr-02.inet.qwest.net (67.14.41.14) 60.071 ms 53.198 ms 54.223 ms 5 te8-3-10g.ar5.sea1.gblx.net (64.208.110.141) 294.182 ms 437.842 ms * 6 * * * Hello from Old Europe, I just openend a case with GBLX because I'm unable to reach destinations in USA. As the technician told me they're having issues in the Seattle area and are trying to fix them at the moment. Kind Regards, Sebastian -- New GPG Key: 0x93A0B9CE (F4F6 B1A3 866B 26E9 450A 9D82 58A2 D94A 93A0 B9CE) Old GPG Key-ID: 0x76B79F20 (0x1B6034F476B79F20) 'Are you Death?' ... IT'S THE SCYTHE, ISN'T IT? PEOPLE ALWAYS NOTICE THE SCYTHE. -- Terry Pratchett, The Fifth Elephant
RE: Outage between GBLX and HE?
It looks like it's back now. I was seeing spotting US connectivity via GLBX upto 08:57 GMT. -Original Message- From: Brielle Bruns [mailto:br...@2mbit.com] Sent: 17 November 2010 03:32 To: NANOG list Subject: Outage between GBLX and HE? Hey All, Sorry to bother the list, but I'm noticing that I've got no connectivity to Hurricane Electric through GBLX from my Qwest DSL. In this case, I'm trying to get to tunnelbroker.net: ... 3 184-99-65-41.boid.qwest.net (184.99.65.41) 38.438 ms 49.250 ms 38.459 ms 4 sea-brdr-02.inet.qwest.net (67.14.41.14) 60.071 ms 53.198 ms 54.223 ms 5 te8-3-10g.ar5.sea1.gblx.net (64.208.110.141) 294.182 ms 437.842 ms * 6 * * * Testing out through the T1 which goes via twtelecom works fine, as does from co-loc in Seattle which goes through Integra. Don't suppose anyone else is noticing this as well? -- Brielle Bruns The Summit Open Source Development Group http://www.sosdg.org/ http://www.ahbl.org
RE: Outage between GBLX and HE?
I may have spoken too soon... issues are on going. -Original Message- From: Paul Kelly :: Blacknight [mailto:p...@blacknight.com] Sent: 17 November 2010 09:21 To: 'Brielle Bruns'; NANOG list Subject: RE: Outage between GBLX and HE? It looks like it's back now. I was seeing spotting US connectivity via GLBX upto 08:57 GMT. -Original Message- From: Brielle Bruns [mailto:br...@2mbit.com] Sent: 17 November 2010 03:32 To: NANOG list Subject: Outage between GBLX and HE? Hey All, Sorry to bother the list, but I'm noticing that I've got no connectivity to Hurricane Electric through GBLX from my Qwest DSL. In this case, I'm trying to get to tunnelbroker.net: ... 3 184-99-65-41.boid.qwest.net (184.99.65.41) 38.438 ms 49.250 ms 38.459 ms 4 sea-brdr-02.inet.qwest.net (67.14.41.14) 60.071 ms 53.198 ms 54.223 ms 5 te8-3-10g.ar5.sea1.gblx.net (64.208.110.141) 294.182 ms 437.842 ms * 6 * * * Testing out through the T1 which goes via twtelecom works fine, as does from co-loc in Seattle which goes through Integra. Don't suppose anyone else is noticing this as well? -- Brielle Bruns The Summit Open Source Development Group http://www.sosdg.org/ http://www.ahbl.org
Re: Outage between GBLX and HE?
On Wed, Nov 17, 2010 at 09:55:10AM +, Paul Kelly :: Blacknight wrote: I may have spoken too soon... issues are on going. We were seeing routing irregularities with GBLX as well. It seems they sending out our prefix to their peers, but blackholing the traffic coming back. We've shutdown our session with AS3549 until someone there answers our ticket. -cjp
Re: Outage between GBLX and HE?
On Wed, Nov 17, 2010 at 10:36:09AM -0500, Christopher J. Pilkington wrote: On Wed, Nov 17, 2010 at 09:55:10AM +, Paul Kelly :: Blacknight wrote: I may have spoken too soon... issues are on going. We were seeing routing irregularities with GBLX as well. It seems they sending out our prefix to their peers, but blackholing the traffic coming back. We've shutdown our session with AS3549 until someone there answers our ticket. Probably another LSP blackholing issue, look at the archives a few weeks back you'll see the same issue on GX in Seattle. As for the issue this morning, they have a router that has been blackholing traffic in Ashburn for a good long while now. I almost put on my Global Double Crossing t-shit this morning too. :) http://www.printfection.com/ras/Global-Double-Crossing-2-T-Shirt/_p_4935066 -- Richard A Steenbergen r...@e-gerbil.net http://www.e-gerbil.net/ras GPG Key ID: 0xF8B12CBC (7535 7F59 8204 ED1F CC1C 53AF 4C41 5ECA F8B1 2CBC)
Re: Outage between GBLX and HE?
On 11/17/10 10:33 AM, Richard A Steenbergen wrote: Probably another LSP blackholing issue, look at the archives a few weeks back you'll see the same issue on GX in Seattle. As for the issue this morning, they have a router that has been blackholing traffic in Ashburn for a good long while now. I almost put on my Global Double Crossing t-shit this morning too.:) http://www.printfection.com/ras/Global-Double-Crossing-2-T-Shirt/_p_4935066 Glad its not just me. Guess I don't have to reboot my Mac or my Linux firewall, eh? :-) -- Brielle Bruns The Summit Open Source Development Group http://www.sosdg.org/ http://www.ahbl.org
RE: Outage between GBLX and HE?
We saw further evidence of this on paths traversing global crossing to a customer last night.I don't know about others but we are intending to make some efforts to move traffic other places, this type of repeated failure is just terrible, especially since they still continue to announce routes indicating reachability that does not exist. John @ AS11404 in Seattle. -Original Message- From: Richard A Steenbergen [mailto:r...@e-gerbil.net] Sent: Wednesday, November 17, 2010 9:33 AM To: Christopher J. Pilkington Cc: NANOG list Subject: Re: Outage between GBLX and HE? On Wed, Nov 17, 2010 at 10:36:09AM -0500, Christopher J. Pilkington wrote: On Wed, Nov 17, 2010 at 09:55:10AM +, Paul Kelly :: Blacknight wrote: I may have spoken too soon... issues are on going. We were seeing routing irregularities with GBLX as well. It seems they sending out our prefix to their peers, but blackholing the traffic coming back. We've shutdown our session with AS3549 until someone there answers our ticket. Probably another LSP blackholing issue, look at the archives a few weeks back you'll see the same issue on GX in Seattle. As for the issue this morning, they have a router that has been blackholing traffic in Ashburn for a good long while now. I almost put on my Global Double Crossing t-shit this morning too. :) http://www.printfection.com/ras/Global-Double-Crossing-2-T-Shirt/_p_4935066 -- Richard A Steenbergen r...@e-gerbil.net http://www.e-gerbil.net/ras GPG Key ID: 0xF8B12CBC (7535 7F59 8204 ED1F CC1C 53AF 4C41 5ECA F8B1 2CBC)
RE: Outage between GBLX and HE?
We saw further evidence of this on paths traversing global crossing to a customer last night.I don't know about others but we are intending to make some efforts to move traffic other places, this type of repeated failure is just terrible, especially since they still continue to announce routes indicating reachability that does not exist. John @ AS11404 in Seattle. This has been going on for some months, moving from market to market. LAX, SEA, now ASH. -Randy
Re: Outage between GBLX and HE?
On 11/16/10 8:32 PM, Brielle Bruns wrote: Hey All, Sorry to bother the list, but I'm noticing that I've got no connectivity to Hurricane Electric through GBLX from my Qwest DSL. In this case, I'm trying to get to tunnelbroker.net: ... 3 184-99-65-41.boid.qwest.net (184.99.65.41) 38.438 ms 49.250 ms 38.459 ms 4 sea-brdr-02.inet.qwest.net (67.14.41.14) 60.071 ms 53.198 ms 54.223 ms 5 te8-3-10g.ar5.sea1.gblx.net (64.208.110.141) 294.182 ms 437.842 ms * 6 * * * Testing out through the T1 which goes via twtelecom works fine, as does from co-loc in Seattle which goes through Integra. Don't suppose anyone else is noticing this as well? Asymmetrical routing for the win. Did a trace from HE's LG to the DSL: core1.fmt1.he.net traceroute 65.102.72.22 numeric Tracing the route to IP node from 1 to 30 hops 119 ms 1 ms1 ms 66.160.158.242 214 ms3 ms1 ms 213.248.86.53 3 1 ms1 ms1 ms 213.248.87.50 4* * * ? 5* * * ? 6* * * ? 7* * * ? IP: Errno(8) Trace Route Failed, no response from target node. # Entry cached for another 32 seconds. Since i'm taking two separate paths, I'm not sure where the problem is exactly. -- Brielle Bruns The Summit Open Source Development Group http://www.sosdg.org/ http://www.ahbl.org
Re: Outage between GBLX and HE?
Brielle Bruns wrote: On 11/16/10 8:32 PM, Brielle Bruns wrote: Hey All, Sorry to bother the list, but I'm noticing that I've got no connectivity to Hurricane Electric through GBLX from my Qwest DSL. 7* * * ? IP: Errno(8) Trace Route Failed, no response from target node. # Entry cached for another 32 seconds. Since i'm taking two separate paths, I'm not sure where the problem is exactly. Did you reboot your computer? (running and ducking!)
Re: Outage between GBLX and HE?
Tammy A. Wisdom wrote: - Original Message - From: Mike mike-na...@tiedyenetworks.com Cc: nanog@nanog.org Sent: Tuesday, November 16, 2010 9:38:57 PM Subject: Re: Outage between GBLX and HE? Brielle Bruns wrote: On 11/16/10 8:32 PM, Brielle Bruns wrote: *snip* Did you reboot your computer? (running and ducking!) Gee so helpful. I hope you enjoyed looking like a fuckwit on nanog. are you sure that's appropriate here?
Re: Outage between GBLX and HE?
On Wed, Nov 17, 2010 at 12:00 AM, Mike mike-na...@tiedyenetworks.com wrote: Tammy A. Wisdom wrote: - Original Message - From: Mike mike-na...@tiedyenetworks.com Cc: nanog@nanog.org Sent: Tuesday, November 16, 2010 9:38:57 PM Subject: Re: Outage between GBLX and HE? Brielle Bruns wrote: On 11/16/10 8:32 PM, Brielle Bruns wrote: *snip* Did you reboot your computer? (running and ducking!) Gee so helpful. I hope you enjoyed looking like a fuckwit on nanog. are you sure that's appropriate here? I'm seeing he.net routes via GBLX peer 3549 6939 6939 Origin IGP, localpref 100, valid, external Community: 3549:4143 3549:30840 GBLX looking glass returns proper peering 1 64.214.13.1 (64.214.13.1) 135.800 ms 151.677 ms 2 Hurrican-Electric-LLC.Port-channel100.ar3.SJC2.gblx.net(64.214.174.246) 86.407 ms 76.988 ms 3 10gigabitethernet1-1.core1.fmt1.he.net (72.52.92.109) 79.397 ms 90.276 ms I'm going with reboot computer
Re: Outage between GBLX and HE?
On 11/16/10 10:07 PM, Mark Wall wrote: I'm seeing he.net routes via GBLX peer 3549 6939 6939 Origin IGP, localpref 100, valid, external Community: 3549:4143 3549:30840 GBLX looking glass returns proper peering 1 64.214.13.1 (64.214.13.1) 135.800 ms 151.677 ms 2 Hurrican-Electric-LLC.Port-channel100.ar3.SJC2.gblx.net(64.214.174.246) 86.407 ms 76.988 ms 3 10gigabitethernet1-1.core1.fmt1.he.net (72.52.92.109) 79.397 ms 90.276 ms I'm going with reboot computer :P yeah, if only it was that simple. -- Brielle Bruns The Summit Open Source Development Group http://www.sosdg.org/ http://www.ahbl.org
