Re: bgp.he.net?

2021-02-18 Thread Hank Nussbacher
On 18/02/2021 15:08, Hank Nussbacher wrote: Is it down? -Hank Back up. -Hank

Re: bgp.he.net?

2021-02-18 Thread Niels Bakker
* h...@interall.co.il (Hank Nussbacher) [Thu 18 Feb 2021, 14:10 CET]: Is it down? -Hank I can access https://bgp.he.net/contact/ just fine from here. Also, it's 2021, please stop posting in HTML. -- Niels.

Re: Famous operational issues

2021-02-18 Thread Jared Mauch
On Thu, Feb 18, 2021 at 01:07:01AM -0800, Eric Kuhnke wrote: > On that note, I'd be very interested in hearing stories of actual incidents > that are the cause of why cardboard boxes are banned in many facilities, > due to loose particulate matter getting into the air and setting off very >

Re: Famous operational issues

2021-02-18 Thread Eric Kuhnke
On that note, I'd be very interested in hearing stories of actual incidents that are the cause of why cardboard boxes are banned in many facilities, due to loose particulate matter getting into the air and setting off very sensitive fire detection systems. Or maybe it's more mundane and 99% of

bgp.he.net?

2021-02-18 Thread Hank Nussbacher
Is it down? -Hank

Re: Famous operational issues

2021-02-18 Thread Seth Mattinen
On 2/18/21 1:07 AM, Eric Kuhnke wrote: On that note, I'd be very interested in hearing stories of actual incidents that are the cause of why cardboard boxes are banned in many facilities, due to loose particulate matter getting into the air and setting off very sensitive fire detection

Re: Carrier Neutral Site - Freetown, Sierra Leone?

2021-02-18 Thread Mark Tinka
On 2/18/21 19:45, Rod Beck wrote: Every time I try to bring a circuit into Africa it is like a complete tour of Dante's Hell. A broad brush for such a large place. Mark.

Re: Google Fiber abuse address does not exist

2021-02-18 Thread Chris Boyd
> On Feb 18, 2021, at 5:19 PM, Louie Lee wrote: > > Hey Chris, > > Thanks for reporting this. We had an issue that caused emails to addresses in > that domain to not be recognized. > > The email is no longer bouncing back, and emails to other googlefiber.net > addresses are confirmed

Re: Famous operational issues

2021-02-18 Thread bzs
One day I got called into the office supplies area because there was a smell of something burning. Uh-oh. To make a long story short there was a stainless steel bowl which was focusing the sun from a window such that it was igniting a cardboard box. Talk about SMH and random bad luck which

Re: Famous operational issues

2021-02-18 Thread George Herbert
Northridge quake. I was #2 and on call at CRL. That One Guy on dialup in Atlanta playing MUDs 23x7 pages that things are down. I wander out to my computer to dial in and see what’s up, turned on TV walking past it, sat down and turned computer on, as it was booting on comes a live helicopter

Re: Famous operational issues

2021-02-18 Thread Andy Ringsmuth
> On Feb 18, 2021, at 4:37 PM, Warren Kumari wrote: > > 4: Not too long after I started doing networking (and for the same small ISP > in Yonkers), I'm flying off to install a new customer. I (of course) think > that I'm hot stuff because I'm going to do the install, configure the router, >

Re: Famous operational issues

2021-02-18 Thread Randy Bush
when employer had shipped 2xJ to london, had the circuits up, ... the local office sat on their hands. for weeks. i finally was pissed enough to throw my toolbag over my shoulder, get on a plane, and fly over. i walked into the fancy office and said "hi, i am randy, vp eng, here to help you

Re: Texas internet connectivity declining due to blackouts

2021-02-18 Thread Mark Tinka
On 2/17/21 16:09, Ben Cannon wrote: https://www.dallasnews.com/business/energy/2021/02/16/electricity-retailer-griddys-unusual-plea-to-texas-customers-leave-now-before-you-get-a-big-bill/

Re: Famous operational issues

2021-02-18 Thread Mark Tinka
On 2/19/21 00:37, Warren Kumari wrote: 5: Another one. In the early 2000s I was working for a dot-com boom company. We are building out our first datacenter, and I'm installing a pair of Cisco 7206s in 811 10th Ave. These will run basically the entire company, we have some transit, we

Re: Famous operational issues

2021-02-18 Thread Suresh Ramasubramanian
Did you at least hire the janitor? From: NANOG on behalf of Mark Tinka Date: Friday, 19 February 2021 at 10:20 AM To: nanog@nanog.org Subject: Re: Famous operational issues On 2/19/21 00:37, Warren Kumari wrote: 5: Another one. In the early 2000s I was working for a dot-com boom company. We

Re: Famous operational issues

2021-02-18 Thread Alain Hebert
A few I remember:     . Some monitoring server SCSI drive failed (we're talking State/Province level govt)...  Got a return back stating it will take 6 month delay to get a replacement...         Ended up choosing to use my own drive instead of leaving something that could be have been

Re: Google Fiber abuse address does not exist

2021-02-18 Thread Mark Seiden
i forwarded this to a colleague who has just taken a job that looks like he’s running abuse and security at g fiber. (not sure that he’s started work yet, it’s that new.) > On Feb 18, 2021, at 2:24 PM, TJ Trout wrote: > > Did you try opening a ticket with arin? > > On Thu, Feb 18, 2021 at

Re: Google Fiber abuse address does not exist

2021-02-18 Thread TJ Trout
Did you try opening a ticket with arin? On Thu, Feb 18, 2021 at 2:00 PM Chris Boyd wrote: > Can someone at ARIN tell them they need to fix this? > > From whois 136.32.164.64: > OrgAbuseHandle: GFA32-ARIN > OrgAbuseName: Google Fiber Abuse > OrgAbusePhone: +1-650-253- > OrgAbuseEmail:

Re: Famous operational issues

2021-02-18 Thread Patrick W. Gilmore
On Feb 18, 2021, at 6:10 PM, Karl Auer wrote: > > I think it was Macchiavelli who said that one should not ascribe to > malice anything adequately explained by incompetence… https://en.wikipedia.org/wiki/Hanlon%27s_razor Never attribute to malice that which is adequately explained by

Re: Famous operational issues

2021-02-18 Thread Henry Yen
On Thu, Feb 18, 2021 at 01:07:01AM -0800, Eric Kuhnke wrote: > On that note, I'd be very interested in hearing stories of actual incidents > that are the cause of why cardboard boxes are banned in many facilities, the datacenter manager's daughter's cat. -- Henry Yen

FCC outage report for Texas (central US) winter storm

2021-02-18 Thread Sean Donelan
The Federal Communications Commission has posted a summary report on outage reports due to the winter storm impacting Texas and central US. It looks incomplete to me compared to the detail collected during a typical hurricane. It is based on reports from telecommunication companies. If

Re: Famous operational issues

2021-02-18 Thread George Metz
Normally I reference this as an example of terrible government bureaucracy, but in this case it's also how said bureaucracy can delay operational changes. I was a contractor for one of the many branches of the DoD in charge of the network at a moderate-sized site. I'd been there about 4 months,

Google Fiber abuse address does not exist

2021-02-18 Thread Chris Boyd
Can someone at ARIN tell them they need to fix this? From whois 136.32.164.64: OrgAbuseHandle: GFA32-ARIN OrgAbuseName: Google Fiber Abuse OrgAbusePhone: +1-650-253- OrgAbuseEmail: ab...@googlefiber.net OrgAbuseRef:https://rdap.arin.net/registry/entity/GFA32-ARIN Email response:

Re: Famous operational issues

2021-02-18 Thread Warren Kumari
On Thu, Feb 18, 2021 at 8:31 AM Jared Mauch wrote: > On Thu, Feb 18, 2021 at 01:07:01AM -0800, Eric Kuhnke wrote: > > On that note, I'd be very interested in hearing stories of actual > incidents > > that are the cause of why cardboard boxes are banned in many facilities, > > due to loose

Re: Carrier Neutral Site - Freetown, Sierra Leone?

2021-02-18 Thread Eric Kuhnke
There is really no such thing since there is just the one cable landing station. I've previously spent months working in network infrastructure and telecom in Sierra Leone, contact me off-list if you're serious about getting something done there. On Thu, Feb 18, 2021 at 9:46 AM Rod Beck

Re: Famous operational issues

2021-02-18 Thread Paul Ebersman
warren> 2: A somewhat similar thing would happen with the Ascend TNT warren> Max, which had side-to-side airflow. These were dial termination warren> boxes, and so people would install racks and racks of them. The warren> first one would draw in cool air on the left, heat it up and warren> ship it

Re: Famous operational issues

2021-02-18 Thread Brian Knight via NANOG
On 2021-02-17 13:28, John Kristoff wrote: On Wed, 17 Feb 2021 14:07:54 -0500 John Curran wrote: I have no idea what outages were most memorable for others, but the Stanford transfer switch explosion in October 1996 resulted in a much of the Internet in the Bay Area simply not being reachable

Re: Google Fiber abuse address does not exist

2021-02-18 Thread Warren Kumari
Whoops. Thank you for reporting this, it’s being looked into. W On Thu, Feb 18, 2021 at 5:01 PM Chris Boyd wrote: > Can someone at ARIN tell them they need to fix this? > > From whois 136.32.164.64: > OrgAbuseHandle: GFA32-ARIN > OrgAbuseName: Google Fiber Abuse > OrgAbusePhone:

Re: Famous operational issues

2021-02-18 Thread Karl Auer
On Thu, 2021-02-18 at 17:37 -0500, Warren Kumari wrote: > Anyway, the subcontractor who made the power supplies for the vendor > realized that they could save a few cents by not installing the > little metal clip that held the heatsink to the MOSFET I think it was Macchiavelli who said that one

Re: Google Fiber abuse address does not exist

2021-02-18 Thread Louie Lee via NANOG
Hey Chris, Thanks for reporting this. We had an issue that caused emails to addresses in that domain to not be recognized. The email is no longer bouncing back, and emails to other googlefiber.net addresses are confirmed working. Louie On Thu, Feb 18, 2021 at 1:58 PM Chris Boyd wrote: > Can

Re: Famous operational issues

2021-02-18 Thread t...@pelican.org
On Thursday, 18 February, 2021 16:23, "Seth Mattinen" said: > I had a customer that tried to stack their servers - no rails except the > bottom most one - using 2x4's between each server. Up until then I > hadn't imagined anyone would want to fill their cabinet with wood, so I > made a rule to

Carrier Neutral Site - Freetown, Sierra Leone?

2021-02-18 Thread Rod Beck
Every time I try to bring a circuit into Africa it is like a complete tour of Dante's Hell.  Regards, Roderick. Roderick Beck Global Network Capacity Procurement United Cable Company www.unitedcablecompany.com https://unitedcablecompany.com/video/ New

Re: Famous operational issues

2021-02-18 Thread Erik Sundberg
Worked a cronic support call where their internet would bounce at noon every workday. The Cisco 1601 or 1700 Router that had there T1 in, ended up being on top a microwave. Weeks of troubleshooting and shipping new routers on this one. Also had another one where the router was plugged in to an