Re: COVID-19 vs. our Networks

2020-03-18 Thread Blake Hudson
On 3/17/2020 1:54 PM, Dan White wrote: On 03/17/20 14:38 -0400, Rich Kulawiec wrote: On Tue, Mar 17, 2020 at 08:38:28AM -0700, Mike Bolitho wrote: Anybody who works in the healthcare vertical will tell you just how bad medical devices are to work with from an IT perspective. Medical

Google Fiber (KC) NOC contact

2020-03-18 Thread Blake Hudson
Does someone from Google Fiber hang out on this list? I've contacted arin-cont...@google.com (the WHOIS tech and admin contact), but not gotten any response and I suspect contacting a frontline callcenter would be fruitless. It appears that some portion of customers in KC are being provided

Re: COVID-19 vs. our Networks

2020-03-18 Thread Tom Beecher
Depends on the verbiage of the clause. On Wed, Mar 18, 2020 at 10:41 AM Seth Mattinen wrote: > On 3/17/20 10:03 AM, Mike Bolitho wrote: > > > > We have two redundant private lines out of each hospital connecting back > > to primary and DR DCs and a metro connecting everything together in each >

Re: COVID-19 vs. our Networks

2020-03-18 Thread Rich Kulawiec
On Wed, Mar 18, 2020 at 03:43:37AM -0600, Keith Medcalf wrote: > So you failed because you did not require the person making the decision > to take responsibility for their decision. That is, your organization > has a severely flawed process wherein the "R" for making the decision is > not the

Re: DHS letters for fuel and facility access

2020-03-18 Thread Mark Tinka
On 17/Mar/20 19:08, Warren Kumari wrote: > > We had specified that the transfer pump be on the generator feed, > there was a schematic showing at is being on the generator feed, there > was even a breaker with a cable marked "Transfer Pump (HP4,5)" --- > but it turned out to just be a ~3ft

Re: COVID-19 vs. our Networks

2020-03-18 Thread Mark Tinka
On 17/Mar/20 19:43, Keith Medcalf wrote: > > If by "device" you mean "computer", then you are correct. "A computer? What's that?" said the kids :-). > Never in 57 years. You caught it early :-). > Never because I don't have any. But I don't either. Babbling idiots don't > do anything

Re: Quagga for production?

2020-03-18 Thread Jens Link
Mark Tinka writes: > On 17/Mar/20 19:39, Jens Link wrote: > >> >> Jens, using frr for quite some time now without any problems > > IS-IS, per chance? Sorry, only BGP for now. Jens -- | Delbrueckstr. 41| 12051

Re: COVID-19 vs. our Networks

2020-03-18 Thread Mark Tinka
On 17/Mar/20 19:46, Mike Bolitho wrote: > > I totally agree and 99.999% of the time, congestion on the Internet is > a nuisance, not a critical problem. I'm not sitting here complaining > that my public internet circuits don't have SLAs or that we run into > some packet loss and latency here

Re: COVID-19 vs. our Networks

2020-03-18 Thread Mark Tinka
On 17/Mar/20 19:03, Mike Bolitho wrote: > I keep seeing this over and over again in this long thread. What's > your suggestion? How does a hospital, with dozens of third party > applications/devices across multiple cloud platforms do this? > > We have two redundant private lines out of each

Re: Quagga for production?

2020-03-18 Thread Mark Tinka
On 17/Mar/20 19:18, Hiers, David wrote: > > Quagga is built into one of our core products, works great.   That > particular vendor a sponsor of frr, and is replacing quagga with frr soon. > >   > > Maybe look at the vendor/partner list for quagga and frr, and decide > which project has better

Re: COVID-19 vs. our Networks

2020-03-18 Thread Seth Mattinen
On 3/17/20 10:03 AM, Mike Bolitho wrote: We have two redundant private lines out of each hospital connecting back to primary and DR DCs and a metro connecting everything together in each region. But for things we do not own that are not hosted locally, what are we supposed to do? We have to

Re: Quagga for production?

2020-03-18 Thread Mark Tinka
On 17/Mar/20 19:39, Jens Link wrote: > > Jens, using frr for quite some time now without any problems IS-IS, per chance? Mark.

Re: COVID-19 vs. our Networks

2020-03-18 Thread Mark Tinka
On 17/Mar/20 19:35, Tom Beecher wrote: > You're facing essentially the same issue as many in non-healthcare do > ; how to best talk to applications in Magic Cloud Land. Reaching the > major cloud providers does not require DIA ; they all have presences > on the major IXes, and direct peering

Re: COVID-19 vs. our Networks

2020-03-18 Thread Mark Tinka
On 17/Mar/20 20:33, Emille Blanc wrote: > In a world where you can license device performance by the megabit/sec/day, > or even have to purchase per-use factory reset keys since the manufacture has > stripped product owners of that right too, this doesn't totally surprise me. > > There would

Re: COVID-19 vs. our Networks

2020-03-18 Thread Anne P. Mitchell, Esq.
> On Mar 18, 2020, at 9:24 AM, Mark Tinka wrote: > > > > On 17/Mar/20 20:35, Owen DeLong wrote: > >> Step one: >> Consumers _AND_ especially mission critical consumers must start >> refusing to purchase devices which have inherent dependency on a >> vendor-cloud (or any cloud for

Re: Quagga for production?

2020-03-18 Thread Nick Hilliard
Mark Tinka wrote on 18/03/2020 14:25: At the moment, I run Quagga with OSPF and export that into my IS-IS core to drive Anycast services. I used to use ISIS for this, but more recently moved to ebgp with 1s/3s timers. The convergence characteristics are reasonable and as the only routing

Re: COVID-19 vs. our Networks

2020-03-18 Thread Mark Tinka
On 18/Mar/20 18:09, Jeff Shultz wrote: > Is it so difficult to put an "override, but keep counting" button on a > device like this? Where's the money in that? Mark.

Re: UDP/123 policers & status

2020-03-18 Thread Steven Sommars
The various NTP filters (rate limits, packet size limits) are negatively affecting the NTP Pool, the new secure NTP protocol (Network Time Security) and other clients. NTP filters were deployed several years ago to solve serious DDoS issues, I'm not second guessing those decisions. Changing the

Re: COVID-19 vs. our Networks

2020-03-18 Thread Alexandre Petrescu
I saw on TV official requests to police radio to remove masks (Idont know why, because they dont have any anyways) Le 18/03/2020 à 16:29, Mark Tinka a écrit : On 17/Mar/20 20:54, Dan White wrote: Attackers taking advantage of this situation is a serious concern. In South Africa, we

Re: COVID-19 vs. our Networks

2020-03-18 Thread Mark Tinka
On 17/Mar/20 20:06, Owen DeLong wrote: > I don’t get this… X-Ray machines (and other critical medical equipment) > should operate in a fail-safe mode where a license screw up doesn’t prevent > the machine from operating. > > If the hospital hasn’t paid up, find a way to go after the

Re: COVID-19 vs. our Networks

2020-03-18 Thread Mark Tinka
On 17/Mar/20 20:54, Dan White wrote: >   > > Attackers taking advantage of this situation is a serious concern. In South Africa, we have people claiming to be from the Department of Health and one other reputable medical care group, going door-to-door offering Coronavirus testing:    

Re: COVID-19 vs. our Networks

2020-03-18 Thread Mark Tinka
On 18/Mar/20 11:43, Keith Medcalf wrote: > No. One simply has to assign a "cost" to "suitability for use". For > example, if you put out an RFQ for a CT Machine and someone bids a bag > of peanuts for $1.50, that is probably the lowest bid, and that is what > you will get if you choose based

Re: COVID-19 vs. our Networks

2020-03-18 Thread Mark Tinka
On 17/Mar/20 19:56, Alexandre Petrescu wrote: >   > > I buy newspaper every Saturday and every Tuesday since some time now.  > In addition to local news and The Economist, I include NYTimes > International edition because thats the only USA thing in my very > small local news stand in small

Re: COVID-19 vs. our Networks

2020-03-18 Thread Mark Tinka
On 17/Mar/20 20:26, Shane Ronan wrote: >  Because the hospitals don't own the machines and the companies that > do, charge the hospital per x-ray. The hospitals moved to this model > to reduce their costs during "quiet" periods. And by doing so, put > their patients in jeopardy. Can be said

Re: COVID-19 vs. our Networks

2020-03-18 Thread Mark Tinka
On 17/Mar/20 23:47, Rich Kulawiec wrote: > > Decisions are no longer based on the greater good or on anticipating worst > case scenarios or on maximizing preparedness or anything that we might > hope they're based on. They're based, coldly and calculatingly, on money. > > If you want this to

Re: COVID-19 vs. our Networks

2020-03-18 Thread Mark Tinka
On 18/Mar/20 16:35, Seth Mattinen wrote: > > > Do all the SLA's in the world even matter if the contract has a force > majeure clause? Feel-good-tick-in-the-box type-thing... like that time a network operator is asked if any part of their network/service touches any equipment manufactured by

Re: Google Fiber (KC) NOC contact

2020-03-18 Thread Louie Lee via NANOG
Hey Blake, Thanks for reaching out. I’m the IP Address Manager. Since this is more a matter of the CPE or local gateway router configuration, I’ve referred the matter to our Operation team to follow up on. FYI, our frontline call center does escalate matters rather promptly after a report is

traffic sag last night (early this morning)

2020-03-18 Thread Aaron Gould
At 00:49 minutes past midnight today I saw a bit of a traffic sag across all 3 of my different upstream providers. All in Texas. Anyone else see that ? -Aaron

RE: COVID-19 vs. our Networks

2020-03-18 Thread Keith Medcalf
On Wednesday, 18 March, 2020 05:24, Rich Kulawiec wrote: >On Wed, Mar 18, 2020 at 03:43:37AM -0600, Keith Medcalf wrote: >> So you failed because you did not require the person making the >> decision to take responsibility for their decision. That is, your >> organization has a severely

Re: COVID-19 vs. our Networks

2020-03-18 Thread Mark Tinka
On 18/Mar/20 13:24, Rich Kulawiec wrote: > The use of "you/your" here and throughout is misplaced and inappropriate. > > Also: this not an isolated or unique experience. It's this way pretty > much everywhere in the US now. And I can disapprove of it, you can > disapprove of it, we can all

Re: DHS letters for fuel and facility access

2020-03-18 Thread Karl Auer
An untested emergency system has to be regarded as a non-existent emergency system. No matter how painful it is to test, no matter how expensive it is to test, the pain and the expense are nothing compared to the pain and expense of having an actual emergency and discovering that the emergency

Re: UDP/123 policers & status

2020-03-18 Thread Saku Ytti
On Wed, 18 Mar 2020 at 18:05, Ca By wrote: > Yeh, not changing ipv4 filters, Sorry pool. Burned once, twice shy. On many edge routers from Juniper, Nokia and Cisco you can create offset based bit-matches. I'm NTP illiterate, but isn't NTP mode in fixed offset after UDP header? So it should be

Re: DHS letters for fuel and facility access

2020-03-18 Thread Paul Nash
You just have to make sure that you test the right thing. In a former life I was an electrical engineer. My first job was with a consulting engineering firm; out biggest customer was the biggest supermarket chain in South Africa. One of my tasks was to travel to one of their stores each

Re: COVID-19 vs. our Networks

2020-03-18 Thread Mark Tinka
On 17/Mar/20 20:35, Owen DeLong wrote: > Step one: > Consumers _AND_ especially mission critical consumers must start > refusing to purchase devices which have inherent dependency on a > vendor-cloud (or any cloud for that matter). Good advice for mission-critical consumers. But the kids

Re: COVID-19 vs. our Networks

2020-03-18 Thread Dan White
On 03/18/20 09:29 -0500, Blake Hudson wrote: On 3/17/2020 1:54 PM, Dan White wrote: On 03/17/20 14:38 -0400, Rich Kulawiec wrote: On Tue, Mar 17, 2020 at 08:38:28AM -0700, Mike Bolitho wrote: That's the good news.   Here's the bad news: in about 2-3 weeks, when our health care systems are

Re: UDP/123 policers & status

2020-03-18 Thread Ca By
On Wed, Mar 18, 2020 at 8:46 AM Steven Sommars wrote: > The various NTP filters (rate limits, packet size limits) are negatively > affecting the NTP Pool, the new secure NTP protocol (Network Time Security) > and other clients. NTP filters were deployed several years ago to solve > serious DDoS

Re: Quagga for production?

2020-03-18 Thread Mark Tinka
On 18/Mar/20 18:01, Nick Hilliard wrote:   > > I used to use ISIS for this, but more recently moved to ebgp with > 1s/3s timers.  The convergence characteristics are reasonable and as > the only routing protocol dependence is bgp, we can use bird which in > turn allow us to automate

Re: DHS letters for fuel and facility access

2020-03-18 Thread Ben Cannon
It flabbergasts me to no end that nobody simulated the actual incident they are guarding against. But I guess that’s why we run telecom companies. Diesel piston generators need to be run for 30min every 30 (absent engineer calcs permitting lower, but, why). You should also consider a pull and

Re: COVID-19 vs. our Networks

2020-03-18 Thread Jeff Shultz
Is it so difficult to put an "override, but keep counting" button on a device like this? On Wed, Mar 18, 2020 at 8:04 AM Mark Tinka wrote: > > > > On 17/Mar/20 20:06, Owen DeLong wrote: > > > > I don’t get this… X-Ray machines (and other critical medical equipment) > > should operate in a

NetEase contact

2020-03-18 Thread Jack Leung (R* NYC)
Hi all Does anyone here have a contact at NetEase, an online service provider out of China. We have a number of customers in Asia who have them as their provider/carrier and are hitting outdated DNS entries so I'm trying to get to the bottom of it. Support tickets have gone unanswered.

SD-WAN Operators Group

2020-03-18 Thread Hiers, David
Hi, If you’re interested in SD-WAN, I’ve started a NANOG-knockoff over on groups.io. https://groups.io/g/sdwanoperators it has all the usual SMTP controls: * Post: sdwanoperat...@groups.io * Subscribe:

Re: Quagga for production?

2020-03-18 Thread Mark Tinka
On 18/Mar/20 22:22, Nick Hilliard wrote: > Yeah.  I was thinking more for the case of customer-facing anycast > resolvers, in which case BGP down means that the network is down, and > if the network is down it doesn't matter than DNS is also down because > their shared fate means that when BGP

Fwd: Internet operations during pandemics

2020-03-18 Thread Christopher Morrow
Did other folk on nanog-l see the nLnog-l note copied here? I wonder how folk are planning for things (noted in the slides) o supply chain for parts/equipment Wait, I can't get me a new shiny shipped because what?? o ongoing rollout of new equipment I'm deploying next week in KIX,

Re: Quagga for production?

2020-03-18 Thread Mark Tinka
On 18/Mar/20 22:22, Nick Hilliard wrote: > > Yeah.  I was thinking more for the case of customer-facing anycast > resolvers, in which case BGP down means that the network is down, and > if the network is down it doesn't matter than DNS is also down because > their shared fate means that when

Re: UDP/123 policers & status

2020-03-18 Thread Damian Menscher via NANOG
On Wed, Mar 18, 2020 at 8:45 AM Steven Sommars wrote: > The various NTP filters (rate limits, packet size limits) are negatively > affecting the NTP Pool, the new secure NTP protocol (Network Time Security) > and other clients. NTP filters were deployed several years ago to solve > serious DDoS

Re: Quagga for production?

2020-03-18 Thread Nick Hilliard
Mark Tinka wrote on 18/03/2020 17:02: I prefer to have a number of core systems accessible in the IGP, because BGP can sometimes get hosed for one reason or another. BGP always needs IGP to work. The reverse is not true, and reduces us to absolute basics when it hits the fan (which it has, a

Re: COVID-19 vs. our Networks

2020-03-18 Thread Scott Weeks
We do about 70-80Gbps at peak over the external BGP links we have and I am not seeing a large increase nor am I seeing it spread out over time. We're an eyeball network plus some really large customers. Anyone else seeing something different? We're now into the 3rd day, so I thought I'd

Re: UDP/123 policers & status

2020-03-18 Thread Damian Menscher via NANOG
On Wed, Mar 18, 2020 at 7:05 PM Harlan Stenn wrote: > On 3/18/2020 4:46 PM, Damian Menscher via NANOG wrote: > > On Wed, Mar 18, 2020 at 8:45 AM Steven Sommars > > mailto:stevesommars...@gmail.com>> wrote: > > > > The various NTP filters (rate limits, packet size limits) are > >

Re: UDP/123 policers & status

2020-03-18 Thread Harlan Stenn
On 3/18/2020 4:46 PM, Damian Menscher via NANOG wrote: > On Wed, Mar 18, 2020 at 8:45 AM Steven Sommars > mailto:stevesommars...@gmail.com>> wrote: > > The various NTP filters (rate limits, packet size limits) are > negatively affecting the NTP Pool, the new secure NTP protocol >

Re: DHS letters for fuel and facility access

2020-03-18 Thread Mark Tinka
On 17/Mar/20 18:44, Paul Nash wrote: > September 2001. Just after the 9/11 attacks, all of lower Manhattan was shut > down. Out link (IIRC) was to a satellite farm on Staten island, across the > bay to 60 Hudson. Power went off, diesels kicked in, fuel trucks was not > allowed in, and a

RE: COVID-19 vs. our Networks

2020-03-18 Thread Keith Medcalf
On Tuesday, 17 March, 2020 15:48, Rich Kulawiec wrote: >On Tue, Mar 17, 2020 at 11:35:59AM -0700, Owen DeLong wrote: >> Anything in the healthcare vertical that is outside of the medical >> providers control/ownership is a result of the medical provider >> buying into that model on some level.