Re: DHS letters for fuel and facility access

[Mark Milhollan]

On Tue, 17 Mar 2020, Grant Taylor wrote:

On 3/17/20 11:35 AM, Alexandre Petrescu wrote:


But I dont expect me to go to my desk any time since now in one month to 
press the button on the phone to set the voicemail active.


My office had problems with multiple workstations needing someone to kick 
them.  My team had someone volunteer to go in and kick multiple machines to 
get the rest of my team back online.


Given it is only a signal to the switch I'd be surprised if it cannot be 
toggled via an admin interface.  Still, someone to go in and diddle a 
PHY or six sounds quite workable.



/mark

Re: DHS letters for fuel and facility access

[Ben Cannon]

It flabbergasts me to no end that nobody simulated the actual incident they are 
guarding against.

But I guess that’s why we run telecom companies.

Diesel piston generators need to be run for 30min every 30 (absent engineer 
calcs permitting lower, but, why).

You should also consider a pull and re-strike on that breaker 3 times.

Most transmission level circuit breakers will auto-retry 3x then quit if they 
trip each time. 

Your ATS should smooth this, but that function needs to get tested too.

Things you learn in heavy civil construction that you don’t necessarily learn 
in telecom even.

-Ben

> On Mar 18, 2020, at 9:58 AM, Paul Nash  wrote:
> 
> You just have to make sure that you test the right thing.
> 
> In a former life I was an electrical engineer. My first job was with a 
> consulting engineering firm; out biggest customer was the biggest supermarket 
> chain in South Africa.  One of my tasks was to travel to one of their stores 
> each Saturday after closing (those were the days when they closed at noon on 
> a Saturday until Monday morning) and test their stand generators.
> 
> The manager’s idea was usually to press the start button, check that the big 
> diesel started, then shut down and go home.  My idea was to pull the main 
> incoming breaker.  9 times out of 10 on first visit, the diesel would start, 
> and then die as soon as the load kicked in because of carbon buildup in the 
> cylinders.
> 
> After discussions with the supermarket management, they decided to (a) have 
> all the diesels serviced ASAP, and (b) adopt my protocol of start diesel, 
> wait for it to come under load, run for at least 30 minutes to get up to heat 
> and clear the carbon deposits.
> 
> I use a similar technique for failover tests on servers, routers, firewalls — 
> pull the power cord and see what happens, pull the incoming network and see 
> what happens.
> 
> This was stymied by a recent network outage where the ISP network was up and 
> running, connected back to their local PoP and thence to their backbone, but 
> connectivity from that network to the critical servers was down.  So now we 
> test end-to-end that the server is reachable, and let the network fail over 
> if not.
> 
>paul
> 
>> On Mar 18, 2020, at 11:56 AM, Karl Auer  wrote:
>> 
>> An untested emergency system has to be regarded as a non-existent
>> emergency system.
>> 
>> No matter how painful it is to test, no matter how expensive it is to
>> test, the pain and the expense are nothing compared to the pain and
>> expense of having an actual emergency and discovering that the
>> emergency system doesn't work...
>> 
>> Multiplied by infinity if it costs lives.
>> 
>> Regards, K.
>> 
>> -- 
>> ~~~
>> Karl Auer (ka...@biplane.com.au)
>> http://www.biplane.com.au/kauer
>> http://twitter.com/kauer389
>> 
>> GPG fingerprint: 2561 E9EC D868 E73C 8AF1 49CF EE50 4B1D CCA1 5170
>> Old fingerprint: 8D08 9CAA 649A AFEF E862 062A 2E97 42D4 A2A0 616D
>> 
>> 
> 

Re: DHS letters for fuel and facility access

[Paul Nash]

You just have to make sure that you test the right thing.

In a former life I was an electrical engineer. My first job was with a 
consulting engineering firm; out biggest customer was the biggest supermarket 
chain in South Africa.  One of my tasks was to travel to one of their stores 
each Saturday after closing (those were the days when they closed at noon on a 
Saturday until Monday morning) and test their stand generators.

The manager’s idea was usually to press the start button, check that the big 
diesel started, then shut down and go home.  My idea was to pull the main 
incoming breaker.  9 times out of 10 on first visit, the diesel would start, 
and then die as soon as the load kicked in because of carbon buildup in the 
cylinders.

After discussions with the supermarket management, they decided to (a) have all 
the diesels serviced ASAP, and (b) adopt my protocol of start diesel, wait for 
it to come under load, run for at least 30 minutes to get up to heat and clear 
the carbon deposits.

I use a similar technique for failover tests on servers, routers, firewalls — 
pull the power cord and see what happens, pull the incoming network and see 
what happens.

This was stymied by a recent network outage where the ISP network was up and 
running, connected back to their local PoP and thence to their backbone, but 
connectivity from that network to the critical servers was down.  So now we 
test end-to-end that the server is reachable, and let the network fail over if 
not.

paul

> On Mar 18, 2020, at 11:56 AM, Karl Auer  wrote:
> 
> An untested emergency system has to be regarded as a non-existent
> emergency system.
> 
> No matter how painful it is to test, no matter how expensive it is to
> test, the pain and the expense are nothing compared to the pain and
> expense of having an actual emergency and discovering that the
> emergency system doesn't work...
> 
> Multiplied by infinity if it costs lives.
> 
> Regards, K.
> 
> -- 
> ~~~
> Karl Auer (ka...@biplane.com.au)
> http://www.biplane.com.au/kauer
> http://twitter.com/kauer389
> 
> GPG fingerprint: 2561 E9EC D868 E73C 8AF1 49CF EE50 4B1D CCA1 5170
> Old fingerprint: 8D08 9CAA 649A AFEF E862 062A 2E97 42D4 A2A0 616D
> 
> 

Re: DHS letters for fuel and facility access

[Karl Auer]

An untested emergency system has to be regarded as a non-existent
emergency system.

No matter how painful it is to test, no matter how expensive it is to
test, the pain and the expense are nothing compared to the pain and
expense of having an actual emergency and discovering that the
emergency system doesn't work...

Multiplied by infinity if it costs lives.

Regards, K.

-- 
~~~
Karl Auer (ka...@biplane.com.au)
http://www.biplane.com.au/kauer
http://twitter.com/kauer389

GPG fingerprint: 2561 E9EC D868 E73C 8AF1 49CF EE50 4B1D CCA1 5170
Old fingerprint: 8D08 9CAA 649A AFEF E862 062A 2E97 42D4 A2A0 616D

Re: DHS letters for fuel and facility access

[Mark Tinka]

On 17/Mar/20 19:08, Warren Kumari wrote:

>
> We had specified that the transfer pump be on the generator feed,
> there was a schematic showing at is being on the generator feed, there
> was even a breaker with a cable marked  "Transfer Pump (HP4,5)" ---
> but it turned out to just be a ~3ft piece of cable stuffed into a
> conduit, and not actually, you know, running all the way down to the
> basement and connected to the transfer pump.

It's the things you rarely think about.

The Fukushima Daiichi nuclear power plant backup generator situation
comes to mind as well.

Mark.

Re: DHS letters for fuel and facility access

[Mark Tinka]

On 17/Mar/20 18:44, Paul Nash wrote:

> September 2001.  Just after the 9/11 attacks, all of lower Manhattan was shut 
> down.  Out link (IIRC) was to a satellite farm on Staten island, across the 
> bay to 60 Hudson.  Power went off, diesels kicked in, fuel trucks was not 
> allowed in, and a few days later we lost all international connectivity.
>
> Lots of important people lost power as well, so the feds decided to let the 
> diesel tankers in after a few days’ deliberations.

Ah, okay. That must have been unique to South Africa, I imagine?

My recollection during that month was we still had connectivity. We
routed our services via PanAmSat's PAS-3R (which later became Intelsat
3R after the acquisition) and landed in their Atlanta teleport. We
weren't impacted, in Uganda, at the time, nor I recall any other outages
in Kenya, Tanzania or Rwanda either.

I'm reminded how, from Uganda, PAS-3R was such a shallow bird, ±6° :-).

Mark.

Re: DHS letters for fuel and facility access

[Grant Taylor via NANOG]

On 3/17/20 11:35 AM, Alexandre Petrescu wrote:
But I dont expect me to go to my desk any time since now in 
one month to press the button on the phone to set the voicemail active.


My office had problems with multiple workstations needing someone to 
kick them.  My team had someone volunteer to go in and kick multiple 
machines to get the rest of my team back online.


I would be surprised if it's not possible to get someone to go poke a 
button on your phone.




--
Grant. . . .
unix || die

Re: DHS letters for fuel and facility access

[Grant Taylor via NANOG]

On 3/17/20 11:35 AM, Alexandre Petrescu wrote:
But I dont expect me to go to my desk any time since now in 
one month to press the button on the phone to set the voicemail active.


My office had problems with multiple workstations needing someone to 
kick them.  My team had someone volunteer to go in and kick multiple 
machines to get the rest of my team back online.


I would be surprised if it's not possible to get someone to go poke a 
button on your phone.




--
Grant. . . .
unix || die



smime.p7s
Description: S/MIME Cryptographic Signature

Re: DHS letters for fuel and facility access

[bzs]

I remember an anecdote during 9/11 about a fuel truck being stopped, I
think the line was Houston St, someone found an empty fuel truck on
the other side and convinced the natl guard or whoever it was to let
them transfer the diesel from one truck to the other across the line
and get the fuel where it was needed.

Whatever works I guess.

-- 
-Barry Shein

Software Tool & Die| b...@theworld.com | http://www.TheWorld.com
Purveyors to the Trade | Voice: +1 617-STD-WRLD   | 800-THE-WRLD
The World: Since 1989  | A Public Information Utility | *oo*

Re: DHS letters for fuel and facility access

[Alexandre Petrescu]

At my work place there is enough generators, fuel generators.

There is enough time to power things down properly.

The IT infra seems to be working ok, although some remote workers 
complain about a few things about VPN.


There is however worry that the IT infra might not keep up, or that not 
all employees might have access to emails.  To address that, they have 
built a website facing to the Internet with internal announcement info 
to employees. They have also created a registry where the employees 
record their external email addresses so we receive internal 
announcements but on external email addresses, a thing which was more or 
less prohibited in normal times by IT policy.


The internal emergency phone number (two digit phone number only 
available to internals only by landline) has just been shut down.  The 
info circulated announcing it so.  IT is standard procedure in case of 
issues.


My desk voicemail is still active and I can consult it remotely, but not 
sure for how long.  The re-start of desk power typically resets the 
phone and I lose voicemail forever.  I expect that re-start of desk 
power in a few weeks or so, part of standard procedure to re-start power 
routinely.  But I dont expect me to go to my desk any time since now in 
one month to press the button on the phone to set the voicemail active.


Alex

Le 17/03/2020 à 18:21, Hiers, David a écrit :

Good reminder to test, test, test...


-Original Message-
From: NANOG [mailto:nanog-boun...@nanog.org] On Behalf Of Warren Kumari
Sent: Tuesday, March 17, 2020 10:08 AM
To: Paul Nash 
Cc: Untitled 3 
Subject: Re: DHS letters for fuel and facility access

On Tue, Mar 17, 2020 at 12:44 PM Paul Nash  wrote:

September 2001.  Just after the 9/11 attacks, all of lower Manhattan was shut 
down.  Out link (IIRC) was to a satellite farm on Staten island, across the bay 
to 60 Hudson.  Power went off, diesels kicked in, fuel trucks was not allowed 
in, and a few days later we lost all international connectivity.

We had some interesting failures during 9/11 as well -- for some reason, the 
UPS didn't kick in, so everything went down - and then came back a few minutes 
later as the generators came online -- and then went down again ~2 hours later 
-- turns out that the genset air filters got clogged with dust, and suffocated 
the diesel.
This was "fixed" a few days later by brushing them off with brooms and 
paintbrushes -- by this point they had completely discharged the 24V starter batteries, 
and so someone (not me!) had to lug a pair of car batteries and jumper cables. They 
restarted, and ran for a while, and then stopped again.

It turns out that getting a permit to store lots of diesel on the roof is hard 
(fair enough), and so there was only a small holding tank on the roof, and the 
primary tanks were in the basement -- and the transfer pump from the basement 
to roof storage was not, as we had been told, on generator power

We had specified that the transfer pump be on the generator feed, there was a schematic 
showing at is being on the generator feed, there was even a breaker with a cable marked  
"Transfer Pump (HP4,5)" --- but it turned out to just be a ~3ft piece of cable 
stuffed into a conduit, and not actually, you know, running all the way down to the 
basement and connected to the transfer pump.

W




Lots of important people lost power as well, so the feds decided to let the 
diesel tankers in after a few days’ deliberations.

 paul


On Mar 17, 2020, at 11:21 AM, Mark Tinka  wrote:



On 17/Mar/20 17:15, Paul Nash wrote:


That same fuel shortage killed all Internet traffic to sub-Saharan Africa.  
Took us a while to figure out what was wrong with the satellite link to the US.

What year was that :-)?

Mark.


--
I don't think the execution is relevant when it was obviously a bad idea in the 
first place.
This is like putting rabid weasels in your pants, and later expressing regret 
at having chosen those particular rabid weasels and that pair of pants.
---maf

--
This message and any attachments are intended only for the use of the addressee 
and may contain information that is privileged and confidential. If the reader 
of the message is not the intended recipient or an authorized representative of 
the intended recipient, you are hereby notified that any dissemination of this 
communication is strictly prohibited. If you have received this communication 
in error, notify the sender immediately by return email and delete the message 
and any attachments from your system.

Re: DHS letters for fuel and facility access

[Warren Kumari]

On Tue, Mar 17, 2020 at 1:21 PM Hiers, David  wrote:
>
> Good reminder to test, test, test...

Indeed -- and we had tested, multiple times. Unfortunately, the only
realistic way we would have found this would have been to kill power
to the building and run on generators for many hours, and then,
likely, we would only have discovered it when the gensets ran out of
power and fell over. IIRC, there is (or was) some noise and pollution
regulations in NYC where you could only run generators for short
periods of time (30min?) unless it was an actual emergency. I also
seem to remember something about having to test at night, probably
also for noise...

But, yes, regular testing is clearly a good practice - but so is
having a good BCP/DR plan (which you also test :-)
W


>
>
> -Original Message-
> From: NANOG [mailto:nanog-boun...@nanog.org] On Behalf Of Warren Kumari
> Sent: Tuesday, March 17, 2020 10:08 AM
> To: Paul Nash 
> Cc: Untitled 3 
> Subject: Re: DHS letters for fuel and facility access
>
> On Tue, Mar 17, 2020 at 12:44 PM Paul Nash  wrote:
> >
> > September 2001.  Just after the 9/11 attacks, all of lower Manhattan was 
> > shut down.  Out link (IIRC) was to a satellite farm on Staten island, 
> > across the bay to 60 Hudson.  Power went off, diesels kicked in, fuel 
> > trucks was not allowed in, and a few days later we lost all international 
> > connectivity.
>
> We had some interesting failures during 9/11 as well -- for some reason, the 
> UPS didn't kick in, so everything went down - and then came back a few 
> minutes later as the generators came online -- and then went down again ~2 
> hours later -- turns out that the genset air filters got clogged with dust, 
> and suffocated the diesel.
> This was "fixed" a few days later by brushing them off with brooms and 
> paintbrushes -- by this point they had completely discharged the 24V starter 
> batteries, and so someone (not me!) had to lug a pair of car batteries and 
> jumper cables. They restarted, and ran for a while, and then stopped again.
>
> It turns out that getting a permit to store lots of diesel on the roof is 
> hard (fair enough), and so there was only a small holding tank on the roof, 
> and the primary tanks were in the basement -- and the transfer pump from the 
> basement to roof storage was not, as we had been told, on generator power
>
> We had specified that the transfer pump be on the generator feed, there was a 
> schematic showing at is being on the generator feed, there was even a breaker 
> with a cable marked  "Transfer Pump (HP4,5)" --- but it turned out to just be 
> a ~3ft piece of cable stuffed into a conduit, and not actually, you know, 
> running all the way down to the basement and connected to the transfer pump.
>
> W
>
>
>
> >
> > Lots of important people lost power as well, so the feds decided to let the 
> > diesel tankers in after a few days’ deliberations.
> >
> > paul
> >
> > > On Mar 17, 2020, at 11:21 AM, Mark Tinka  wrote:
> > >
> > >
> > >
> > > On 17/Mar/20 17:15, Paul Nash wrote:
> > >
> > >> That same fuel shortage killed all Internet traffic to sub-Saharan 
> > >> Africa.  Took us a while to figure out what was wrong with the satellite 
> > >> link to the US.
> > >
> > > What year was that :-)?
> > >
> > > Mark.
> >
>
>
> --
> I don't think the execution is relevant when it was obviously a bad idea in 
> the first place.
> This is like putting rabid weasels in your pants, and later expressing regret 
> at having chosen those particular rabid weasels and that pair of pants.
>---maf
>
> --
> This message and any attachments are intended only for the use of the 
> addressee and may contain information that is privileged and confidential. If 
> the reader of the message is not the intended recipient or an authorized 
> representative of the intended recipient, you are hereby notified that any 
> dissemination of this communication is strictly prohibited. If you have 
> received this communication in error, notify the sender immediately by return 
> email and delete the message and any attachments from your system.



-- 
I don't think the execution is relevant when it was obviously a bad
idea in the first place.
This is like putting rabid weasels in your pants, and later expressing
regret at having chosen those particular rabid weasels and that pair
of pants.
   ---maf

RE: DHS letters for fuel and facility access

[Hiers, David]

Good reminder to test, test, test...


-Original Message-
From: NANOG [mailto:nanog-boun...@nanog.org] On Behalf Of Warren Kumari
Sent: Tuesday, March 17, 2020 10:08 AM
To: Paul Nash 
Cc: Untitled 3 
Subject: Re: DHS letters for fuel and facility access

On Tue, Mar 17, 2020 at 12:44 PM Paul Nash  wrote:
>
> September 2001.  Just after the 9/11 attacks, all of lower Manhattan was shut 
> down.  Out link (IIRC) was to a satellite farm on Staten island, across the 
> bay to 60 Hudson.  Power went off, diesels kicked in, fuel trucks was not 
> allowed in, and a few days later we lost all international connectivity.

We had some interesting failures during 9/11 as well -- for some reason, the 
UPS didn't kick in, so everything went down - and then came back a few minutes 
later as the generators came online -- and then went down again ~2 hours later 
-- turns out that the genset air filters got clogged with dust, and suffocated 
the diesel.
This was "fixed" a few days later by brushing them off with brooms and 
paintbrushes -- by this point they had completely discharged the 24V starter 
batteries, and so someone (not me!) had to lug a pair of car batteries and 
jumper cables. They restarted, and ran for a while, and then stopped again.

It turns out that getting a permit to store lots of diesel on the roof is hard 
(fair enough), and so there was only a small holding tank on the roof, and the 
primary tanks were in the basement -- and the transfer pump from the basement 
to roof storage was not, as we had been told, on generator power

We had specified that the transfer pump be on the generator feed, there was a 
schematic showing at is being on the generator feed, there was even a breaker 
with a cable marked  "Transfer Pump (HP4,5)" --- but it turned out to just be a 
~3ft piece of cable stuffed into a conduit, and not actually, you know, running 
all the way down to the basement and connected to the transfer pump.

W



>
> Lots of important people lost power as well, so the feds decided to let the 
> diesel tankers in after a few days’ deliberations.
>
> paul
>
> > On Mar 17, 2020, at 11:21 AM, Mark Tinka  wrote:
> >
> >
> >
> > On 17/Mar/20 17:15, Paul Nash wrote:
> >
> >> That same fuel shortage killed all Internet traffic to sub-Saharan Africa. 
> >>  Took us a while to figure out what was wrong with the satellite link to 
> >> the US.
> >
> > What year was that :-)?
> >
> > Mark.
>


--
I don't think the execution is relevant when it was obviously a bad idea in the 
first place.
This is like putting rabid weasels in your pants, and later expressing regret 
at having chosen those particular rabid weasels and that pair of pants.
   ---maf

--
This message and any attachments are intended only for the use of the addressee 
and may contain information that is privileged and confidential. If the reader 
of the message is not the intended recipient or an authorized representative of 
the intended recipient, you are hereby notified that any dissemination of this 
communication is strictly prohibited. If you have received this communication 
in error, notify the sender immediately by return email and delete the message 
and any attachments from your system.

Re: DHS letters for fuel and facility access

[Warren Kumari]

On Tue, Mar 17, 2020 at 12:44 PM Paul Nash  wrote:
>
> September 2001.  Just after the 9/11 attacks, all of lower Manhattan was shut 
> down.  Out link (IIRC) was to a satellite farm on Staten island, across the 
> bay to 60 Hudson.  Power went off, diesels kicked in, fuel trucks was not 
> allowed in, and a few days later we lost all international connectivity.

We had some interesting failures during 9/11 as well -- for some
reason, the UPS didn't kick in, so everything went down - and then
came back a few minutes later as the generators came online -- and
then went down again ~2 hours later -- turns out that the genset air
filters got clogged with dust, and suffocated the diesel.
This was "fixed" a few days later by brushing them off with brooms and
paintbrushes -- by this point they had completely discharged the 24V
starter batteries, and so someone (not me!) had to lug a pair of car
batteries and jumper cables. They restarted, and ran for a while, and
then stopped again.

It turns out that getting a permit to store lots of diesel on the roof
is hard (fair enough), and so there was only a small holding tank on
the roof, and the primary tanks were in the basement -- and the
transfer pump from the basement to roof storage was not, as we had
been told, on generator power

We had specified that the transfer pump be on the generator feed,
there was a schematic showing at is being on the generator feed, there
was even a breaker with a cable marked  "Transfer Pump (HP4,5)" ---
but it turned out to just be a ~3ft piece of cable stuffed into a
conduit, and not actually, you know, running all the way down to the
basement and connected to the transfer pump.

W



>
> Lots of important people lost power as well, so the feds decided to let the 
> diesel tankers in after a few days’ deliberations.
>
> paul
>
> > On Mar 17, 2020, at 11:21 AM, Mark Tinka  wrote:
> >
> >
> >
> > On 17/Mar/20 17:15, Paul Nash wrote:
> >
> >> That same fuel shortage killed all Internet traffic to sub-Saharan Africa. 
> >>  Took us a while to figure out what was wrong with the satellite link to 
> >> the US.
> >
> > What year was that :-)?
> >
> > Mark.
>


-- 
I don't think the execution is relevant when it was obviously a bad
idea in the first place.
This is like putting rabid weasels in your pants, and later expressing
regret at having chosen those particular rabid weasels and that pair
of pants.
   ---maf

Re: DHS letters for fuel and facility access

[Paul Nash]

September 2001.  Just after the 9/11 attacks, all of lower Manhattan was shut 
down.  Out link (IIRC) was to a satellite farm on Staten island, across the bay 
to 60 Hudson.  Power went off, diesels kicked in, fuel trucks was not allowed 
in, and a few days later we lost all international connectivity.

Lots of important people lost power as well, so the feds decided to let the 
diesel tankers in after a few days’ deliberations.

paul

> On Mar 17, 2020, at 11:21 AM, Mark Tinka  wrote:
> 
> 
> 
> On 17/Mar/20 17:15, Paul Nash wrote:
> 
>> That same fuel shortage killed all Internet traffic to sub-Saharan Africa.  
>> Took us a while to figure out what was wrong with the satellite link to the 
>> US.
> 
> What year was that :-)?
> 
> Mark.

Re: DHS letters for fuel and facility access

[Keefe John]

WISPA has the letters available in the Members Section of the website.

Keefe John
CEO
Ethoplex
Direct: 262.345.5200

Ethoplex Business Internet
http://www.ethoplex.com/
Signal Residential Internet
http://www.signalisp.com/

https://www.linkedin.com/in/keefejohn/


On Tue, Mar 17, 2020 at 10:33 AM Matt Hoppes <
mattli...@rivervalleyinternet.net> wrote:

> Does anyone know who to contact at DHS to see about getting a letter
> like this for an operator?
>
>
> >>> 
> >>> On some other mailing lists, FCC licensed operators are reporting they
> have received letters from the Department of Homeland Security authorizing
> "access" and "fuel" priority.
> >>>
> >>> Occasionally, DHS issues these letters after natural disasters such as
> hurricanes for hospitals and critical facilities.  I haven't heard of them
> issued for pandemics.
> >>>
> >
>

Re: DHS letters for fuel and facility access

[Matt Hoppes]

Does anyone know who to contact at DHS to see about getting a letter 
like this for an operator?





On some other mailing lists, FCC licensed operators are reporting they have received letters from 
the Department of Homeland Security authorizing "access" and "fuel" priority.

Occasionally, DHS issues these letters after natural disasters such as 
hurricanes for hospitals and critical facilities.  I haven't heard of them 
issued for pandemics.

Re: DHS letters for fuel and facility access

[Mark Tinka]

On 17/Mar/20 17:15, Paul Nash wrote:

> That same fuel shortage killed all Internet traffic to sub-Saharan Africa.  
> Took us a while to figure out what was wrong with the satellite link to the 
> US.

What year was that :-)?

Mark.

Re: DHS letters for fuel and facility access

[Paul Nash]

That same fuel shortage killed all Internet traffic to sub-Saharan Africa.  
Took us a while to figure out what was wrong with the satellite link to the US.

paul

> On Mar 16, 2020, at 5:12 PM, Ben Cannon  wrote:
> 
> We (Verizon not me) lost a central office during 9/11 because it ran out of 
> fuel - the tankers were staged but we’re not allowed to enter Manhattan.  
> 
> This clears that pathway for us now, and it’s fairly standard protocol since.
> 
> -Ben
> 
>> On Mar 16, 2020, at 1:20 PM, Sean Donelan  wrote:
>> 
>> 
>> On some other mailing lists, FCC licensed operators are reporting they have 
>> received letters from the Department of Homeland Security authorizing 
>> "access" and "fuel" priority.
>> 
>> Occasionally, DHS issues these letters after natural disasters such as 
>> hurricanes for hospitals and critical facilities.  I haven't heard of them 
>> issued for pandemics.
>> 

Re: DHS letters for fuel and facility access

[Ben Cannon]

It’s true, we’re all here, and we’re standing by.  Also if anyone on NANOG 
needs something we can do, please reach out to me via email and I will make it 
happen.  You’re not alone during times of crisis.
-Ben.

-Ben Cannon
CEO 6x7 Networks & 6x7 Telecom, LLC 
b...@6by7.net 




> On Mar 16, 2020, at 4:24 PM, George Herbert  wrote:
> 
> 
> The SF Bay Area shelter in place rules specifically exempt news media, 
> telecommunications and internet including infrastructure services thereof 
> (presumably large internet companies, network and security vendors, etc), 
> fuel deliveries.
> 
> I could use infrastructure vendors excuse but $current_client_company is on 
> mandatory WFH for next five weeks and team had filtered out doing it 
> informally before it became official.  
> 
> I’d name the company but someone might contact me for an emergency and I have 
> nothing to do with the customer incidents team.  I don’t even know who to 
> forward stuff to.  Suffice it to say that everyone doing network security 
> infra at all the vendors is being as safe as possible under the 
> circumstances.  We’re trying to keep all the lights on for you.
> 
> 
> -George 
> 
> Sent from my iPhone
> 
>> On Mar 16, 2020, at 1:21 PM, Sean Donelan  wrote:
>> 
>> 
>> On some other mailing lists, FCC licensed operators are reporting they have 
>> received letters from the Department of Homeland Security authorizing 
>> "access" and "fuel" priority.
>> 
>> Occasionally, DHS issues these letters after natural disasters such as 
>> hurricanes for hospitals and critical facilities.  I haven't heard of them 
>> issued for pandemics.
>> 

Re: DHS letters for fuel and facility access

[George Herbert]

The SF Bay Area shelter in place rules specifically exempt news media, 
telecommunications and internet including infrastructure services thereof 
(presumably large internet companies, network and security vendors, etc), fuel 
deliveries.

I could use infrastructure vendors excuse but $current_client_company is on 
mandatory WFH for next five weeks and team had filtered out doing it informally 
before it became official.  

I’d name the company but someone might contact me for an emergency and I have 
nothing to do with the customer incidents team.  I don’t even know who to 
forward stuff to.  Suffice it to say that everyone doing network security infra 
at all the vendors is being as safe as possible under the circumstances.  We’re 
trying to keep all the lights on for you.


-George 

Sent from my iPhone

> On Mar 16, 2020, at 1:21 PM, Sean Donelan  wrote:
> 
> 
> On some other mailing lists, FCC licensed operators are reporting they have 
> received letters from the Department of Homeland Security authorizing 
> "access" and "fuel" priority.
> 
> Occasionally, DHS issues these letters after natural disasters such as 
> hurricanes for hospitals and critical facilities.  I haven't heard of them 
> issued for pandemics.
> 

Re: DHS letters for fuel and facility access

[Tim Požár]

As an ex-broadcaster, I have never seen one of these letters.  Even 
during our 1989 earthquake.   In fact, I knew of one station that 
ordered a genset as power was down after the earthquake for several days 
and it was commandeered by LE as they were being driven to the 
transmitter site, three times!  Three different gensets!




On 3/16/20 1:20 PM, Sean Donelan wrote:


On some other mailing lists, FCC licensed operators are reporting they 
have received letters from the Department of Homeland Security 
authorizing "access" and "fuel" priority.


Occasionally, DHS issues these letters after natural disasters such as 
hurricanes for hospitals and critical facilities.  I haven't heard of 
them issued for pandemics.

Re: DHS letters for fuel and facility access

[james jones]

I get that thanks, wasn’t trying to be snarky just genuinely curious.

Sent from my iPhone

> On Mar 16, 2020, at 4:46 PM, Sean Donelan  wrote:
> 
> 
> In response to a snarky question offlist.  Yes, the DHS letters are just 
> copies.  Yes, the DHS letters are easy to counterfeit.
> 
> Not a lawyer, but counterfeiting an official federal document during a 
> national state of emergency likely violates many federal and state laws.
> 
> DON'T DO IT.
> 
> 
>> On Mon, 16 Mar 2020, Sean Donelan wrote:
>> On some other mailing lists, FCC licensed operators are reporting they have 
>> received letters from the Department of Homeland Security authorizing 
>> "access" and "fuel" priority.
>> 
>> Occasionally, DHS issues these letters after natural disasters such as 
>> hurricanes for hospitals and critical facilities.  I haven't heard of them 
>> issued for pandemics.

Re: DHS letters for fuel and facility access

[james jones]

Got it!

Sent from my iPhone

> On Mar 16, 2020, at 4:26 PM, Jared Mauch  wrote:
> 
> 
> 
>> On Mar 16, 2020, at 4:24 PM, james jones  wrote:
>> 
>> Fuel priority? They expecting shortage and/or power outages?
>> 
> 
> I suspect it’s more to solve issues with truck drivers going to work and 
> their job is to deliver fuel.  Some areas have been instituting curfews and 
> this would satisfy the local authorities who may stop such a driver.
> 
> - Jared
> 

Re: DHS letters for fuel and facility access

[Ben Cannon]

We (Verizon not me) lost a central office during 9/11 because it ran out of 
fuel - the tankers were staged but we’re not allowed to enter Manhattan.  

This clears that pathway for us now, and it’s fairly standard protocol since.

-Ben

> On Mar 16, 2020, at 1:20 PM, Sean Donelan  wrote:
> 
> 
> On some other mailing lists, FCC licensed operators are reporting they have 
> received letters from the Department of Homeland Security authorizing 
> "access" and "fuel" priority.
> 
> Occasionally, DHS issues these letters after natural disasters such as 
> hurricanes for hospitals and critical facilities.  I haven't heard of them 
> issued for pandemics.
> 

Re: DHS letters for fuel and facility access

[Sean Donelan]

In response to a snarky question offlist.  Yes, the DHS letters are just 
copies.  Yes, the DHS letters are easy to counterfeit.


Not a lawyer, but counterfeiting an official federal document during a 
national state of emergency likely violates many federal and state laws.


DON'T DO IT.


On Mon, 16 Mar 2020, Sean Donelan wrote:
On some other mailing lists, FCC licensed operators are reporting they have 
received letters from the Department of Homeland Security authorizing 
"access" and "fuel" priority.


Occasionally, DHS issues these letters after natural disasters such as 
hurricanes for hospitals and critical facilities.  I haven't heard of them 
issued for pandemics.

Re: DHS letters for fuel and facility access

[Sean Donelan]

Its a form letter.

Same letter is printed no matter what disaster its for.  I don't think 
they are expecting power outages (unless there is a co-disaster at the 
same time).  Its just the standard form.



On Mon, 16 Mar 2020, james jones wrote:


Fuel priority? They expecting shortage and/or power outages?
-James

On Mon, Mar 16, 2020 at 4:21 PM Sean Donelan  wrote:

  On some other mailing lists, FCC licensed operators are
  reporting they
  have received letters from the Department of Homeland Security
  authorizing
  "access" and "fuel" priority.

  Occasionally, DHS issues these letters after natural disasters
  such as
  hurricanes for hospitals and critical facilities.  I haven't
  heard of them
  issued for pandemics.

Re: DHS letters for fuel and facility access

[Jared Mauch]

> On Mar 16, 2020, at 4:24 PM, james jones  wrote:
> 
> Fuel priority? They expecting shortage and/or power outages?
> 

I suspect it’s more to solve issues with truck drivers going to work and their 
job is to deliver fuel.  Some areas have been instituting curfews and this 
would satisfy the local authorities who may stop such a driver.

- Jared

Re: DHS letters for fuel and facility access

[james jones]

Fuel priority? They expecting shortage and/or power outages?

-James

On Mon, Mar 16, 2020 at 4:21 PM Sean Donelan  wrote:

>
> On some other mailing lists, FCC licensed operators are reporting they
> have received letters from the Department of Homeland Security authorizing
> "access" and "fuel" priority.
>
> Occasionally, DHS issues these letters after natural disasters such as
> hurricanes for hospitals and critical facilities.  I haven't heard of them
> issued for pandemics.
>
>