> On Sep 17, 2021, at 8:59 AM, Sean Donelan wrote:
>
> It is possible to design a data center WITHOUT using those electrical code
> exceptions, and WITHOUT a "Big Red Button."
>
> You can check, because my data center ideas were copied by several tech
> companies world-wide (you know who
Sigh, people often mis-hear this when I say it, so I will try to say it
carefully.
If you have an Emergency Power Off (EPO), the electrical code (and
life-safety code) allows use of several alternative wiring methods. Some
people mistakenly believe the allowed alternatives are the rule, but
7-6824 or 1-800-430-6404 (MB only)
> athomp...@merlin.mb.ca <mailto:athomp...@merlin.mb.ca>
> www.merlin.mb.ca <http://www.merlin.mb.ca/>
> From: NANOG on behalf of Jay
> R. Ashworth
> Sent: September 11, 2021 22:23
> To: nanog
> Subject: Re: Never push the Big Red Button (N
We had a new fire suppression guy testing our system for our computer room,
and unbeknownst to him, one of the tests that he did triggered the EPO.
One of my co-workers was in the room, which had about 20 racks of
equipment, and he told me afterwards that for a quick second he thought he
died.
He
to
restart everything if we ever had to hit our red button.
-richey
From: NANOG on behalf of
Roy
Date: Thursday, September 16, 2021 at 12:41 AM
To: nanog
Subject: Re: Never push the Big Red Button (New York City subway failure)
Miy story in the late 1970s I was working in a large computer
- On Sep 15, 2021, at 9:08 PM, bzs b...@theworld.com wrote:
Hi,
> People don't suffocate from Halon dumps, I've been thru a couple (not
> me personally but staff, I was in my office but arrived quickly.)
>
> What is somewhat dangerous about Halon (or likely more modern) fire
> suppression
Miy story in the late 1970s I was working in a large computer facility
with both mainframes and mil-spec 400hz computers.
Management decided that the EPO should be tested. So we powered down
the disk and tapes. The electrician pressed
the EPO button and NOTHING. Everything kept running.
On September 15, 2021 at 13:31 war...@kumari.net (Warren Kumari) wrote:
> Well, there is the EPO button, which generally does that, and the (variously
> labeled) HALON/FM-200/GAS FIRE SUPPRESSION/GAS DISCHARGE button, which does
> the
> flashy lights and klangly bell and similar. This is
Totally agree @billy, could've put it better myself. Though it's much more
entertaining (and terrifying) to wince at the audible difference between
just the hardware whirring to a silence, and all of the temp and humidity
controls whirring to a halt with the hardware. The fear in the air is
Indeed. Few sounds in the data center haunt me quite as much as a sensation
that the decibel level has just decreased significantly.
On Wed, Sep 15, 2021, 4:14 PM Keith Stokes wrote:
> The bigger thing to notice is the *lack* of noise as every server, switch
> and storage system spins down.
>
>
> On Sep 15, 2021, at 2:20 PM, Fred Baker wrote:
>
> One of the many stories that came out of 9/11 was a switching center in NY
> City that had a diesel generator as a power backup - which of course acted as
> primary when the city power is off. After a few days of operation, it needed
> to
The bigger thing to notice is the *lack* of noise as every server, switch and
storage system spins down.
---
Keith Stokes
On Sep 15, 2021, at 3:50 PM, Stephen Satchell
mailto:l...@satchell.net>> wrote:
In the data centers I've worked in over the decades, those Big Red Buttons
would
In the data centers I've worked in over the decades, those Big Red
Buttons would activate a normally-closed contactor in a breaker panel.
When pushed, the contactor would open, and turn off all the circults in
said breaker panel. Not affected are lights, convenience outlets, door
locks, and
On Wed, Sep 15, 2021 at 12:32 PM Warren Kumari wrote:
> Oooof. I've seen someone at a gas station do something similar --
> I cannot remember if it was putting diesel in their gasoline car,
> or gas in their diesel pickup, but I *do* remember the sudden
> yelp and look of dismay when they
On Wed, Sep 15, 2021 at 3:20 PM Fred Baker wrote:
>
>
> > On Sep 10, 2021, at 1:33 PM, Warren Kumari wrote:
> >
> > The utility let them know that they were going to be doing some
> maintenance work in the area. No impact expected, but out of an abundance
> of caution, they transfer over to
> On Sep 10, 2021, at 1:33 PM, Warren Kumari wrote:
>
> The utility let them know that they were going to be doing some maintenance
> work in the area. No impact expected, but out of an abundance of caution,
> they transfer over to generators. After the utility lets them know that the
>
- Original Message -
> From: "Adam Thompson"
> Now I'm curious... in all of the DCs and COs I've worked in - to the best of
> my
> knowledge, I haven't personally tested this! - the EPO button does not switch
> to emergency power. It turns off ALL equipment power in the space - no
>
very long pause…then some mumbling off phone, then the manager
>>> got on the line and said someone would be flying out and be onsite within
>>> 12 hours. We were down for 3 days, and got fined $250,000 by the insurance
>>> regulators since we couldn’t pay claims.
>>>
>>>
>>>
>>> *Matthew Huff* | Director of Technical Operations
On Wed, Sep 15, 2021 at 12:23 PM Daniel Seagraves <
dseag...@humancapitaldev.com> wrote:
>
> On Sep 15, 2021, at 10:58 AM, Adam Thompson
> wrote:
>
> Now I'm curious... in all of the DCs and COs I've worked in - to the best
> of my knowledge, I haven't personally tested this! - the EPO button
On Wed, Sep 15, 2021 at 9:21 AM Daniel Seagraves
wrote:
> It was always my understanding EPO was to be used for
> “We have an electrical fire and need to remove the source RFN”,
> not “we need to be on the redundant power instead of city power
> and don’t want to wait for the automatic transfer”.
On 9/15/21 08:58, Adam Thompson wrote:
Now I'm curious... in all of the DCs and COs I've worked in - to the
best of my knowledge, I haven't personally tested this! - the EPO button
does *not* switch to emergency power. It turns off ALL equipment power
in the space - no lights, no klaxons,
> On Sep 15, 2021, at 10:58 AM, Adam Thompson wrote:
>
> Now I'm curious... in all of the DCs and COs I've worked in - to the best of
> my knowledge, I haven't personally tested this! - the EPO button does not
> switch to emergency power. It turns off ALL equipment power in the space -
>
ehalf of Jay
R. Ashworth
Sent: September 11, 2021 22:23
To: nanog
Subject: Re: Never push the Big Red Button (New York City subway failure)
- Original Message -
> From: "Sean Donelan"
> NEW YORK CITY TRANSIT RAIL CONTROL CENTER POWER
> OUTAGE ISSUE ON AUGUST 29, 20
- Original Message -
> From: "Sean Donelan"
> NEW YORK CITY TRANSIT RAIL CONTROL CENTER POWER
> OUTAGE ISSUE ON AUGUST 29, 2021
> Key Findings
> September 8, 2021
>
> https://www.governor.ny.gov/sites/default/files/2021-09/WSP_Key_Findings_Summary-for_release.pdf
>
> Key Findings
>
t;
>>
>>
>> *Office: 914-460-4039*
>>
>> *mh...@ox.com | **www.ox.com <http://www.ox.com>*
>>
>>
>> *.......
..*
>
>
>
> *From:* Chris Kane
> *Sent:* Friday, September 10, 2021 3:16 PM
> *To:* Christopher Morrow
> *Cc:* Matthew Huff ; nanog@nanog.org
> *Subject:* Re: Never push the Big Red Button (New York City subway
> failure)
>
>
>
> True EPO story; main
..
>>
>> -----Original Message-----
>> From: NANOG On Behalf Of Sean
>> Donelan
>> Sent: Friday, September 10, 2021 12:38 PM
>> To: nanog@nanog.org
>> Subject: Never push the Big Red Button (New York City subway failure)
>>
>&
On Fri, 10 Sep 2021, Sean Donelan wrote:
1. The “Emergency Power Off” button did not have a protective cover at the
time of the shutdown or the following WSP investigation.
Aka "molly-guard".
https://en.wiktionary.org/wiki/molly-guard
--
Mikael Abrahamssonemail: swm...@swm.pp.se
...
-Original Message-
From: NANOG mailto:ox@nanog.org>> On
Behalf Of Sean Donelan
Sent: Friday, September 10, 2021 12:38 PM
To: nanog@nanog.org<mailto:nanog@nanog.org>
Subject: Never push the Big Red Button (New York City subway failure)
NEW YORK CITY TRANSIT RAIL CONTROL
t;>
>> -Original Message-
>> From: NANOG On Behalf Of Sean
>> Donelan
>> Sent: Friday, September 10, 2021 12:38 PM
>> To: nanog@nanog.org
>> Subject: Never push the Big Red Button (New York City subway failure)
>>
>> NEW YORK CITY TRANS
Friday, September 10, 2021 12:38 PM
> To: nanog@nanog.org
> Subject: Never push the Big Red Button (New York City subway failure)
>
> NEW YORK CITY TRANSIT RAIL CONTROL CENTER POWER
> OUTAGE ISSUE ON AUGUST 29, 2021
> Key Findings
> September 8, 2021
>
>
>
>
Donelan
Sent: Friday, September 10, 2021 12:38 PM
To: nanog@nanog.org
Subject: Never push the Big Red Button (New York City subway failure)
NEW YORK CITY TRANSIT RAIL CONTROL CENTER POWER
OUTAGE ISSUE ON AUGUST 29, 2021
Key Findings
September 8, 2021
https://www.governor.ny.gov/sites/default/files
NEW YORK CITY TRANSIT RAIL CONTROL CENTER POWER
OUTAGE ISSUE ON AUGUST 29, 2021
Key Findings
September 8, 2021
https://www.governor.ny.gov/sites/default/files/2021-09/WSP_Key_Findings_Summary-for_release.pdf
Key Findings
[...]
3. Based on the electrical equipment log readings and the
33 matches
Mail list logo
