Nope . This guy did it .
On Tue, Oct 5, 2021, 2:46 PM Nate Burke wrote:
> I think the more plausible explanation is that Zuckerberg was in a bar
> with some guys he was trying to impress saying something like 'I do SO run
> Facebook' and then whips out his phone and instead of deleting their
>
Ping FB.com -t
Sent from my iPhone
> On Oct 5, 2021, at 4:40 PM, Robert wrote:
>
> Much more information, _Except the Command_ LOL
>
> https://engineering.fb.com/2021/10/05/networking-traffic/outage-details/
>
>> On 10/5/21 9:17 AM, Bill Prince wrote:
>> I see it differently. In the
Much more information, _Except the Command_ LOL
https://engineering.fb.com/2021/10/05/networking-traffic/outage-details/
On 10/5/21 9:17 AM, Bill Prince wrote:
I see it differently. In the beginning cloudflare thought something
was wrong with their systems. It doesn't explain what
Probably better luck finding a 10mm wrench
On Tue, Oct 5, 2021, 4:26 PM Nate Burke wrote:
> No, they just had to find a laptop that had a serial port on it. They
> probably only are issued company tablets.
>
> On 10/5/2021 4:22 PM, Steve Jones wrote:
>
> Id like to think some lowly janitor was
No, they just had to find a laptop that had a serial port on it. They
probably only are issued company tablets.
On 10/5/2021 4:22 PM, Steve Jones wrote:
Id like to think some lowly janitor was picked up from his vacation by
a helicopter right from his john boat on the lake, whisked to an
Id like to think some lowly janitor was picked up from his vacation by a
helicopter right from his john boat on the lake, whisked to an airport and
loaded onto a leer jet to california, then police escorted to FB HQ to pull
out his big ol key ring and open the door
On Tue, Oct 5, 2021 at 4:12 PM
Probably more like some kind of automation with a bug in it. I got a kick out
of FB actually saying that this caused some of their people to be physically
locked out of data center equipment they needed to access to fix it. I don’t
think I would have ever admitted that.
From: Nate Burke
I think the more plausible explanation is that Zuckerberg was in a bar
with some guys he was trying to impress saying something like 'I do SO
run Facebook' and then whips out his phone and instead of deleting their
profile, he presses the 'delete all' button by accident.
I've been at some
If 30 minutes would have been long enough. I wonder how long it really takes
for BGP changes to propagate.
Having contracted for FB before, let me tell you their management style is
horrible. Conference calls to plan conference calls. I got my ass chewed for
being honest on a call. Can’t
ill bet whatever their process was, its not what it is and delayed
commits/fallbacks are instituted forthwith. Not by the guy who
committed this set of changes though, hes at the bottom of a river now
On Tue, Oct 5, 2021 at 12:13 PM Cassidy B. Larson wrote:
> I wonder if they did a "commit
I wonder if they did a "commit confirmed 30”? If not, would that have avoided
the whole thing?
> On Oct 5, 2021, at 11:08 AM, Carl Peterson wrote:
>
> "an engineer put in a config change on a BGP router that propagated to the
> other BGP routers and cut off access"
>
> Sounds like
"an engineer put in a config change on a BGP router that propagated to the
other BGP routers and cut off access"
Sounds like something I would do which is why I generally insist on
having a remote tech physically in the building with a console cable if I
don't have OOB console access when
FB has posted that an engineer put in a config change on a BGP router
that propagated to the other BGP routers and cut off access. Sounds
like it took a while to track down the config change. I do know someone
who is intimate with that group but he's not talking... Drinking, but
not
I see it differently. In the beginning cloudflare thought
something was wrong with their systems. It doesn't explain what
happened inside facebook, probably because only facebook knows
what went wrong. That's not cloudflare's problem. We may never
know what
I really don't like that cloudflare posted this, as it doesn't do
anything to tell why. It's not a root cause, it's an effect and
cloudflare looks like they are just trying to say how smart they are.
On 10/5/21 8:40 AM, Bill Prince wrote:
https://blog.cloudflare.com/october-2021-facebook-outage/
bp
On 10/5/2021 7:39 AM, Chuck McCown via
AF wrote:
Sign him up for a SNAP card.
Sent from my iPhone
On Oct 5, 2021, at 8:25 AM, Bill Prince
Sign him up for a SNAP card.
Sent from my iPhone
> On Oct 5, 2021, at 8:25 AM, Bill Prince wrote:
>
>
> Heard the Zuch got around $6 or $7 billion trimmed from his net worth
> yesterday. Now he's only worth around $121 billion.
>
>
>
> bp
>
> On 10/5/2021 6:52 AM, dmmoff...@gmail.com
Heard the Zuch got around $6 or $7 billion trimmed from his net
worth yesterday. Now he's only worth around $121 billion.
bp
On 10/5/2021 6:52 AM,
dmmoff...@gmail.com wrote:
I am very curious what it was
I am very curious what it was that took 6 hours to figure out or undo.
…..but I wouldn’t judge too harshly. When any contraption gets big and complex
it’s easy to overlook one seemingly small thing.
Remember this XKCD?
From: AF On Behalf Of Steve Jones
Sent: Monday,
19 matches
Mail list logo
