Re: [outages] After-Action Report: Facebook/Meta outage

There was definitely a reset of Auth. Seen here in the middle east. Whether that was intentional eg security patch similar to Google I'm not sure but it recovered after a few minutes and looks okay since On Wed, 6 Mar 2024, 00:17 Aaron Hope via Outages, wrote: > GAH! Too many emails about

Re: [outages] After-Action Report: Facebook/Meta outage

GAH! Too many emails about Facebook today! Now I got bit! Sorry all :) Aaron From: Outages on behalf of Aaron Hope via Outages Sent: Tuesday, March 5, 2024 3:14 PM To: Ross Tajvar ; Jay Ashworth Cc: outages@outages.org Subject: Re: [outages] After-Action

[outages] Recall: Re: After-Action Report: Facebook/Meta outage

aaron.h...@papamurphys.com would like to recall the message, "Re: [outages] After-Action Report: Facebook/Meta outage". WARNING CONCERNING CONFIDENTIALITY This email message, including any attachments, is for the sole use by its intended recipient or recipients and may contain confidential and

Re: [outages] After-Action Report: Facebook/Meta outage

We are not renewing Splunk. We have migrated to Azure Sentinel for logging and monitoring. Aaron From: Outages on behalf of Jay Ashworth via Outages Sent: Tuesday, March 5, 2024 2:59 PM To: Ross Tajvar Cc: outages@outages.org Subject: Re: [outages]

Re: [outages] After-Action Report: Facebook/Meta outage

Yeah, but I shouldn't have gotten bitten. I'm supposed to be holding myself to a higher standard, as a moderator of this particular group. On March 5, 2024 2:58:00 PM EST, Ross Tajvar wrote: >Indeed - this happens every time facebook has a major outage, because they >stopped putting out posts

Re: [outages] After-Action Report: Facebook/Meta outage

Indeed - this happens every time facebook has a major outage, because they stopped putting out posts explaining what happened and because people tend not to look too closely before spreading links that look plausible. On Tue, Mar 5, 2024 at 2:56 PM Jay R. Ashworth via Outages <

Re: [outages] After-Action Report: Facebook/Meta outage

Well, when I pulled up the link from Ross's mobile version, it had comments under it from 10/22; if those people didn't know where to go either... :-} - Original Message - > From: "Damian Menscher" > To: "jra" > Cc: outages@outages.org > Sent: Tuesday, March 5, 2024 2:16:33 PM >

Outages-discussion Digest, Vol 165, Issue 4

>> Outages-discussion mailing list >> Outages-discussion@outages.org >> https://puck.nether.net/mailman/listinfo/outages-discussion >> > > >-- >Yours sincerely, >Ivan Ip >Pantry Manager at Toughlife -- Sent from my Android device with K-9 Mail. Please e

Re: [outages] After-Action Report: Facebook/Meta outage

On Tue, Mar 05, 2024 at 07:12:24PM +, Jay R. Ashworth via Outages wrote: > Well, it seems equivocal whether that's about *this* outage > rather than an earlier one -- though it's clearly not from 2010. It's from 2010

Re: [outages] After-Action Report: Facebook/Meta outage

It clearly *is* from 2010: https://engineering.fb.com/2010/09/23/uncategorized/more-details-on-today-s-o Damian On Tue, Mar 5, 2024 at 11:13 AM Jay R. Ashworth via Outages < outages@outages.org> wrote: > Well, it seems equivocal whether that's about *this* outage > rather than an earlier one --

Re: [outages] After-Action Report: Facebook/Meta outage

Well, it seems equivocal whether that's about *this* outage rather than an earlier one -- though it's clearly not from 2010. More to follow. Cheers, -- jra - Original Message - > From: "Jay R. Ashworth via Outages" > To: outages@outages.org > Sent: Tuesday, March 5, 2024 1:57:24 PM >

[outages] After-Action Report: Facebook/Meta outage

[ I can't set the header from Zimbra, but please, Reply-To: -discuss ] Here's a link to FB's AAR about this morning's 70-minuteish outage. It's been pointed out to me that this affected other services as well, if they are an OAuth client, and you chose to use FB's OAuth service to create your

Outages-discussion Digest, Vol 165, Issue 3

e this email if you received it in error. -- next part -- An HTML attachment was scrubbed... URL: <https://puck.nether.net/pipermail/outages-discussion/attachments/20240305/d09c78b0/attachment-0001.htm> -- Message: 3 Date: Tue, 05 Mar 2024 11

[outages] FACEBOOK/META recovering

No further messages are expected to be necessary on the main list. I know no one's actually listening, but please govern yourselves accordingly. :-) -- Sent from my Android device with K-9 Mail. Please excuse my brevity.___ Outages mailing list

Re: [outages] Facebook/ Insta down?

My Facebook is back up here in NW Ohio everything is loading now On 2024-03-05 16:30, Mel Beckman wrote: Sorry, Nash, but that page is not responding. -mel via cell On Mar 5, 2024, at 8:25 AM, Nate wrote:  Hey all for the latest and greatest info on this issue go check out meta status

Re: [outages] Facebook/ Insta down?

Sorry, Nash, but that page is not responding. -mel via cell On Mar 5, 2024, at 8:25 AM, Nate wrote:  Hey all for the latest and greatest info on this issue go check out meta status page instead of chatting here. https://metastatus.com/ Thank you. On Tue, Mar 5, 2024, 8:23 AM Jay Ashworth

Re: [outages] [External] Re: Facebook/ Insta down?

I am seeing the return of Facebook and Messenger here. -- Hunter Fuller (they) Router Jockey VBH M-1C +1 256 824 5331 Office of Information Technology The University of Alabama in Huntsville Network Engineering On Tue, Mar 5, 2024 at 10:23 AM Jay Ashworth via Outages < outages@outages.org>

Re: [outages] Facebook/ Insta down?

Hey all for the latest and greatest info on this issue go check out meta status page instead of chatting here. https://metastatus.com/ Thank you. On Tue, Mar 5, 2024, 8:23 AM Jay Ashworth via Outages wrote: > I am hearing some uninformed speculations somebody fat fingered their > major DB

Re: [outages] Facebook/ Insta down?

I am hearing some uninformed speculations somebody fat fingered their major DB cluster, but really guys, take this over to the discussion list please. Press hard, you are making 30,000 copies. On March 5, 2024 11:19:32 AM EST, Tim Reichhart via Outages wrote: >It would allow me to login on

Re: [outages] [EXTERNAL] Re: Facebook/ Insta down?

Down Philadelphia Linda Lederer IT DEPARTMENT [A picture containing object Description generated with very high confidence] 2701 Red Lion Road Philadelphia, PA 19154 Office: 215.992.0900 Ext. 238

Re: [outages] Facebook/ Insta down?

It would allow me to login on the app but noting will load when tried messenger it will not allow me to login so I’m thinking coding got canned like att did week ago lol On 2024-03-05 16:15, Tim Reichhart via Outages wrote: Mine is starting to come back up here in nw ohio On 2024-03-05

Re: [outages] Facebook/ Insta down?

Mine is starting to come back up here in nw ohio On 2024-03-05 16:13, Mel Beckman wrote: According to downdetector.com, many Google services, AWS, and Amazon shopping are all showing a large spike in complaints. -mel On Mar 5, 2024, at 8:09 AM, Tim Reichhart via Outages wrote: It’s

Re: [outages] Facebook/ Insta down?

Repeat of att code error again? On 2024-03-05 16:13, Mel Beckman wrote: According to downdetector.com, many Google services, AWS, and Amazon shopping are all showing a large spike in complaints. -mel On Mar 5, 2024, at 8:09 AM, Tim Reichhart via Outages wrote: It’s global I’m seeing

Re: [outages] Facebook/ Insta down?

According to downdetector.com, many Google services, AWS, and Amazon shopping are all showing a large spike in complaints. -mel > On Mar 5, 2024, at 8:09 AM, Tim Reichhart via Outages > wrote: > > It’s global I’m seeing now > > >> On 2024-03-05 16:01, James Breeden via Outages wrote: >>

[outages] REMINDER: MAIN LIST NOT FOR CHAT

The only other messages we should see on the main list are "it's back now". Please take the discussions over to -discuss. Cheers, -- jr '' a -- Sent from my Android device with K-9 Mail. Please excuse my brevity.___ Outages mailing list

Re: [outages] Who broke the Internet? 2024-03-05 edition.

Looks like what att took week ago it’s being reported as auth code is broke On 2024-03-05 16:08, Jason Kuehl via Outages wrote: I love the smell of a bad BGP something in the morning. On Tue, Mar 5, 2024 at 11:01 AM Edward Vielmetti via Outages wrote: Down detector is showing elevated

Re: [outages] Who broke the Internet? 2024-03-05 edition.

I love the smell of a bad BGP something in the morning. On Tue, Mar 5, 2024 at 11:01 AM Edward Vielmetti via Outages < outages@outages.org> wrote: > Down detector is showing elevated problems across Facebook/Meta > properties, Google properties, T-Mobile, Discord, Tik Tok – with no obvious >

Re: [outages] Facebook/ Insta down?

It’s global I’m seeing now On 2024-03-05 16:01, James Breeden via Outages wrote: Everyone else is using meta login and can't log in  Seriously though, DownDetector is over 600k reports. James W. Breeden _Managing Partner_ _ _ Arenal Group: Arenal Consulting Group | Acilis Telecom

Re: [outages] Facebook/ Insta down?

Failing for us as well. “It’s down, Debbie.” -mel On Mar 5, 2024, at 8:04 AM, James Breeden via Outages wrote:  Everyone else is using meta login and can't log in  Seriously though, DownDetector is over 600k reports. James W. Breeden Managing Partner Arenal Group: Arenal

Re: [outages] Facebook/ Insta down?

https://metastatus.com/ shows "major disruptions" on a number of their services as of 10:17am.     ---Mike On 3/5/2024 10:57 AM, Chris K via Outages wrote: I can't be the first posting this ___ Outages mailing list Outages@outages.org

Re: [outages] [Outages-discussion] Facebook down.

Still down in NTX via ATT On 3/5/24 09:56, Bill Woodcock via Outages-discussion wrote: One of my staff just noticed, and I and several others just verified. The landing page is up, but authentication fails. -Bill

Outages-discussion Digest, Vol 165, Issue 2

es-discussion mailing list >> Outages-discussion@outages.org >> https://puck.nether.net/mailman/listinfo/outages-discussion >> > ___ > Outages-discussion mailing list > Outages-discussion@outages.org > https://puck.nether.net/mailman/listinfo/outages-discussion >

Re: [outages] Facebook/ Insta down?

Everyone else is using meta login and can't log in  Seriously though, DownDetector is over 600k reports. James W. Breeden Managing Partner [cid:storage_emulated_0__EmailTempImage_3_TempSignature_signature_Outlook-zwrpfok2_png_161953781] Arenal Group: Arenal Consulting Group |

Re: [outages] Facebook/ Insta down?

News sources saying so https://9to5mac.com/2024/03/05/yep-facebook-messenger-and-instagram-are-down/ https://www.independent.co.uk/tech/facebook-instagram-messenger-down-not-working-latest-b2507376.html https://www.wfla.com/news/national/facebook-instagram-down-during-outage-thousands-affected/

Re: [outages] Facebook/ Insta down?

Confirmed down in Vegas -- *Doug Roberts* d...@dougr.com 702-846-5000 (Las Vegas) 480-401-5000 (Phoenix) 212-220- (New York) 702-874-4428 (Fax) On Tue, Mar 5, 2024 at 7:58 AM Chris K via Outages wrote: > I can't be the first posting this >

Re: [outages] Facebook/ Insta down?

No, but hopefully you'll be the last. :-) Third of a million reports on down detector. They apparently screwed the pooch on authentication, somewhere early in the 10:00 EST hour. No further comments are necessary on the main list except for "it's back now", and make sure you're the first

[outages] Who broke the Internet? 2024-03-05 edition.

Down detector is showing elevated problems across Facebook/Meta properties, Google properties, T-Mobile, Discord, Tik Tok – with no obvious single cause that I have seen reported. Any ideas? Ed. ___ Outages mailing list Outages@outages.org

Outages-discussion Digest, Vol 165, Issue 1

scii" One of my staff just noticed, and I and several others just verified. The landing page is up, but authentication fails. -Bill -- next part ------ A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signatur

[outages] Facebook/ Insta down?

I can't be the first posting this ___ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages