Agreed with Chris’ sentiment. I’m a firm believer in the blameless post-mortem particularly when paired with action items to avoid repeat occurrences, and I’d hope that others can learn from the technical issues involved.
On top of that, everyone loves a good war story :) Thanks, -C > On Mar 8, 2016, at 7:45 AM, Christopher Morrow <[email protected]> > wrote: > > Also, i'd be super awesome if there would be a pretty detailed > post-mortem document published about what happened, how it happened > and how it was discovered/repaired. > > I believe ARIN isn't the only one having these issues, so publishing > so other folk can learn would be great! > > -crhis > > On Mon, Mar 7, 2016 at 10:28 PM, <[email protected]> wrote: >> Nate, >> >> Please let us know if ARIN monitors all their zones for DNSSEC signature >> expiration. >> >> Frank >> >> -----Original Message----- >> From: [email protected] [mailto:[email protected]] On >> Behalf Of Nate Davis >> Sent: Monday, March 07, 2016 7:59 PM >> To: Michael Peddemors <[email protected]>; [email protected] >> Subject: Re: [arin-ppml] Just so it is recorded here (DNSSEC.. ) outages >> today.. >> >> Michael - thanks for reporting the issue. >> >> ARIN Engineering resolved the DNSSEC failure shortly after you reported >> the issue. They are currently looking into the cause of the failure. All >> DNSSEC functions should be operating properly at this time. >> >> Regards, >> >> Nate Davis >> Chief Operating Officer >> American Registry for Internet Numbers >> >> >> >> >> On 3/7/16, 6:14 PM, "[email protected] on behalf of Michael >> Peddemors" <[email protected] on behalf of >> [email protected]> wrote: >> >>> We had a flurry of reports from various customers, problems with reverse >>> DNS lookups.. >>> >>> Limited to the 65/8 IPv4, and from apparent reports, related to a >>> failure to update a DNSSEC signature.. >>> >>> Reported: Anyone with a DNSSEC enforced name server will have problems >>> with PTR queries for that range. >>> >>> Someone with more inside knowledge can provide more details, I am sure.. >>> >>> >>> >>> -- >>> "Catch the Magic of Linux..." >>> ------------------------------------------------------------------------ >>> Michael Peddemors, President/CEO LinuxMagic Inc. >>> Visit us at http://www.linuxmagic.com @linuxmagic >>> ------------------------------------------------------------------------ >>> A Wizard IT Company - For More Info http://www.wizard.ca >>> "LinuxMagic" a Registered TradeMark of Wizard Tower TechnoServices Ltd. >>> ------------------------------------------------------------------------ >>> 604-682-0300 Beautiful British Columbia, Canada >>> >>> This email and any electronic data contained are confidential and intended >>> solely for the use of the individual or entity to which they are >>> addressed. >>> Please note that any views or opinions presented in this email are solely >>> those of the author and are not intended to represent those of the >>> company. >>> >>> _______________________________________________ >>> PPML >>> You are receiving this message because you are subscribed to >>> the ARIN Public Policy Mailing List ([email protected]). >>> Unsubscribe or manage your mailing list subscription at: >>> http://lists.arin.net/mailman/listinfo/arin-ppml >>> Please contact [email protected] if you experience any issues. >> >> _______________________________________________ >> PPML >> You are receiving this message because you are subscribed to >> the ARIN Public Policy Mailing List ([email protected]). >> Unsubscribe or manage your mailing list subscription at: >> http://lists.arin.net/mailman/listinfo/arin-ppml >> Please contact [email protected] if you experience any issues. >> >> >> _______________________________________________ >> PPML >> You are receiving this message because you are subscribed to >> the ARIN Public Policy Mailing List ([email protected]). >> Unsubscribe or manage your mailing list subscription at: >> http://lists.arin.net/mailman/listinfo/arin-ppml >> Please contact [email protected] if you experience any issues. > _______________________________________________ > PPML > You are receiving this message because you are subscribed to > the ARIN Public Policy Mailing List ([email protected]). > Unsubscribe or manage your mailing list subscription at: > http://lists.arin.net/mailman/listinfo/arin-ppml > Please contact [email protected] if you experience any issues. > _______________________________________________ PPML You are receiving this message because you are subscribed to the ARIN Public Policy Mailing List ([email protected]). Unsubscribe or manage your mailing list subscription at: http://lists.arin.net/mailman/listinfo/arin-ppml Please contact [email protected] if you experience any issues.
