I've seen too many presumably too big to fail companies fail like this. Sure, we're speculating here. Were I the state/legislature I would be very interested in a detailed analysis of the failure and how to prevent said failure in the future. As it is a state government, all of that should be an open record or available via a FOIA. I think we COULD know, we just may be buried in a mountain of paper and exhorbitant fees if we want to know.
On Fri, Aug 27, 2010 at 2:45 PM, Sean Martin <[email protected]> wrote: > Understood, but planning for every possible disaster could be an infinite > chore. > > As I understand it, a memory chip failed. What underlying problems that > caused weren't explained, but it did prompt them to failover their SAN (at > some level) and that process started throwing errors. > > One would assume that 2.4 Billion Dollars a year to Northrop Grumman would > include failover testing of such a major system, but we don't have that > information. Were past DR tests successful? Had something changed between > this failure and the last test to cause the failure? Did the hardware issue > with the primary system somehow affect failover capabilities? > > It'd be nice to have those details but we'll probably never know. > > - Sean > > On Fri, Aug 27, 2010 at 10:37 AM, Jonathan Link <[email protected] > > wrote: > >> Invariably, disasters can be planned for. A corner was cut because it >> was deemd too expensive, and the implications to the rest of the system >> weren't studied. >> >> For example, the LED streelight fiasco. They're cheap, they're green, and >> when you get snow, they won't melt it so you can't tell if the light is red >> or green. I'm complaining about this, because the city where I work has >> been installing them at some of the busiest intersections. And we do get >> enough snow that it will be a problem. >> >> >> >> On Fri, Aug 27, 2010 at 2:34 PM, Sean Martin <[email protected]>wrote: >> >>> The article obvious lacking in detail. I would imagine North Grumman >>> is going to get some very bad PR from this even if it ends up being a fluke >>> failure that really couldn't be planned for. >>> >>> - Sean >>> >>> On Fri, Aug 27, 2010 at 10:24 AM, Jonathan Link < >>> [email protected]> wrote: >>> >>>> It doesn't appear to be something that was well designed for >>>> fault-tolerance. A memory card failure brought down their SAN. And I >>>> envision this being a true SAN, Storage Area Network, with many storage >>>> appliances, segregated from the main production network. >>>> >>>> Maybe that wasn't part of the design spec of SLA from the vendor, >>>> though... >>>> >>>> On Fri, Aug 27, 2010 at 2:17 PM, Sean Martin >>>> <[email protected]>wrote: >>>> >>>>> >>>>> http://hamptonroads.com.nyud.net/2010/08/massive-computer-outage-halts-some-va-agencies >>>>> >>>>> I'm really curious to know what SAN hardware they're using.... >>>>> >>>>> - Sean >>>>> >>>>> ~ Finally, powerful endpoint security that ISN'T a resource hog! ~ >>>>> ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/> ~ >>>>> >>>>> >>>>> --- >>>>> You are currently subscribed to ntsysadmin as: [email protected] >>>>> . >>>>> To unsubscribe click here: >>>>> http://lyris.sunbelt-software.com/u?id=8080758.f0f37eba7f9db04d7598d052fc37ba1c&n=T&l=ntsysadmin&o=9076928 >>>>> >>>>> (It may be necessary to cut and paste the above URL if the line is >>>>> broken) >>>>> or send a blank email to >>>>> leave-9076928-8080758.f0f37eba7f9db04d7598d052fc37b...@lyris.sunbelt-software.com >>>>> >>>>> >>>> ~ Finally, powerful endpoint security that ISN'T a resource hog! ~ >>>> ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/> ~ >>>> >>>> >>>> --- >>>> You are currently subscribed to ntsysadmin as: [email protected]. >>>> To unsubscribe click here: >>>> http://lyris.sunbelt-software.com/u?id=7432680.6e6595761ad36f434042683031b94018&n=T&l=ntsysadmin&o=9076937 >>>> >>>> (It may be necessary to cut and paste the above URL if the line is >>>> broken) >>>> or send a blank email to >>>> leave-9076937-7432680.6e6595761ad36f434042683031b94...@lyris.sunbelt-software.com >>>> >>>> >>> ~ Finally, powerful endpoint security that ISN'T a resource hog! ~ >>> ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/> ~ >>> >>> >>> --- >>> You are currently subscribed to ntsysadmin as: [email protected]. >>> To unsubscribe click here: >>> http://lyris.sunbelt-software.com/u?id=8080758.f0f37eba7f9db04d7598d052fc37ba1c&n=T&l=ntsysadmin&o=9076946 >>> >>> (It may be necessary to cut and paste the above URL if the line is >>> broken) >>> or send a blank email to >>> leave-9076946-8080758.f0f37eba7f9db04d7598d052fc37b...@lyris.sunbelt-software.com >>> >>> >> ~ Finally, powerful endpoint security that ISN'T a resource hog! ~ >> ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/> ~ >> >> >> --- >> You are currently subscribed to ntsysadmin as: [email protected]. >> To unsubscribe click here: >> http://lyris.sunbelt-software.com/u?id=7432680.6e6595761ad36f434042683031b94018&n=T&l=ntsysadmin&o=9076949 >> >> (It may be necessary to cut and paste the above URL if the line is broken) >> or send a blank email to >> leave-9076949-7432680.6e6595761ad36f434042683031b94...@lyris.sunbelt-software.com >> >> > ~ Finally, powerful endpoint security that ISN'T a resource hog! ~ > ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/> ~ > > > --- > You are currently subscribed to ntsysadmin as: [email protected]. > To unsubscribe click here: > http://lyris.sunbelt-software.com/u?id=8080758.f0f37eba7f9db04d7598d052fc37ba1c&n=T&l=ntsysadmin&o=9076961 > > (It may be necessary to cut and paste the above URL if the line is broken) > or send a blank email to > leave-9076961-8080758.f0f37eba7f9db04d7598d052fc37b...@lyris.sunbelt-software.com > > ~ Finally, powerful endpoint security that ISN'T a resource hog! ~ ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/> ~ --- You are currently subscribed to ntsysadmin as: [email protected]. To unsubscribe click here: http://lyris.sunbelt-software.com/u?id=8142875.a9cf90b99baa17cb4fcf8293a59eb3b1&n=T&l=ntsysadmin&o=9076964 or send a blank email to leave-9076964-8142875.a9cf90b99baa17cb4fcf8293a59eb...@lyris.sunbelt-software.com
