Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-05 Thread Wayne Bickerdike
t down, and > > it they the CIA down > > > > Steve > > > > -Original Message- > > From: IBM Mainframe Discussion List [mailto:IBM-MAIN@LISTSERV.UA.EDU] On > > Behalf Of Vernooij, Kees (ITOPT1) - KLM > > Sent: Friday, March 3, 2017 8:35

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-04 Thread Steve Smith
[mailto:IBM-MAIN@LISTSERV.UA.EDU] > > On Behalf Of zMan > > Sent: 03 March, 2017 15:31 > > To: IBM-MAIN@LISTSERV.UA.EDU > > Subject: Re: Check out Massive Amazon cloud service outage disrupts > > sites > > > > Cite? (Not challenging you, interested!) &g

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread Steve Beaver
@LISTSERV.UA.EDU Subject: Re: Check out Massive Amazon cloud service outage disrupts sites It was on Dutch newssites, with the text: "Amazon Web Services (AWS) announced this on Thursday". Kees. > -Original Message- > From: IBM Mainframe Discussion List [mailto:IBM-MAIN

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread Phil Smith
There's a great (though probably apocryphal) story of the Xerox STAR product being installed in directory /bin/star. Tech support is on phone with customer, they decide to whack it and start over: "Type rm dash rf slash bin slash star" "What's happening?" "It's taking a really long time..."

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread John McKown
On Fri, Mar 3, 2017 at 1:09 PM, Paul Gilmartin < 000433f07816-dmarc-requ...@listserv.ua.edu> wrote: > On Fri, 3 Mar 2017 11:19:52 -0600, John McKown wrote: > > > >> The outage was caused by a typo. > > > >​Ah, yes. The UNIX community has the legend of the system administrator > >(aka "root")

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread Lester, Bob
unix and watch the MVS syslog. :-) Happy Friday, BobL -Original Message- From: IBM Mainframe Discussion List [mailto:IBM-MAIN@LISTSERV.UA.EDU] On Behalf Of Paul Gilmartin Sent: Friday, March 03, 2017 12:09 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Check out Massive Amazon cloud

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread Tony Harminc
On 3 March 2017 at 13:51, John McKown wrote: > On Fri, Mar 3, 2017 at 12:31 PM, J R wrote: > >> Maybe a side effect of Agile / DevOps. >> >> Ah, well, time for a Scrum! >> > > Software, rugby or drink? >

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread Paul Gilmartin
On Fri, 3 Mar 2017 11:19:52 -0600, John McKown wrote: > >> The outage was caused by a typo. > >​Ah, yes. The UNIX community has the legend of the system administrator >(aka "root") who meant to remove all single character files via "rm -f ?" >who typed in "rm -f /" OOPS!​ > Can even superuser

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread John McKown
On Fri, Mar 3, 2017 at 12:31 PM, J R wrote: > Maybe a side effect of Agile / DevOps. > > Ah, well, time for a Scrum! > ​Software, rugby or drink? http://stackoverflow.com/questions/11469358/what-is-the-difference-between-scrum-and-agile-development ​

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread J R
Maybe a side effect of Agile / DevOps. Ah, well, time for a Scrum! Sent from my iPhone -- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread John McKown
On Fri, Mar 3, 2017 at 2:40 AM, Vernooij, Kees (ITOPT1) - KLM < kees.verno...@klm.com> wrote: > The outage was caused by a typo. > ​Ah, yes. The UNIX community has the legend of the system administrator (aka "root") who meant to remove all single character files via "rm -f ?" who typed in "rm -f

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread Mike Beer
When I see things like this I am always amazed how IT has changed. Acting like that in the previous century was not the way professionals worked. Of course, there was a test, development and production environment. But what really puzzled me was that billing did not work in the way they had

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread Elardus Engelbrecht
Bill Woodger wrote: >>...giving a link to this [honest] post mortem by the AWS: >>https://aws.amazon.com/message/41926/ >I'm not sure "honest" is the exact word I'd use to describe what Amazon writes >:-). This is why I put that word in those brackets because I also barely read that airplane

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread Bill Woodger
On Fri, 3 Mar 2017 09:30:11 -0600, Elardus Engelbrecht wrote: >Vernooij, Kees (ITOPT1) - KLM wrote: > ... > >...giving a link to this [honest] post mortem by the AWS: > >https://aws.amazon.com/message/41926/ > >Just a simple lame typo... ;-) > >Groete /

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread Elardus Engelbrecht
Vernooij, Kees (ITOPT1) - KLM wrote: Thanks for giving the sources. You can look at https://en.wikipedia.org/wiki/Timeline_of_Amazon_Web_Services were it says: "On March 2, AWS reveals that the outage was caused by an incorrect parameter passed in by an authorized employee while debugging

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread Vernooij, Kees (ITOPT1) - KLM
.edu> > Subject: RE: Check out Massive Amazon cloud service outage disrupts > sites > > Since I can't find any other references, the full translation of the > Dutch article is: > > Seattle- > a simple typing error was the cause of the global failure Tuesday on the &g

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread Blake, Daniel J [CTR]
sion List > > [mailto:IBM-MAIN@LISTSERV.UA.EDU] > On > > Behalf Of zMan > > Sent: 03 March, 2017 15:31 > > To: IBM-MAIN@LISTSERV.UA.EDU > > Subject: Re: Check out Massive Amazon cloud service outage disrupts > > sites > > > > Cite? (Not challenging y

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread Vernooij, Kees (ITOPT1) - KLM
the failure. Eventually the problem lasted four hours. Kees. > -Original Message- > From: Vernooij, Kees (ITOPT1) - KLM > Sent: 03 March, 2017 15:35 > To: 'IBM Mainframe Discussion List' <IBM-MAIN@LISTSERV.UA.EDU> > Subject: RE: Check out Massive Amazon cloud service ou

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread Vernooij, Kees (ITOPT1) - KLM
LISTSERV.UA.EDU > Subject: Re: Check out Massive Amazon cloud service outage disrupts > sites > > Cite? (Not challenging you, interested!) > > On Fri, Mar 3, 2017 at 3:40 AM, Vernooij, Kees (ITOPT1) - KLM < > kees.verno...@klm.com> wrote: > > > The outage

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread zMan
id silly errors in the production environment... > > Kees. > > > -Original Message- > > From: IBM Mainframe Discussion List [mailto:IBM-MAIN@LISTSERV.UA.EDU] On > > Behalf Of Edward Finnell > > Sent: 28 February, 2017 23:47 > > To: IBM-MAIN@LISTSERV.UA.EDU >

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-03 Thread Vernooij, Kees (ITOPT1) - KLM
t; Behalf Of Edward Finnell > Sent: 28 February, 2017 23:47 > To: IBM-MAIN@LISTSERV.UA.EDU > Subject: Check out Massive Amazon cloud service outage disrupts sites > > _Massive Amazon cloud service outage disrupts sites_ > (http://www.usatoday.com/story/tech/news/2017/02/28/amazons

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-02 Thread Anne & Lynn Wheeler
es were starting to shift to human error, software bugs, > and environmental (power, acts of nature, etc) ... copy of summary from > that study > http://www.garlic.com/~lynn/grayft84.pdf re: http://www.garlic.com/~lynn/2017c.html#13 Check out Massive Amazon cloud service o

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-01 Thread Anne & Lynn Wheeler
charl...@mcn.org (Charles Mills) writes: > It is hard to prepare for unknown unknowns. It is legendary that people have > had recovery failures because the fallover switch (channel, power, network, > whatever) failed. re: http://www.garlic.com/~lynn/2017c.html#13 Check out Massive Ama

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-01 Thread Edward Gould
> On Mar 1, 2017, at 11:40 AM, Barry Merrill wrote: > > John Deere's data center in the 70s had multiple AC providers but still had > Midwest lightning > induced outages, but the data center manager was unsuccessful in installing a > diesel backup > system because the only UPS

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-01 Thread Charles Mills
& Lynn Wheeler Sent: Wednesday, March 1, 2017 9:47 AM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Check out Massive Amazon cloud service outage disrupts sites jesse1.robin...@sce.com (Jesse 1 Robinson) writes: > Our data center folks insist on dual power feeds for everything, >

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-01 Thread Anne & Lynn Wheeler
jesse1.robin...@sce.com (Jesse 1 Robinson) writes: > Our data center folks insist on dual power feeds for everything, > sometimes infuriatingly so. To test power redundancy, they > occasionally drop one power feed or the other--with ample heads > up--and check that all devices are functioning.

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-01 Thread Barry Merrill
-Original Message- From: IBM Mainframe Discussion List [mailto:IBM-MAIN@LISTSERV.UA.EDU] On Behalf Of Jesse 1 Robinson Sent: Wednesday, March 1, 2017 11:25 AM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Check out Massive Amazon cloud service outage disrupts sites I heard about a major electric

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-01 Thread David W Noon
On Wed, 1 Mar 2017 09:02:47 -0800, Charles Mills (charl...@mcn.org) wrote about "Re: Check out Massive Amazon cloud service outage disrupts sites" (in <04c101d292ad$a751f750$f5f5e5f0$@mcn.org>): [snip] > Up here in northern CA we used to joke that PG's company song &g

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-01 Thread Jesse 1 Robinson
ISTSERV.UA.EDU] On Behalf Of Jesse 1 Robinson Sent: Wednesday, March 1, 2017 8:27 AM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Check out Massive Amazon cloud service outage disrupts sites Our data center folks insist on dual power feeds for everything, sometimes infuriatingly so. To test po

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-01 Thread Charles Mills
half Of Jesse 1 Robinson Sent: Wednesday, March 1, 2017 8:27 AM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Check out Massive Amazon cloud service outage disrupts sites Our data center folks insist on dual power feeds for everything, sometimes infuriatingly so. To test power redundancy, they occ

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-01 Thread Jesse 1 Robinson
-Original Message- From: IBM Mainframe Discussion List [mailto:IBM-MAIN@LISTSERV.UA.EDU] On Behalf Of Mike Beer Sent: Wednesday, March 01, 2017 5:45 AM To: IBM-MAIN@LISTSERV.UA.EDU Subject: (External):Re: Check out Massive Amazon cloud service outage disrupts sites ​>Ah, probably happe

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-01 Thread Mike Beer
​>Ah, probably happened when the floor maintenance technician (janitor inold-speak) repurposed a electrical outlet.​ Usually large datacenters test their emergency procedures (at least once a year) - unfortunately the redundant power supply does not always work. And some servers might not

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-03-01 Thread John McKown
On Tue, Feb 28, 2017 at 5:52 PM, Edward Finnell < 000248cce9f3-dmarc-requ...@listserv.ua.edu> wrote: > The notice says check the Dashboard for updates. They seem to have one or > two of these a year. So far they've been pretty tight lipped about it. > > ​Ah, probably happened when the floor

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-02-28 Thread Paul Gilmartin
On Tue, 28 Feb 2017 17:46:46 -0500, Edward Finnell wrote: >_Massive Amazon cloud service outage disrupts sites_ >(http://www.usatoday.com/story/tech/news/2017/02/28/amazons-cloud-service-goes-down-sites-scramble >/98530914/) > >Wondered why traffic was a little off. > That URL is broken by

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-02-28 Thread Lester, Bob
uld be bad. More to come, I'm sure! -Original Message- From: IBM Mainframe Discussion List [mailto:IBM-MAIN@LISTSERV.UA.EDU] On Behalf Of Edward Finnell Sent: Tuesday, February 28, 2017 4:52 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Check out Massive Amazon cloud service outage disr

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-02-28 Thread Edward Finnell
The notice says check the Dashboard for updates. They seem to have one or two of these a year. So far they've been pretty tight lipped about it. In a message dated 2/28/2017 5:35:37 P.M. Central Standard Time, bles...@ofiglobal.com writes: I'm doing an AWS class and was online fiddling

Re: Check out Massive Amazon cloud service outage disrupts sites

2017-02-28 Thread Lester, Bob
to see what we learn going forward. Thanks! BobL -Original Message- From: IBM Mainframe Discussion List [mailto:IBM-MAIN@LISTSERV.UA.EDU] On Behalf Of Edward Finnell Sent: Tuesday, February 28, 2017 3:47 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Check out Massive Amazon cloud service outage

Check out Massive Amazon cloud service outage disrupts sites

2017-02-28 Thread Edward Finnell
_Massive Amazon cloud service outage disrupts sites_ (http://www.usatoday.com/story/tech/news/2017/02/28/amazons-cloud-service-goes-down-sites-scramble /98530914/) Wondered why traffic was a little off. -- For IBM-MAIN