Re: [lopsa-tech] Amazon AWS becoming unreliable

2014-09-26 Thread Tom Perrine
All the patching aside, the network (and some of the server hardware) within the AWS East zones has been. brittle, for at least 1-2 years. We have pinger hosts in all our datacenters, and in every AZ where we have instances. This info is mostly from an internal study we did last year, so may

Re: [lopsa-tech] Amazon AWS becoming unreliable

2014-09-26 Thread Bill Bogstad
On Fri, Sep 26, 2014 at 1:24 PM, Derek Balling wrote: > On Sep 26, 2014, at 7:22 AM, Sean Lally wrote: > > Haven't seen that, but they are doing a bunch of scheduled reboots that > started yesterday. Guessing they're patching for bash... > > > The reboots started before bash. The current running

Re: [lopsa-tech] Amazon AWS becoming unreliable

2014-09-26 Thread Sean Lally
Good point about them starting before bash. Fewer of ours were rebooted before though... On Fri, Sep 26, 2014 at 7:24 AM, Derek Balling wrote: > On Sep 26, 2014, at 7:22 AM, Sean Lally wrote: > > Haven't seen that, but they are doing a bunch of scheduled reboots that > started yesterday. Gues

Re: [lopsa-tech] Amazon AWS becoming unreliable

2014-09-26 Thread Derek Balling
On Sep 26, 2014, at 7:22 AM, Sean Lally wrote: > Haven't seen that, but they are doing a bunch of scheduled reboots that > started yesterday. Guessing they're patching for bash... The reboots started before bash. The current running-theory is there's a bug in Xen that allows a guest to pierce

Re: [lopsa-tech] Amazon AWS becoming unreliable

2014-09-26 Thread Sean Lally
Haven't seen that, but they are doing a bunch of scheduled reboots that started yesterday. Guessing they're patching for bash... On Fri, Sep 26, 2014 at 7:15 AM, Edward Ned Harvey (lopser) < lop...@nedharvey.com> wrote: > Has anyone else noticed Amazon AWS becoming less and less reliable in > t

[lopsa-tech] Amazon AWS becoming unreliable

2014-09-26 Thread Edward Ned Harvey (lopser)
Has anyone else noticed Amazon AWS becoming less and less reliable in the last several months? It is getting really annoying to me. There are many things I've observed, but this is the easiest one to talk about: We have a zabbix server hosted in amazon, monitoring all the other systems in ama