Hi Robby,

Yes, both were in us-central-1a.

That's a shame your notification didn't make it - but at least that 
resolves our root cause.
Will you release the details of why/how the latency caused the clusters to 
be unavailable?

>From our side we added more granular monitoring alerts so we can respond in 
a more timely fashion to meet our 'response times' - obviously without it 
making to the dashboard makes it hard for us to know anything more. :)

Thanks for the help.

On Wednesday, June 29, 2016 at 1:27:29 PM UTC-4, Robert Bailey wrote:
>
> Hi Kevin,
>
> The 'latency on ssd' incident last night had a serious impact on all GKE 
> clusters running in the us-central1-a zone. Most, if not all, clusters 
> experienced an outage during the duration of the compute incident (~2 
> hours) and some were unavailable for a few hours longer. 
>
> Were both of your clusters in us-central1-a?
>
> I notified the cloud support folks last night that the incident affected 
> GKE, but apparently that fact didn't make it onto the cloud status 
> dashboard. 
>
> Robby
>
>
>
> On Wed, Jun 29, 2016 at 9:43 AM, Kevin Griffin <[email protected] 
> <javascript:>> wrote:
>
>> Hi,
>>
>> I am trying to find the best place to get support for an issue we have 
>> had with two of our Google Container Engine clusters (both running Node 
>> version 1.1.6) which last night failed at 10:56 pm (EST) / 11:07 pm (EST) 
>> and 
>> failed to restart cleanly.
>>
>> The only reported issue from Google last night has 'investigating latency 
>> on ssd' which seems unrelated, we'd obviously like to get to the root cause 
>> of why both clusters went down, logs are of no real use, they show the 
>> Health Checks, then they just stop. Next logs are from us restarting the 
>> cluster and upgrading to Node Version 1.2.4.
>>
>> Is there another source of logs perhaps we are not looking at?
>>
>> Is this only source of 'bronze' support?
>>
>> Any help/clarification is appreciated.
>>
>> (Apologies if you're re-reading this I originally had it posted in 
>> gc-discussion)
>>
>> Regards,
>>
>> -- 
>> You received this message because you are subscribed to the Google Groups 
>> "Containers at Google" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to [email protected] <javascript:>.
>> To post to this group, send email to [email protected] 
>> <javascript:>.
>> Visit this group at https://groups.google.com/group/google-containers.
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Containers at Google" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/google-containers.
For more options, visit https://groups.google.com/d/optout.

Reply via email to