Re: Austin Colo Offline
The Austin Colo (and DeveloperCloud) should be back online now. Our main router had a fan that failed. Despite the other 3 working fine, I had to steal one from another server to get it running. I had to steal a fan from the server handling all serial console connections to r1-a* servers. So those will be unavailable while I get the part next-day-mailed. On 15 November 2016 at 10:14, Andy Doan wrote: > Its down again. Sorry for troubles. > > On 15 November 2016 at 10:02, Andy Doan wrote: >> Everything should be back online now. The team is now going to comb >> over logs to understand how this happened. >> >> On 14 November 2016 at 23:28, Andy Doan wrote: >>> The Austin colo router has become unreachable and everything behind it is >>> offline. I'll be heading there in my Tuesday morning to debug. ___ linaro-dev mailing list linaro-dev@lists.linaro.org https://lists.linaro.org/mailman/listinfo/linaro-dev
Re: Austin Colo Offline
Its down again. Sorry for troubles. On 15 November 2016 at 10:02, Andy Doan wrote: > Everything should be back online now. The team is now going to comb > over logs to understand how this happened. > > On 14 November 2016 at 23:28, Andy Doan wrote: >> The Austin colo router has become unreachable and everything behind it is >> offline. I'll be heading there in my Tuesday morning to debug. ___ linaro-dev mailing list linaro-dev@lists.linaro.org https://lists.linaro.org/mailman/listinfo/linaro-dev
Re: Austin Colo Offline
Everything should be back online now. The team is now going to comb over logs to understand how this happened. On 14 November 2016 at 23:28, Andy Doan wrote: > The Austin colo router has become unreachable and everything behind it is > offline. I'll be heading there in my Tuesday morning to debug. ___ linaro-dev mailing list linaro-dev@lists.linaro.org https://lists.linaro.org/mailman/listinfo/linaro-dev
Re: Austin colo offline?
On 17 September 2016 at 19:16, Andy Doan wrote: > The collocation facility hosting our servers suffered a major HVAC > failure. To compound matters, their monitoring network failed to notice > and temperatures got pretty hot for about 3 rows of racks (of which we > were one). Ouch! Mr. Robot strikes again? > At this point, I think everything is back online but please let me know > if something isn't working properly. From what I can tell our servers > never got too hot or crashed (uptime seems to confirm this). It seems > like an upstream switch may have overheated and shut down. All good on our side, thanks! --renato ___ linaro-dev mailing list linaro-dev@lists.linaro.org https://lists.linaro.org/mailman/listinfo/linaro-dev
Re: Austin colo offline?
The collocation facility hosting our servers suffered a major HVAC failure. To compound matters, their monitoring network failed to notice and temperatures got pretty hot for about 3 rows of racks (of which we were one). At this point, I think everything is back online but please let me know if something isn't working properly. From what I can tell our servers never got too hot or crashed (uptime seems to confirm this). It seems like an upstream switch may have overheated and shut down. On 09/17/2016 10:48 AM, Renato Golin wrote: > Hi, > > Is the Austin colo offline? Did I miss some scheduled maintenance? > > I can't access aus-colo.linaro.org and all our public buildbots are down: > > http://lab.llvm.org:8011/builders/clang-cmake-aarch64-quick > > http://lab.llvm.org:8011/builders/clang-cmake-aarch64-full > > http://lab.llvm.org:8011/builders/clang-cmake-aarch64-42vma > > Let me know if I'm missing something, or when it comes back. > > Thanks! > --renato > ___ linaro-dev mailing list linaro-dev@lists.linaro.org https://lists.linaro.org/mailman/listinfo/linaro-dev
