Toolforge NFS services are not accessible to the VMs. Something went wrong during the upgrade and the team is working to restore services as quickly as possible.
I have shut off the bastions to protect their local disks. Brooke Storm Staff SRE Wikimedia Cloud Services [email protected] > On Apr 27, 2021, at 8:34 AM, Roy Smith <[email protected]> wrote: > > I'm getting timeouts and 502's on both https://spi-tools.toolforge.org/ > <https://spi-tools.toolforge.org/> and https://spi-tools-dev.toolforge.org/ > <https://spi-tools-dev.toolforge.org/>. Also: > > ssh: connect to host dev.tools.wmflabs.org <http://dev.tools.wmflabs.org/> > port 22: Network is unreachable > > Could the VPS work be causing this? > > >> On Apr 27, 2021, at 10:03 AM, Andrew Bogott <[email protected] >> <mailto:[email protected]>> wrote: >> >> Reminder: this is starting shortly. >> >> On 4/27/21 12:48 AM, Andrew Bogott wrote: >>> We will be upgrading the Cloud-VPS OpenStack install later today beginning >>> at 14:00 UTC (7:00 AM Pacific time). >>> >>> The total upgrade should take 60-90 minutes. During the upgrade period >>> Horizon will be disabled. There may also be brief network interruptions as >>> we restart router services. >>> >>> -Andrew + the WMCS Team >>> >>> >> >> >> _______________________________________________ >> Wikimedia Cloud Services announce mailing list >> [email protected] >> <mailto:[email protected]> (formerly >> [email protected] <mailto:[email protected]>) >> https://lists.wikimedia.org/mailman/listinfo/cloud-announce >> <https://lists.wikimedia.org/mailman/listinfo/cloud-announce> >> _______________________________________________ >> Wikimedia Cloud Services mailing list >> [email protected] (formerly [email protected]) >> https://lists.wikimedia.org/mailman/listinfo/cloud > > _______________________________________________ > Wikimedia Cloud Services mailing list > [email protected] (formerly [email protected]) > https://lists.wikimedia.org/mailman/listinfo/cloud
_______________________________________________ Wikimedia Cloud Services mailing list [email protected] (formerly [email protected]) https://lists.wikimedia.org/mailman/listinfo/cloud
