We ran into issues with the cookbook / cumin before Gerrit instances were switched over. All the changes have now been reverted and we'll try again after investigating.
On Mon, Oct 6, 2025 at 1:53 PM Arnaud Bran <[email protected]> wrote: > Hello, > > small reminder: we'll start in a few minutes > > Thank you for your understanding > > On Mon, Sep 29, 2025 at 3:48 PM Arnaud Bran <[email protected]> wrote: > >> Hello, >> >> We will perform maintenance on Gerrit on *Monday, October 6*, from *12:00 >> to 13:00 UTC*. >> During this window, we expect a *~20 minutes* write outage while we >> switch over Gerrit's service from the current primary (gerrit1003) to the >> spare host (gerrit2003). >> Since last time, we've added a few guardrails: >> >> - >> >> Local emergency backup on each instance. >> - >> >> All instances will be *read-only during the switchover *to protect >> data integrity. >> - >> >> Pre- and post-switch checks to verify everything is in the expected >> state. >> >> As before, we’ll perform the switchover *live with Release Engineering*. >> >> This operation will allow us to unblock a few things: >> >> - >> >> System daemon user: *gerrit2 → gerrit (*T338470 >> <https://phabricator.wikimedia.org/T338470>) >> - >> >> *OS upgrade* (T392464 <https://phabricator.wikimedia.org/T392464>, >> T384595 <https://phabricator.wikimedia.org/T384595>)*, Java* (T392465 >> <https://phabricator.wikimedia.org/T392465>) version update and *Gerrit >> *(T379714 <https://phabricator.wikimedia.org/T379714>, T392448 >> <https://phabricator.wikimedia.org/T392448>) version update >> >> *Expected impact* >> >> - >> >> A ~20 minutes *read-only* window; reads (browsing, cloning, >> reviewing) should remain fine. Pushes, votes, comments, etc. will be >> blocked during that period >> - >> >> We’ll post start/end updates during the window. >> >> *Links* >> >> - >> >> Documentation: >> https://wikitech.wikimedia.org/wiki/Gerrit/Operations#Switch_over >> - >> >> Phabricator: https://phabricator.wikimedia.org/T387833 >> - >> >> Deployment Calendar: >> >> https://wikitech.wikimedia.org/wiki/Deployments#deploycal-item-20251006T1200 >> >> >> Thank you for your understanding. >> >> -- >> *Arnaud Bran* (he/him) >> Senior Site Reliability Engineer >> Wikimedia Foundation <https://wikimediafoundation.org/> >> > _______________________________________________ > Wikitech-l mailing list -- [email protected] > To unsubscribe send an email to [email protected] > https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/ -- Lukasz
_______________________________________________ Wikitech-l mailing list -- [email protected] To unsubscribe send an email to [email protected] https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
