Re: [Wikitech-l] eqiad->codfw datacenter switchover, weeks of Apr 17th/May 1st

2017-05-05 Thread Pine W
Thanks for publishing the email summaries. This is one of those situations where, contrary to some our perfectionist tendencies (including mine), it's a surprise if everything goes 100% according to plan, and discovering problems through a live-fire exercise is a characteristic of a successful

Re: [Wikitech-l] eqiad->codfw datacenter switchover, weeks of Apr 17th/May 1st

2017-05-05 Thread Faidon Liambotis
Hi all, The switchback to eqiad is successfully completed as this week. The main read-only phase of the switch happend already on Wednesday at 14:30 UTC, as originally scheduled. The readonly time was approximate 13 minutes in this run (down from 17) and was more uneventful than the switchover

Re: [Wikitech-l] eqiad->codfw datacenter switchover, weeks of Apr 17th/May 1st

2017-04-19 Thread Faidon Liambotis
Hi all, The first part of this switch completed successfully today. The total time in which the projects were in read-only was approximately 17 minutes. There were a few hiccups that were or still are being dealt with, the most major ones identified so far being: - The switch to codfw in

[Wikitech-l] eqiad->codfw datacenter switchover, weeks of Apr 17th/May 1st

2017-04-07 Thread Faidon Liambotis
Hi all, You may have heard already that, like last year, we are planning to switch our active datacenter from eqiad to codfw in the week of April 17th and back to eqiad two weeks later, on the week of May 1st. We do this periodically in order to exercise our ability to run from the backup site in