[Wikidata-bugs] [Maniphest] T285710: WDQS lag detection required manual adjustment during DC switchover

Gehel closed subtask T288231: Deploy the wdqs streaming updater to production as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T285710 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Gehel Cc: Lucas_Werkmeister_WMDE, dcausse,

[Wikidata-bugs] [Maniphest] T285710: WDQS lag detection required manual adjustment during DC switchover

dcausse added a comment. In T285710#7443613 , @Lucas_Werkmeister_WMDE wrote: > Does that mean the periodic `updateQueryServiceLag` should be removed? Currently that’s still running on mwmaint1002. T221774

[Wikidata-bugs] [Maniphest] T285710: WDQS lag detection required manual adjustment during DC switchover

Lucas_Werkmeister_WMDE added a comment. Does that mean the periodic `updateQueryServiceLag` should be removed? Currently that’s still running on mwmaint1002. TASK DETAIL https://phabricator.wikimedia.org/T285710 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T285710: WDQS lag detection required manual adjustment during DC switchover

dcausse closed this task as "Resolved". dcausse claimed this task. dcausse added a comment. In T285710#7441835 , @Legoktm wrote: > I think this is resolved now that the streaming updater is in use everywhere?

[Wikidata-bugs] [Maniphest] T285710: WDQS lag detection required manual adjustment during DC switchover

Legoktm added a comment. I think this is resolved now that the streaming updater is in use everywhere? https://lists.wikimedia.org/hyperkitty/list/wikid...@lists.wikimedia.org/message/NXBOCI3WKTZBB6RB2GYWBBH2BFH3NBT6/ TASK DETAIL https://phabricator.wikimedia.org/T285710 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T285710: WDQS lag detection required manual adjustment during DC switchover

Legoktm removed a parent task: T287539: September 2021 Datacenter switchover (codfw -> eqiad). TASK DETAIL https://phabricator.wikimedia.org/T285710 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Legoktm Cc: dcausse, Legoktm, Gehel, Aklapper,

[Wikidata-bugs] [Maniphest] T285710: WDQS lag detection required manual adjustment during DC switchover

dcausse edited subtasks, added: T288231: Deploy the wdqs streaming updater to production; removed: T244590: [Epic] Rework the WDQS updater as an event driven application. TASK DETAIL https://phabricator.wikimedia.org/T285710 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T285710: WDQS lag detection required manual adjustment during DC switchover

dcausse added a subtask: T244590: [Epic] Rework the WDQS updater as an event driven application. TASK DETAIL https://phabricator.wikimedia.org/T285710 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: dcausse, Legoktm, Gehel, Aklapper,

[Wikidata-bugs] [Maniphest] T285710: WDQS lag detection required manual adjustment during DC switchover

Legoktm added a comment. In T285710#7262256 , @dcausse wrote: > Because none of these changes would be trivial I think we prefer to wait for the new system to be in place. Fair enough, thanks for the explanation. Could you add a

[Wikidata-bugs] [Maniphest] T285710: WDQS lag detection required manual adjustment during DC switchover

dcausse added a comment. In T285710#7261551 , @Legoktm wrote: > @Gehel what ends up consuming that value? Can we have it read the primary DC from conftool? > > For now I've documented this as a manual step:

[Wikidata-bugs] [Maniphest] T285710: WDQS lag detection required manual adjustment during DC switchover

Legoktm added a comment. @Gehel what ends up consuming that value? Can we have it read the primary DC from conftool? For now I've documented this as a manual step: https://wikitech.wikimedia.org/w/index.php?title=Switch_Datacenter=revision=1920831=1920827 TASK DETAIL

[Wikidata-bugs] [Maniphest] T285710: WDQS lag detection required manual adjustment during DC switchover

Legoktm added a parent task: T287539: September 2021 Datacenter switchover (codfw -> eqiad). TASK DETAIL https://phabricator.wikimedia.org/T285710 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Legoktm Cc: dcausse, Legoktm, Gehel, Aklapper,

[Wikidata-bugs] [Maniphest] T285710: WDQS lag detection required manual adjustment during DC switchover

Gehel added a comment. It is unlikely that the long term fix (T244590 ) will be in place for the switch back. The simple workaround (but far from ideal) is to revert https://gerrit.wikimedia.org/r/c/operations/puppet/+/701927/ during the switch

[Wikidata-bugs] [Maniphest] T285710: WDQS lag detection required manual adjustment during DC switchover

Addshore added projects: Wikidata, wdwb-tech. TASK DETAIL https://phabricator.wikimedia.org/T285710 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore Cc: dcausse, Legoktm, Gehel, Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz,

[Wikidata-bugs] [Maniphest] T285710: WDQS lag detection required manual adjustment during DC switchover

Legoktm added a project: Datacenter-Switchover. TASK DETAIL https://phabricator.wikimedia.org/T285710 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Legoktm Cc: dcausse, Legoktm, Gehel, Aklapper, MPhamWMF, CBogen, RhinosF1, Namenlos314, jijiki,

[Wikidata-bugs] [Maniphest] T285710: WDQS lag detection required manual adjustment during DC switchover

Legoktm created this task. Legoktm triaged this task as "High" priority. Legoktm added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION During today's DC switchover, the WDQS lag checking/monitoring required manual adjustment: