[Wikidata-bugs] [Maniphest] T267029: The streaming-updater-producer should handle backfills gracefully

2020-12-14 Thread Gehel
Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T267029 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Gehel Cc: dcausse, Aklapper, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86,

[Wikidata-bugs] [Maniphest] T267029: The streaming-updater-producer should handle backfills gracefully

2020-11-27 Thread Maintenance_bot
Maintenance_bot removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T267029 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Maintenance_bot Cc: dcausse, Aklapper, CBogen, Akuckartz, Nandana, Namenlos314, Lahi,

[Wikidata-bugs] [Maniphest] T267029: The streaming-updater-producer should handle backfills gracefully

2020-11-27 Thread gerritbot
gerritbot added a comment. Change 642077 **merged** by jenkins-bot: [wikidata/query/rdf@master] Unify re-ordering and decide mutation operation https://gerrit.wikimedia.org/r/642077 TASK DETAIL https://phabricator.wikimedia.org/T267029 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T267029: The streaming-updater-producer should handle backfills gracefully

2020-11-23 Thread dcausse
dcausse added a comment. There were no new inconsistent events found in the past two days. TASK DETAIL https://phabricator.wikimedia.org/T267029 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: dcausse, Aklapper, Alter-paule,

[Wikidata-bugs] [Maniphest] T267029: The streaming-updater-producer should handle backfills gracefully

2020-11-20 Thread dcausse
dcausse moved this task from In Progress to Needs review on the Discovery-Search (Current work) board. dcausse added a comment. The new approach seems to work. - Backfill period: `2020-11-06T23:00:01` -> `2020-11-20T13:40:00` - Dump reconciliation: `2020-11-06T23:00:01` ->

[Wikidata-bugs] [Maniphest] T267029: The streaming-updater-producer should handle backfills gracefully

2020-11-19 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T267029 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, gerritbot Cc: dcausse, Aklapper, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696,

[Wikidata-bugs] [Maniphest] T267029: The streaming-updater-producer should handle backfills gracefully

2020-11-19 Thread gerritbot
gerritbot added a comment. Change 642077 had a related patch set uploaded (by DCausse; owner: DCausse): [wikidata/query/rdf@master] Unify re-ordering and decide mutation operation https://gerrit.wikimedia.org/r/642077 TASK DETAIL https://phabricator.wikimedia.org/T267029 EMAIL

[Wikidata-bugs] [Maniphest] T267029: The streaming-updater-producer should handle backfills gracefully

2020-11-19 Thread dcausse
dcausse updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T267029 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: dcausse, Aklapper, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE,

[Wikidata-bugs] [Maniphest] T267029: The streaming-updater-producer should handle backfills gracefully

2020-11-19 Thread dcausse
dcausse added a comment. After a test run it seems that we are able to backfill, unfortunately we skip a non negligible number of revision: ++---+---+---+---+---+---+-+ |y |m |d |h |inconsistency |status |event_type |count|

[Wikidata-bugs] [Maniphest] T267029: The streaming-updater-producer should handle backfills gracefully

2020-11-18 Thread Maintenance_bot
Maintenance_bot removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T267029 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Maintenance_bot Cc: dcausse, Aklapper, CBogen, Akuckartz, Nandana, Namenlos314, Lahi,

[Wikidata-bugs] [Maniphest] T267029: The streaming-updater-producer should handle backfills gracefully

2020-11-18 Thread gerritbot
gerritbot added a comment. Change 640444 **merged** by jenkins-bot: [wikidata/query/rdf@master] Add support for partial re-ordering https://gerrit.wikimedia.org/r/640444 TASK DETAIL https://phabricator.wikimedia.org/T267029 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T267029: The streaming-updater-producer should handle backfills gracefully

2020-11-17 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T267029 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, gerritbot Cc: dcausse, Aklapper, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696,

[Wikidata-bugs] [Maniphest] T267029: The streaming-updater-producer should handle backfills gracefully

2020-11-17 Thread gerritbot
gerritbot added a comment. Change 640444 had a related patch set uploaded (by DCausse; owner: DCausse): [wikidata/query/rdf@master] Add support for partial re-ordering https://gerrit.wikimedia.org/r/640444 TASK DETAIL https://phabricator.wikimedia.org/T267029 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T267029: The streaming-updater-producer should handle backfills gracefully

2020-11-17 Thread dcausse
dcausse renamed this task from "Tune the streaming-updater-producer to limit late events" to "The streaming-updater-producer should handle backfills gracefully". dcausse updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T267029 EMAIL PREFERENCES