[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-07-07 Thread dcausse
dcausse added a subtask: T257325: Upgrade to flink 1.11. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: revi, Mholloway, Ladsgroup, Multichill, darthmon_wmde, Iamamz3, Smalyshev,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-07-02 Thread dcausse
dcausse added a subtask: T256949: The streaming updater should support suppressed deletes. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: revi, Mholloway, Ladsgroup, Multichill,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-07-02 Thread dcausse
dcausse added a subtask: T256946: Add a custom watermark generator that supports low rate streams. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: revi, Mholloway, Ladsgroup,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-07-01 Thread Bugreporter
Bugreporter added a subtask: T105427: Need a way for WDQS updater to become aware of suppressed deletes. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Bugreporter Cc: revi, Mholloway,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-07-01 Thread dcausse
dcausse added a subtask: T256882: The streaming updater should support page undeletes. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: revi, Mholloway, Ladsgroup, Multichill,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-07-01 Thread dcausse
dcausse added a subtask: T256875: The streaming updater should support page deletions. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: revi, Mholloway, Ladsgroup, Multichill,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-06-15 Thread dcausse
dcausse added a subtask: T255399: Prepare wdqs1009 to run the streaming updater . TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: revi, Mholloway, Ladsgroup, Multichill,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-05-27 Thread dcausse
dcausse added a subtask: T253753: Increase retention for mediawiki.revision-create on the kafka jumbo cluster. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: revi, Mholloway,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-04-28 Thread dcausse
dcausse added a subtask: T251275: Add a new updater component to update blazegraph based on the content present in the streaming updater output kafka stream. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-04-28 Thread dcausse
dcausse added a subtask: T251270: The streaming updater should produce its events to kafka. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: revi, Mholloway, Ladsgroup, Multichill,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-04-27 Thread Zbyszko
Zbyszko added a subtask: T251096: [WDQS Streaming Updater] Organise module structure. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: revi, Mholloway, Ladsgroup, Multichill,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-04-20 Thread dcausse
dcausse removed a subtask: T243603: Create a way to deploy WDQS artifacts to Archiva with Jenkins. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: revi, Mholloway, Ladsgroup,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-04-20 Thread Gehel
Gehel added a subtask: T248451: [WDQS Streaming Updater] Custom parallelism configuration for Streaming Updater. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: revi, Mholloway,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-04-20 Thread Gehel
Gehel added a subtask: T243603: Create a way to deploy WDQS artifacts to Archiva with Jenkins. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: revi, Mholloway, Ladsgroup, Multichill,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-04-20 Thread Gehel
Gehel added a subtask: T248450: [WDQS Streaming Updater] Monitor Streaming Updater - metrics . TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: revi, Mholloway, Ladsgroup, Multichill,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-04-20 Thread Gehel
Gehel added a subtask: T249500: [WDQS Streaming Updater] Reuse WikibaseRepository. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: revi, Mholloway, Ladsgroup, Multichill, darthmon_wmde,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-04-20 Thread Gehel
Gehel added a subtask: T249097: [WDQS Streaming Updater] Fix pipeline checkpointing. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: revi, Mholloway, Ladsgroup, Multichill,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-04-20 Thread Gehel
Gehel added a subtask: T248452: [WDQS Streaming Updater] Deploy and configure Streaming Updater Hadoop YARN. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: revi, Mholloway, Ladsgroup,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-04-20 Thread Gehel
Gehel added a subtask: T249099: [WDQS Streaming Updater] Error during munging process. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: revi, Mholloway, Ladsgroup, Multichill,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-04-20 Thread Gehel
Gehel added a subtask: T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: revi, Mholloway, Ladsgroup,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-04-20 Thread Gehel
Gehel added a subtask: T248464: [WDQS Streaming Updater] Implement ouput format in Streaming Updater. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: revi, Mholloway, Ladsgroup,

[Wikidata-bugs] [Maniphest] [Updated] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-04-08 Thread Gehel
Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Ladsgroup, Multichill, darthmon_wmde, Iamamz3, Smalyshev, Ottomata, JAllemandou,