[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T248449 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Gehel Cc: dcausse, Aklapper, Zbyszko, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, Lahi,

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

Maintenance_bot removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T248449 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Maintenance_bot Cc: dcausse, Aklapper, Zbyszko, CBogen, Akuckartz, darthmon_wmde,

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

gerritbot added a comment. Change 623000 **merged** by jenkins-bot: [wikidata/query/rdf@master] Report side outputs as structured data set https://gerrit.wikimedia.org/r/623000 TASK DETAIL https://phabricator.wikimedia.org/T248449 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

dcausse added a comment. Exception received while attempting a checkpoint (streaming-updater flink pipeline): Caused by: org.apache.flink.runtime.checkpoint.CheckpointException: Could not complete snapshot 2747 for operator RouteFailedOpsToSideOutput -> RDFPatchChunkOperation ->

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

dcausse moved this task from In Progress to Needs review on the Discovery-Search (Current work) board. dcausse added a comment. - Streaming updater pipeline is not failing because of recoverable errors: the sole recoverable errors I can think of now are transient failures of the various

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

dcausse added a comment. FailedOps are now queryable from spark reading a parquet file, after running one hour of backfill all errors are ENTITY_NOT_FOUND which are probably deleted entities. scala> val df_failed =

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T248449 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, gerritbot Cc: dcausse, Aklapper, Zbyszko, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz,

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

gerritbot added a comment. Change 623000 had a related patch set uploaded (by DCausse; owner: DCausse): [wikidata/query/rdf@master] Report side outputs as structured data set https://gerrit.wikimedia.org/r/623000 TASK DETAIL https://phabricator.wikimedia.org/T248449 EMAIL

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

Maintenance_bot removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T248449 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Maintenance_bot Cc: dcausse, Aklapper, Zbyszko, CBogen, Akuckartz, darthmon_wmde,

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

gerritbot added a comment. Change 622617 **merged** by jenkins-bot: [wikidata/query/rdf@master] Do not swallow errors from WikibaseRepository https://gerrit.wikimedia.org/r/622617 TASK DETAIL https://phabricator.wikimedia.org/T248449 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T248449 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, gerritbot Cc: dcausse, Aklapper, Zbyszko, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz,

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

gerritbot added a comment. Change 622617 had a related patch set uploaded (by DCausse; owner: DCausse): [wikidata/query/rdf@master] Do not swallow errors from WikibaseRepository https://gerrit.wikimedia.org/r/622617 TASK DETAIL https://phabricator.wikimedia.org/T248449 EMAIL

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

dcausse added a comment. In T248449#6411584 , @Zbyszko wrote: > In T248449#6411542 , @dcausse wrote: > >> In T248449#6382230 ,

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

Zbyszko added a comment. In T248449#6411542 , @dcausse wrote: > In T248449#6382230 , @Zbyszko wrote: > >> We need to decide our approach on possible data corruption issues as well.

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

dcausse added a comment. In T248449#6382230 , @Zbyszko wrote: > We need to decide our approach on possible data corruption issues as well. One that comes to mind is a rev create with revid higher than previouis page delete. All

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

dcausse added a comment. Removed "alerting" as I think this is too soon to tackle and should be considered when we have a sane deployment system, currently the pipeline is run manually on yarn. TASK DETAIL https://phabricator.wikimedia.org/T248449 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

dcausse updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T248449 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: dcausse, Aklapper, Zbyszko, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86,

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

dcausse claimed this task. dcausse moved this task from Ready for Development to In Progress on the Discovery-Search (Current work) board. TASK DETAIL https://phabricator.wikimedia.org/T248449 WORKBOARD https://phabricator.wikimedia.org/project/board/1227/ EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T248449 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: dcausse, Aklapper, Zbyszko, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86,

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

CBogen set the point value for this task to "8". TASK DETAIL https://phabricator.wikimedia.org/T248449 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: CBogen Cc: dcausse, Aklapper, Zbyszko, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314,

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T248449 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: dcausse, Aklapper, Zbyszko, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86,

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

TJones updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T248449 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: TJones Cc: dcausse, Aklapper, Zbyszko, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86,

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T248449 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: dcausse, Aklapper, Zbyszko, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86,

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

Zbyszko added a comment. We need to decide our approach on possible data corruption issues as well. One that comes to mind is a rev create with revid higher than previouis page delete. TASK DETAIL https://phabricator.wikimedia.org/T248449 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T248449 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: dcausse, Aklapper, Zbyszko, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86,

[Wikidata-bugs] [Maniphest] T248449: [WDQS Streaming Updater] Add error handling for Streaming Updater

Zbyszko moved this task from Scaling to Current work on the Wikidata-Query-Service board. Zbyszko added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T248449 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL PREFERENCES