[Wikidata-bugs] [Maniphest] T271412: Investigate an alert on statements volume in Blazegraph instances

2021-01-11 Thread CBogen
CBogen triaged this task as "Medium" priority.
CBogen moved this task from All WDQS-related tasks to Operations on the 
Wikidata-Query-Service board.

TASK DETAIL
  https://phabricator.wikimedia.org/T271412

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: CBogen
Cc: Aklapper, Zbyszko, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T271412: Investigate an alert on statements volume in Blazegraph instances

2021-01-11 Thread RKemper
RKemper updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T271412

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Aklapper, Zbyszko, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] T271412: Investigate an alert on statements volume in Blazegraph instances

2021-01-07 Thread Zbyszko
Zbyszko created this task.
Zbyszko added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  As a WDQS maintainer I want to verify if it's possible to create an alert 
that would trigger on incorrect number of statements in any Blazegraph 
instance, so that I can react and remedy the issue.
  
  Currently we rely for too much on user input when it comes to potential 
inconsistencies in Blazegraph (by which we mean meaningful differences between 
WD and WDQS). New Streaming Updater should remedy some issues we have with the 
current updater, but it would be good to be able to now early if the data is 
corrupt or incomplete. 
  Idea is to create alert that would periodically compare the number of 
statements in Wikidata and any given Blazegraph statement. The main difficult  
(which may be in fact a blocking one) is to come up with a threshold that make 
sense. These numbers do not match on purpose - due to intentionally dropped 
statements, shared ones, etc.
  
  AC:
  
  - Proposal for an algorithm of calculating the threshold, or
  - explanation why it doesn't make sense to calculate one.

TASK DETAIL
  https://phabricator.wikimedia.org/T271412

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Zbyszko
Cc: Aklapper, Zbyszko, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs