[Wikidata-bugs] [Maniphest] T267924: WDQS Updater (based on recent changes) missed some updates

[Gehel]

Gehel added a parent task: T267927: Reload wikidata journal from fresh dumps.

TASK DETAIL
  https://phabricator.wikimedia.org/T267924

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Aklapper, dcausse, MPhamWMF, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T267924: WDQS Updater (based on recent changes) missed some updates

[dcausse]

dcausse closed this task as a duplicate of T267175: SPARQL-Query shows entries, 
which should be filter out; number of entries in result set might change when 
executed repeatedly (possible caching/indexing problem).

TASK DETAIL
  https://phabricator.wikimedia.org/T267924

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse
Cc: Gehel, Aklapper, dcausse, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T267924: WDQS Updater (based on recent changes) missed some updates

[Gehel]

Gehel triaged this task as "Low" priority.

TASK DETAIL
  https://phabricator.wikimedia.org/T267924

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Aklapper, dcausse, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T267924: WDQS Updater (based on recent changes) missed some updates

[Gehel]

Gehel moved this task from All WDQS-related tasks to Tech Debt on the 
Wikidata-Query-Service board.
Gehel added a comment.


  The data reload in T267927  will 
fix the actual issue. We are not going to fix the current updater, our focus is 
on migrating to a streaming updater instead.

TASK DETAIL
  https://phabricator.wikimedia.org/T267924

WORKBOARD
  https://phabricator.wikimedia.org/project/board/891/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Gehel
Cc: Gehel, Aklapper, dcausse, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, 
Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T267924: WDQS Updater (based on recent changes) missed some updates

[dcausse]

dcausse created this task.
dcausse added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  As a wdqs user I want all updates made to wikidata visible in the query 
service so that I query data that is not //stale//.
  
  It appears that some updates on **some servers** were missed:
  
  - Q30347341 revision 1290839021 at 2020-10-13T13:03:18
  - Q30347351 revision 1290839028 at 2020-10-13T13:03:19
  
  Scanning all servers it seems we missed it from most of them, out of 16 
servers only two has the revision with only one running the recent change 
poller out of these two (wdqs2003).
  
  Looking at the updater logs on wdqs1004 (P13263 
) around this time it looks like it 
missed the period from 2020-10-13T13:03:17 to 2020-10-13T13:03:28 and polled at 
2020-10-13T13:03:21 and 2020-10-13T13:03:24.
  
  Reason is still unclear, could it be that the recent change entry was added 
after 13:03:24?
  
  AC:
  
  - The RC poller should not miss items

TASK DETAIL
  https://phabricator.wikimedia.org/T267924

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse
Cc: Aklapper, dcausse, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs