Gehel created this task.
Gehel added projects: Wikidata-Query-Service, Operations, Discovery-Search
(Current work).
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.
TASK DESCRIPTION
As a client of the Categories SPARQL endpoint, I want up to date data.
Categories update are failing on all WDQS servers, update lag is > 8 days. A
quick look at the logs show:
>Processing thankyouwiki...
Could not load timestamp from
https://dumps.wikimedia.org/other/categoriesrdf/daily/lastdump/thankyouwiki-daily.last
2020-08-24T07:30:56+00:00 categories daily load done
That dump isn't available on the latest dumps
<https://dumps.wikimedia.org/other/categoriesrdf/daily/lastdump/>.
While we have an entry about categories lag in the WDQS runbook
<https://wikitech.wikimedia.org/wiki/Wikidata_query_service/Runbook#Categories_update_lag>,
it is limited and does not seem to apply here. We need to have a more robust
mechanism for categories update, maybe porting the current bash script to a
higher level language.
AC:
[ ] categories are up to date on all WDQS servers
[ ] categories update mechanism is robust enough
[ ] if there is still a known case where manual intervention is required,
this case is documented in the WDQS Runbook
<https://wikitech.wikimedia.org/wiki/Wikidata_query_service/Runbook#Categories_update_lag>
TASK DETAIL
https://phabricator.wikimedia.org/T261097
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Gehel
Cc: RKemper, Gehel, Aklapper, lmata, CBogen, Akuckartz, darthmon_wmde,
Legado_Shulgin, Nandana, Namenlos314, Davinaclare77, Qtn1293, Techguru.pc,
Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0,
QZanden, EBjune, merbst, LawExplorer, Zppix, _jensen, rosalieper, Scott_WUaS,
Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984,
Manybubbles, faidon, Mbch331, Rxy, Jay8g, fgiunchedi
_______________________________________________
Wikidata-bugs mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
