dcausse created this task.
dcausse added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  Lexemes were not imported on wdqs1009 and when the streaming-updater-consumer 
started consuming lexemes from the flink ouput streams the triple store did not 
match what was expected causing diffs to generate a lot of inconsistencies.
  
  The full flink output is still retained in kafka (1 month retention) and we 
could try to recover lexemes without having to do a full import again.
  
  1. add an option to the streaming-updater-consumer to ingest only lexemes
  2. import the lexemes from `/srv/wdqs/lex-munged/`
  3. start a manual streaming-updater-consumer re-reading the whole mutation 
stream filtered on lexeme from offset 12080891
  4. stop it when it catches up with the normal consumer

TASK DETAIL
  https://phabricator.wikimedia.org/T276784

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: dcausse
Cc: Aklapper, dcausse, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
_______________________________________________
Wikidata-bugs mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Reply via email to