[Wikidata-bugs] [Maniphest] [Created] T192142: Property suggester python scripts do not scale to the amount of Wikidata data that needs to be processed

[WMDE-leszek]

WMDE-leszek created this task. WMDE-leszek added projects: Wikidata-Ministry-Of-Magic-Tech-Debt, Epic, Wikidata, MediaWiki-extensions-PropertySuggester. Herald added a subscriber: Aklapper.

TASK DESCRIPTION

Currently running scripts takes approx. two days, and it is bound to take more as the amount of Wikidata data keeps growing.
Scripts cannot be run in parallel, which might be the easier way to make their work finish faster.

Please @Ladsgroup and/or @hoo provide more details, or add already existing tasks if there are any.

TASK DETAIL

https://phabricator.wikimedia.org/T192142

WORKBOARD

https://phabricator.wikimedia.org/project/board/3338/

EMAIL PREFERENCES

https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: WMDE-leszek
Cc: Aklapper, WMDE-leszek, hoo, Ladsgroup, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Lydia_Pintscher, Sjoerddebruin, Mbch331

_______________________________________________
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs