[Wikidata-bugs] [Maniphest] [Commented On] T190513: Make sure Wikidata entity dump scripts run for only about 1-2hours

Tue, 10 Apr 2018 01:49:11 -0700

hoo added a comment.

Velocity (taken as average from the three runs listed above):

  • JSON: 214k entities/hour
  • TTL: 189k entities/hour
  • truthy-nt: 157k entities/hour

Due to this, I suggest to always run roughly roughly 400k page ids per script run (considering there are possibly missing ones, pages in other namespaces, …).


TASK DETAIL
https://phabricator.wikimedia.org/T190513

EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: hoo
Cc: ArielGlenn, Aklapper, hoo, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Svick, Mbch331, jeremyb
_______________________________________________
Wikidata-bugs mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Reply via email to