[Wikidata-bugs] [Maniphest] [Created] T176844: Look into truthy nt dump performance

Wed, 27 Sep 2017 02:09:02 -0700

hoo created this task.
hoo added projects: Datasets-General-or-Unknown, Wikidata.

TASK DESCRIPTION

Yesterday @ArielGlenn and I were looking into the performance of the various entity dumpers:

  • full json creation is taking about 23-26h
  • full ttl creation is taking about 24-30h
  • truthy nt creation is taking about 36-48h

The truthy nt dumps are quite slow (and notably slower than the other dump types), thus we should profile them and see what we can do.


TASK DETAIL
https://phabricator.wikimedia.org/T176844

EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: hoo
Cc: Aklapper, daniel, Lydia_Pintscher, aude, hoo, ArielGlenn, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, Svick, Mbch331, jeremyb
_______________________________________________
Wikidata-bugs mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Reply via email to