[Wikidata-bugs] [Maniphest] [Commented On] T194627: dumpRdf script should take the disabledRdfExportEntityTypes flag into account

Tue, 05 Jun 2018 08:56:27 -0700

Pablo-WMDE added a comment.

Observations:

  • SqlEntityIdPager can be used to select entities (their ids) by page_namespace (which can be derived from the entity type) from the database
    • currently only supports this for one entityType at a time
  • when querying for more than one entity type, filtering is performed in application code (DumpGenerator)
  • as DumpEntities supports two id stream providers, SqlEntityIdPager and a file based EntityIdReader, the second of which does not support filtering by entity type on its own, the DumpGenerator will have to preserve its ability to filter by entity type regardless of potential optimization in the SQL department

TASK DETAIL
https://phabricator.wikimedia.org/T194627

EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pablo-WMDE
Cc: hoo, WMDE-leszek, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Darkdadaah, Mbch331
_______________________________________________
Wikidata-bugs mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Reply via email to