Neunhoef added a comment. Further experiments:
I dropped each of these indexes and recreated it. This isolates the rebuilding of the indexes from the loading (and scanning) of the collection files. Here are the timing results for the recreation (dropping is instantaneous): - unique hash index on "id": 3.0 s - hash index on "type": 2.1 s - skip list index on "sitelinks.enwiki": 215.8 s - skip list index on "sitelist.enwiki.badges": 25.8 s Note that index generation is single threaded in version 2.4. TASK DETAIL https://phabricator.wikimedia.org/T88549 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign <username>. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev, Neunhoef Cc: Neunhoef, Fceller, JanZerebecki, Aklapper, Manybubbles, jkroll, Smalyshev, Wikidata-bugs, aude, GWicke, daniel _______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
