Smalyshev added a comment. @Fceller this was tested on my work machine, so it has about 8G of memory, are you saying giving it more memory would significantly improve things significantly? How much memory should be enough to get under 10 mins loading data of this size?
what you mean by "2-3 thousands indexed fields"? Are you going to have JSON documents with 2000 attributes, that you are going to index? There are thousands of indexable attributes, but not each document has every one of them - typical one would have tens, rarely up to a hundred. We need to be able to search by any of the attributes though. TASK DETAIL https://phabricator.wikimedia.org/T88549 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign <username>. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Fceller, JanZerebecki, Aklapper, Manybubbles, jkroll, Smalyshev, Wikidata-bugs, aude, GWicke, daniel _______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
