[Wikidata-bugs] [Maniphest] [Commented On] T126956: Investigate Bulk Data Load for faster loading dumps into WDQS
gerritbot added a comment. Change 273539 merged by jenkins-bot: Add new REST API data loader, which is faster. https://gerrit.wikimedia.org/r/273539 TASK DETAIL https://phabricator.wikimedia.org/T126956 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: gerritbot Cc: gerritbot, Aklapper, Smalyshev, debt, Gehel, D3r1ck01, FloNight, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T126956: Investigate Bulk Data Load for faster loading dumps into WDQS
gerritbot added a comment. Change 273539 had a related patch set uploaded (by Smalyshev): Add new REST API data loader, which is faster. https://gerrit.wikimedia.org/r/273539 TASK DETAIL https://phabricator.wikimedia.org/T126956 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: gerritbot Cc: gerritbot, Aklapper, Smalyshev, debt, Gehel, D3r1ck01, FloNight, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T126956: Investigate Bulk Data Load for faster loading dumps into WDQS
Smalyshev added a comment. Loading one dump file via curl takes 7m7.633s on test machine, loading via data loader takes 3m54.660s. That's almost twice as fast. I think that warrants looking into switching data loading to this function. TASK DETAIL https://phabricator.wikimedia.org/T126956 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Aklapper, Smalyshev, debt, Gehel, FloNight, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs