[Wikidata-bugs] [Maniphest] [Commented On] T126956: Investigate Bulk Data Load for faster loading dumps into WDQS

2016-02-29 Thread gerritbot
gerritbot added a comment.


  Change 273539 merged by jenkins-bot:
  Add new REST API data loader, which is faster.
  
  https://gerrit.wikimedia.org/r/273539

TASK DETAIL
  https://phabricator.wikimedia.org/T126956

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: gerritbot, Aklapper, Smalyshev, debt, Gehel, D3r1ck01, FloNight, Izno, 
jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T126956: Investigate Bulk Data Load for faster loading dumps into WDQS

2016-02-26 Thread gerritbot
gerritbot added a comment.


  Change 273539 had a related patch set uploaded (by Smalyshev):
  Add new REST API data loader, which is faster.
  
  https://gerrit.wikimedia.org/r/273539

TASK DETAIL
  https://phabricator.wikimedia.org/T126956

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: gerritbot, Aklapper, Smalyshev, debt, Gehel, D3r1ck01, FloNight, Izno, 
jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T126956: Investigate Bulk Data Load for faster loading dumps into WDQS

2016-02-25 Thread Smalyshev
Smalyshev added a comment.


  Loading one dump file via curl takes 7m7.633s on test machine, loading via 
data loader takes 3m54.660s. That's almost twice as fast. I think that warrants 
looking into switching data loading to this function.

TASK DETAIL
  https://phabricator.wikimedia.org/T126956

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Smalyshev
Cc: Aklapper, Smalyshev, debt, Gehel, FloNight, Izno, jkroll, Wikidata-bugs, 
Jdouglas, aude, Deskana, Manybubbles, Mbch331



___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs