[Wikidata-bugs] [Maniphest] [Commented On] T236663: Create a parallel loader to improve load performance for WDQS / Blazegraph

2020-01-31 Thread Igorkim78
Igorkim78 added a comment. @Aklapper , Thank you! Fixed the commit message. TASK DETAIL https://phabricator.wikimedia.org/T236663 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Igorkim78 Cc: Addshore, Aklapper, Igorkim78, Gehel, Un1tY, Hook696,

[Wikidata-bugs] [Maniphest] [Commented On] T236663: Create a parallel loader to improve load performance for WDQS / Blazegraph

2020-01-30 Thread Igorkim78
Igorkim78 added a comment. Changeset is https://gerrit.wikimedia.org/r/#/c/wikidata/query/rdf/+/532373/ TASK DETAIL https://phabricator.wikimedia.org/T236663 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Igorkim78 Cc: Addshore, Aklapper,

[Wikidata-bugs] [Maniphest] [Commented On] T236663: Create a parallel loader to improve load performance for WDQS / Blazegraph

2020-01-16 Thread Igorkim78
Igorkim78 added a comment. Performance measured on dump from 20191202: https://dumps.wikimedia.org/wikidatawiki/entities/20191202/ Baseline tIme to load: 4264m29.914s, 714218864640 bytes Improvements proposed: 1. One-path loading (when data is loaded into SPO index only and POS,