[Wikidata-bugs] [Maniphest] [Commented On] T210235: wdqs-updater crashing when update size is too large

gerritbot added a comment. Change 482902 merged by jenkins-bot: [wikidata/query/rdf@master] Extract the classification of statements in its own class. https://gerrit.wikimedia.org/r/482902TASK DETAILhttps://phabricator.wikimedia.org/T210235EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T210235: wdqs-updater crashing when update size is too large

gerritbot added a comment. Change 482815 merged by jenkins-bot: [wikidata/query/rdf@master] Move max POST size configuration to RdfRepository. https://gerrit.wikimedia.org/r/482815TASK DETAILhttps://phabricator.wikimedia.org/T210235EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T210235: wdqs-updater crashing when update size is too large

gerritbot added a comment. Change 482902 had a related patch set uploaded (by Gehel; owner: Gehel): [wikidata/query/rdf@master] Extract the classification of statements in its own class. https://gerrit.wikimedia.org/r/482902TASK DETAILhttps://phabricator.wikimedia.org/T210235EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T210235: wdqs-updater crashing when update size is too large

gerritbot added a comment. Change 482815 had a related patch set uploaded (by Gehel; owner: Gehel): [wikidata/query/rdf@master] Move max POST size configuration to RdfRepository. https://gerrit.wikimedia.org/r/482815TASK DETAILhttps://phabricator.wikimedia.org/T210235EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T210235: wdqs-updater crashing when update size is too large

gerritbot added a comment. Change 480697 merged by jenkins-bot: [wikidata/query/rdf@master] Enable chunking of updates to not overrun POST buffer in Blazegraph https://gerrit.wikimedia.org/r/480697TASK DETAILhttps://phabricator.wikimedia.org/T210235EMAIL

[Wikidata-bugs] [Maniphest] [Commented On] T210235: wdqs-updater crashing when update size is too large

gerritbot added a comment. Change 480697 had a related patch set uploaded (by Smalyshev; owner: Smalyshev): [wikidata/query/rdf@master] Enable chunking of updates to not overrun POST buffer in Blazegraph https://gerrit.wikimedia.org/r/480697TASK

[Wikidata-bugs] [Maniphest] [Commented On] T210235: wdqs-updater crashing when update size is too large

gerritbot added a comment. Change 480697 had a related patch set uploaded (by Smalyshev; owner: Smalyshev): [wikidata/query/rdf@master] Enable chunking of updates to not overrun POST buffer in Blazegraph https://gerrit.wikimedia.org/r/480697TASK

[Wikidata-bugs] [Maniphest] [Commented On] T210235: wdqs-updater crashing when update size is too large

Smalyshev added a comment. We have a limit of 20M per update, and we usually update about 500 to 700 entities, so we expect the average item's data size be no more than around 30k. However, we have things like: -rw-r--r-- 1 smalyshev wikidev 763K Dec 17 08:40 Q56939386.ttl -rw-r--r-- 1 smalyshev

[Wikidata-bugs] [Maniphest] [Commented On] T210235: wdqs-updater crashing when update size is too large

Smalyshev added a comment. Also got this one today: Exception in thread "main" java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Arrays.java:3332) at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:124) at