Laszlo Gaal (Cloudera) has uploaded this change for review. ( http://gerrit.cloudera.org:8080/18630
Change subject: IMPALA-10316: Increase Yarn minimum container size for dataload ...................................................................... IMPALA-10316: Increase Yarn minimum container size for dataload This is an attempt to get rod of IMPALA-10669 and friends, crashing Tez containers during the loading of nested ORC data. It sets the minimum size and the sizing increment of Yarn containers to 2GB, hoping to avoid too small Yarn containers that sometimes fail during this step. Tested by running the dataload phase successfully on the following platform combinations: - Ubuntu 16.04, m6i.8xlarge (128 GB RAM, Docker) - Ubuntu 16.04, m5.12xlarge (192 GB RAM, Docker) - Centos 7.4, m5.4xlarge (64 GB RAM) - Centos 7.4, r5.4xlarge (128 GB RAM) - Ubuntu 16.04, m6i.4xlarge (64 GB RAM) Change-Id: I77e7c9e9fa3491c6e5652351869d3a4410bbb7b8 --- M testdata/cluster/node_templates/common/etc/hadoop/conf/yarn-site.xml.py 1 file changed, 4 insertions(+), 1 deletion(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/30/18630/1 -- To view, visit http://gerrit.cloudera.org:8080/18630 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I77e7c9e9fa3491c6e5652351869d3a4410bbb7b8 Gerrit-Change-Number: 18630 Gerrit-PatchSet: 1 Gerrit-Owner: Laszlo Gaal (Cloudera) <[email protected]>
