Impala Public Jenkins has submitted this change and it was merged. ( 
http://gerrit.cloudera.org:8080/20501 )

Change subject: IMPALA-12453: Increase yarn high disk threshold
......................................................................

IMPALA-12453: Increase yarn high disk threshold

Yarn will mark a node as unavailable for running jobs if it exceeds the
disk threshold. We only have one node, so that means jobs hang until
disk frees up. Exhaustive test runs are approaching using 300GB, which
is a common size for our test environments, and we see some tests
hanging on yarn jobs.

Increases the disk threshold from default of 90% to 99%; in test
environments the remaining 1% is ~3GB. That should still be sufficient
in case yarn needs to throttle workloads to avoid using all the disk,
while leaving most of the disk available.

Change-Id: I06b723e4ecea94ce95fb2bd41bd356fba694e87a
Reviewed-on: http://gerrit.cloudera.org:8080/20501
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
---
M testdata/cluster/node_templates/common/etc/hadoop/conf/yarn-site.xml.py
1 file changed, 5 insertions(+), 0 deletions(-)

Approvals:
  Impala Public Jenkins: Looks good to me, approved; Verified

--
To view, visit http://gerrit.cloudera.org:8080/20501
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: merged
Gerrit-Change-Id: I06b723e4ecea94ce95fb2bd41bd356fba694e87a
Gerrit-Change-Number: 20501
Gerrit-PatchSet: 4
Gerrit-Owner: Michael Smith <[email protected]>
Gerrit-Reviewer: Daniel Becker <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Joe McDonnell <[email protected]>
Gerrit-Reviewer: Laszlo Gaal <[email protected]>
Gerrit-Reviewer: Michael Smith <[email protected]>

Reply via email to