Rajesh Balamohan created TEZ-1986:
-------------------------------------
Summary: Unable to increase am/task container size for MR job in
yarn-tez
Key: TEZ-1986
URL: https://issues.apache.org/jira/browse/TEZ-1986
Project: Apache Tez
Issue Type: Bug
Reporter: Rajesh Balamohan
Tried to run a MR job with "-Dtez.am.resource.memory.mb=8192
-Dtez.task.resource.memory.mb=8192 -Dmapreduce.framework.name=yarn-tez
-Dmapreduce.map.resource.mb=8192 -Dmapreduce.reduce.resource.mb=8192".
>>>
DAGAppMaster:
java -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN
-server -Xmx7168m -Djava.net.preferIPv4Stack=true -XX:+PrintGCDetails
-verbose:gc -XX:+PrintGCTimeStamps
-Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator
-Dlog4j.configuration=tez-container-log4j.properties
-Dyarn.app.container.log.dir=/grid/5/cluster/yarn/logs/application_1421164610335_0326/container_1421164610335_0326_01_000001
-Dtez.root.logger=INFO,CLA -Dsun.nio.ch.bugLevel=
org.apache.tez.dag.app.DAGAppMaster
Tasks:
java -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN
-XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA
-XX:+UseParallelGC -Djava.net.preferIPv4Stack=true
-Dhadoop.metrics.log.level=WARN -server -Xmx3584m
-Djava.net.preferIPv4Stack=true -XX:+UseNUMA -XX:+UseParallelGC
-Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator
-Dlog4j.configuration=tez-container-log4j.properties
>>>
These values seem to be from "mapred.map.child.java.opts" and
"mapred.reduce.child.java.opts" instead of (8192 m * 0.8 = 6553m).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
