Srimanth Gunturi created AMBARI-11870:
-----------------------------------------
Summary: HDP-2.3 'hive.tez.java.opts' should not contain Xmx and
add additional JDK1.8 params
Key: AMBARI-11870
URL: https://issues.apache.org/jira/browse/AMBARI-11870
Project: Ambari
Issue Type: Bug
Components: contrib
Affects Versions: 2.1.0
Reporter: Srimanth Gunturi
Assignee: Srimanth Gunturi
Fix For: 2.1.0
{{hive.tez.java.opts}} for HDP-2.3 should not contain the Xmx JVM parameter.
The reason for this is:
{noformat}
Tez does it based on the allocated container (i.e if you use a 1.5Gig
container.size and YARN returns a 4Gig one, Tez should use a 0.8*4096).
https://github.com/apache/tez/blob/master/tez-api/src/main/java/org/apache/tez/client/TezClientUtils.java#L920
This would work much better if you removed the whole Xmx parameter from the
config in hive-site.xml.
{noformat}
Also, for JDK8 the preferred GC isn't {{-XX:+UseParallelGC}} it is
{{-XX:+UseG1GC -XX:+ResizeTLAB}} while retaining all the other java parameters.
In some JDK7 versions, the G1GC occasionally segfaults, so the choice of those
two are based on whether the install is on JDK8 or not.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
