[
https://issues.apache.org/jira/browse/AMBARI-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Srimanth Gunturi updated AMBARI-11870:
--------------------------------------
Attachment: AMBARI-11870_2.patch
Attaching new patch containing validation issue fix found during testing.
> HDP-2.3 'hive.tez.java.opts' should not contain Xmx and add additional JDK1.8
> params
> ------------------------------------------------------------------------------------
>
> Key: AMBARI-11870
> URL: https://issues.apache.org/jira/browse/AMBARI-11870
> Project: Ambari
> Issue Type: Bug
> Components: contrib
> Affects Versions: 2.1.0
> Reporter: Srimanth Gunturi
> Assignee: Srimanth Gunturi
> Fix For: 2.1.0
>
> Attachments: AMBARI-11870.patch, AMBARI-11870_2.patch
>
>
> {{hive.tez.java.opts}} for HDP-2.3 should not contain the Xmx JVM parameter.
> The reason for this is:
> {noformat}
> Tez does it based on the allocated container (i.e if you use a 1.5Gig
> container.size and YARN returns a 4Gig one, Tez should use a 0.8*4096).
> https://github.com/apache/tez/blob/master/tez-api/src/main/java/org/apache/tez/client/TezClientUtils.java#L920
> This would work much better if you removed the whole Xmx parameter from the
> config in hive-site.xml.
> {noformat}
> Also, for JDK8 the preferred GC isn't {{-XX:+UseParallelGC}} it is
> {{-XX:+UseG1GC -XX:+ResizeTLAB}} while retaining all the other java
> parameters. In some JDK7 versions, the G1GC occasionally segfaults, so the
> choice of those two are based on whether the install is on JDK8 or not.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
