[ 
https://issues.apache.org/jira/browse/AMBARI-11870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583831#comment-14583831
 ] 

Siddharth Wagle commented on AMBARI-11870:
------------------------------------------

+1 patch looks good.

> HDP-2.3 'hive.tez.java.opts' should not contain Xmx and add additional JDK1.8 
> params
> ------------------------------------------------------------------------------------
>
>                 Key: AMBARI-11870
>                 URL: https://issues.apache.org/jira/browse/AMBARI-11870
>             Project: Ambari
>          Issue Type: Bug
>          Components: contrib
>    Affects Versions: 2.1.0
>            Reporter: Srimanth Gunturi
>            Assignee: Srimanth Gunturi
>             Fix For: 2.1.0
>
>         Attachments: AMBARI-11870.patch, AMBARI-11870_2.patch
>
>
> {{hive.tez.java.opts}} for HDP-2.3 should not contain the Xmx JVM parameter. 
> The reason for this is:
> {noformat}
> Tez does it based on the allocated container (i.e if you use a 1.5Gig 
> container.size and YARN returns a 4Gig one, Tez should use a 0.8*4096).
> https://github.com/apache/tez/blob/master/tez-api/src/main/java/org/apache/tez/client/TezClientUtils.java#L920
> This would work much better if you removed the whole Xmx parameter from the 
> config in hive-site.xml.
> {noformat}
> Also, for JDK8 the preferred GC isn't {{-XX:+UseParallelGC}} it is 
> {{-XX:+UseG1GC -XX:+ResizeTLAB}} while retaining all the other java 
> parameters. In some JDK7 versions, the G1GC occasionally segfaults, so the 
> choice of those two are based on whether the install is on JDK8 or not.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to