[ 
https://issues.apache.org/jira/browse/TEZ-3282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15308601#comment-15308601
 ] 

Hitesh Shah commented on TEZ-3282:
----------------------------------

Too many permutations to this: 
  - Set Xms yes/no
  - If, yes how to calculate Xms - % of total ( would need to configure the % 
too ), equal to Xmx, etc?
  - How to calculate Xmx is also an open question - today it is % but various 
folks have pointed out that % fails badly for larger containers where a fixed 
buffer would be sufficient compared to %?

They could all be implemented into the same impl but that would imply a lot of 
knobs to be toggled. 


> Set the Xms value when Tez computes the heap size for a container
> -----------------------------------------------------------------
>
>                 Key: TEZ-3282
>                 URL: https://issues.apache.org/jira/browse/TEZ-3282
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Siddharth Seth
>            Assignee: Siddharth Seth
>         Attachments: TEZ-3282.01.txt
>
>
> Currently, we only set the Xmx value.
> Another useful change would be to change the calculation to not use the 
> fraction blindly. For large containers - .e.g 10GB - this ends up leaving 2G 
> of the container unused.
> Instead we can add another parameter which indicates the max amount of memory 
> to leave outside the heap. Maybe a separate jira for this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to