[
https://issues.apache.org/jira/browse/TEZ-3282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15308601#comment-15308601
]
Hitesh Shah commented on TEZ-3282:
----------------------------------
Too many permutations to this:
- Set Xms yes/no
- If, yes how to calculate Xms - % of total ( would need to configure the %
too ), equal to Xmx, etc?
- How to calculate Xmx is also an open question - today it is % but various
folks have pointed out that % fails badly for larger containers where a fixed
buffer would be sufficient compared to %?
They could all be implemented into the same impl but that would imply a lot of
knobs to be toggled.
> Set the Xms value when Tez computes the heap size for a container
> -----------------------------------------------------------------
>
> Key: TEZ-3282
> URL: https://issues.apache.org/jira/browse/TEZ-3282
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
> Attachments: TEZ-3282.01.txt
>
>
> Currently, we only set the Xmx value.
> Another useful change would be to change the calculation to not use the
> fraction blindly. For large containers - .e.g 10GB - this ends up leaving 2G
> of the container unused.
> Instead we can add another parameter which indicates the max amount of memory
> to leave outside the heap. Maybe a separate jira for this.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)