[
https://issues.apache.org/jira/browse/YARN-782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandy Ryza updated YARN-782:
----------------------------
Description:
The vcores-pcores ratio functions differently from the vmem-pmem ratio in the
sense that the vcores-pcores ratio has an impact on allocations and the
vmem-pmem ratio does not.
If I double my vmem-pmem ratio, the only change that occurs is that my
containers, after being scheduled, are less likely to be killed for using too
much virtual memory. But if I double my vcore-pcore ratio, my nodes will
appear to the ResourceManager to contain double the amount of CPU space, which
will affect scheduling decisions.
The lack of consistency will exacerbate the fundamentally difficult problem of
resource configuration.
was:
The vcores-pcores ratio functions differently from the vmem-pmem ratio in the
sense that the vcores-pcores ratio has an impact on allocations and the
vmem-pmem ratio does not.
If I double my vmem-pmem ratio, the only change that occurs is that my
already-scheduled containers are less likely to be killed for using too much
virtual memory. But if I double my vcore-pcore ratio, my nodes will appear to
the ResourceManager to contain double the amount of CPU space, which will
affect scheduling decisions.
The lack of consistency will exacerbate the fundamentally difficult problem of
resource configuration.
> vcores-pcores ratio functions differently from vmem-pmem ratio in misleading
> way
> ---------------------------------------------------------------------------------
>
> Key: YARN-782
> URL: https://issues.apache.org/jira/browse/YARN-782
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: nodemanager
> Affects Versions: 2.0.4-alpha
> Reporter: Sandy Ryza
> Assignee: Sandy Ryza
> Priority: Critical
>
> The vcores-pcores ratio functions differently from the vmem-pmem ratio in the
> sense that the vcores-pcores ratio has an impact on allocations and the
> vmem-pmem ratio does not.
> If I double my vmem-pmem ratio, the only change that occurs is that my
> containers, after being scheduled, are less likely to be killed for using too
> much virtual memory. But if I double my vcore-pcore ratio, my nodes will
> appear to the ResourceManager to contain double the amount of CPU space,
> which will affect scheduling decisions.
> The lack of consistency will exacerbate the fundamentally difficult problem
> of resource configuration.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
