Sangjin Lee commented on YARN-2440:

It might be good to use several fairly representative scenarios and see how we 
can satisfy them with clear configuration.

One scenario I can see pretty common is this (just for illustration):
- 8-core system
- want to use only 6 cores for containers (reserving 2 for NM and DN, etc.)
- want to allocate 1/2 core per container by default

IMO, the simplest config is
yarn.nodemanager.resource.cpu-vcores = 60
yarn.nodemanager.containers-cores-to-vcores = 10
each container asks 5 vcores

Or I could have
yarn.nodemanager.resource.cpu-vcores = 60
yarn.nodemanager.containers-cpu-cores = 6 (core-to-vcore ratio understood as 
the ratio of these two)
each container asks 5 vcores

I'm not sure how I can use containers-cpu-percentage to describe this 

Does this help? Are there other types of use cases that we should review this 

> Cgroups should allow YARN containers to be limited to allocated cores
> ---------------------------------------------------------------------
>                 Key: YARN-2440
>                 URL: https://issues.apache.org/jira/browse/YARN-2440
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Varun Vasudev
>            Assignee: Varun Vasudev
>         Attachments: apache-yarn-2440.0.patch, apache-yarn-2440.1.patch, 
> apache-yarn-2440.2.patch, screenshot-current-implementation.jpg
> The current cgroups implementation does not limit YARN containers to the 
> cores allocated in yarn-site.xml.

This message was sent by Atlassian JIRA

Reply via email to