[ 
https://issues.apache.org/jira/browse/YARN-9045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Zhaohui Xin updated YARN-9045:
------------------------------
    Description: 
There are two modes in yarn container cpu limitation. The default is Shared 
mode which guarantees the requested resource and can also use other spare CPU 
if avaliable. Another one is Strict mode, container's resource is limited to 
allocated resource strictly.

If we want to limit the resource usage of the container and can use a certain 
percentage of spare CPU if available, the above two modes cannot satisfy our 
demand. We can define a relax 
coefficient(yarn.nodemanager.linux-container-executor.cgroups.strict-resource-usage.ratio)
 to relax the restrictions on resources in strict mode.

 
 Attachments are different modes comparison. Especifically, the last one is the 
maximum percentage of container using CPU when the relaxation coefficient is 
1.5.

  was:
There are two modes in yarn container cpu limitation. The default is Shared 
mode which guarantees the requested resource and can also use other spare CPU 
if avaliable. Another one is Strict mode, container's resource is limited to 
allocated resource strictly.

If we want to limit the resource usage of the container and can use a certain 
percentage of spare CPU if available, the above two modes cannot satisfy our 
demand. We can define a relax 
coefficient(yarn.nodemanager.linux-container-executor.cgroups.strict-resource-usage.ratio)
 to relax the restrictions on resources in strict mode.

 
Attachments are different modes comparison. Epecifically, the last one is the 
maximum percentage of container using CPU when the relaxation coefficient is 
1.5.


> Container's cpu usage limit should be soft with a relaxation factor
> -------------------------------------------------------------------
>
>                 Key: YARN-9045
>                 URL: https://issues.apache.org/jira/browse/YARN-9045
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager
>    Affects Versions: 2.6.0, 3.1.1
>            Reporter: Zhaohui Xin
>            Assignee: Zhaohui Xin
>            Priority: Major
>         Attachments: shared_mode.png
>
>
> There are two modes in yarn container cpu limitation. The default is Shared 
> mode which guarantees the requested resource and can also use other spare CPU 
> if avaliable. Another one is Strict mode, container's resource is limited to 
> allocated resource strictly.
> If we want to limit the resource usage of the container and can use a certain 
> percentage of spare CPU if available, the above two modes cannot satisfy our 
> demand. We can define a relax 
> coefficient(yarn.nodemanager.linux-container-executor.cgroups.strict-resource-usage.ratio)
>  to relax the restrictions on resources in strict mode.
>  
>  Attachments are different modes comparison. Especifically, the last one is 
> the maximum percentage of container using CPU when the relaxation coefficient 
> is 1.5.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to