[jira] [Comment Edited] (YARN-10154) CS Dynamic Queues cannot be configured with absolute resources

2020-04-27 Thread Prabhu Joseph (Jira)


[ 
https://issues.apache.org/jira/browse/YARN-10154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17089904#comment-17089904
 ] 

Prabhu Joseph edited comment on YARN-10154 at 4/27/20, 1:04 PM:


[~maniraj...@gmail.com] [~sunilg] We have found below two issues on further 
testing.

1. Application submitted into AutoCreatedLeafQueue stays in ACCEPTED state as 
the queue's capacity and max capacity are set as NaN. This happens as 
{{leafQueueTemplate}} created during ManagedParentQueue initialize as part of 
ResourceManager startup sets capacity based on the initial clusterResource 0 in 
case of DominantResourceCalculator.

     >> Have moved the setCapacity in leafQueueTemplate inside addChildQueue 
where it uses the right clusterResource.

2. Enforces Max Capacity to be set in leafqueuetemplate. If not set, RM fails 
to start with IllegalArgumentException abs-cap cannot be greater that 
abs-max-cap.

     >> When not set, parent max resource is used.

 


was (Author: prabhu joseph):
[~maniraj...@gmail.com] [~sunilg] We have found below two issues on further 
testing.

1. Application submitted into AutoCreatedLeafQueue stays in ACCEPTED state as 
the queue's capacity and max capacity are set as NaN. This happens as 
{{leafQueueTemplate}} created during ManagedParentQueue initialize as part of 
ResourceManager startup sets capacity based on the initial clusterResource 0.

     >> Have moved the setCapacity in leafQueueTemplate inside addChildQueue 
where it uses the right clusterResource.

2. Enforces Max Capacity to be set in leafqueuetemplate. If not set, RM fails 
to start with IllegalArgumentException abs-cap cannot be greater that 
abs-max-cap.

     >> When not set, parent max resource is used.

 

> CS Dynamic Queues cannot be configured with absolute resources
> --
>
> Key: YARN-10154
> URL: https://issues.apache.org/jira/browse/YARN-10154
> Project: Hadoop YARN
>  Issue Type: Bug
>Affects Versions: 3.1.3
>Reporter: Sunil G
>Assignee: Manikandan R
>Priority: Major
> Fix For: 3.4.0
>
> Attachments: YARN-10154.001.patch, YARN-10154.002.patch, 
> YARN-10154.003.patch, YARN-10154.addendum-001.patch, 
> YARN-10154.addendum-002.patch
>
>
> In CS, ManagedParent Queue and its template cannot take absolute resource 
> value like 
> [memory=8192,vcores=8]
>  Thsi Jira is to track and improve the configuration reading module of 
> DynamicQueue to support absolute resource values.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Comment Edited] (YARN-10154) CS Dynamic Queues cannot be configured with absolute resources

2020-03-14 Thread Manikandan R (Jira)


[ 
https://issues.apache.org/jira/browse/YARN-10154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17059200#comment-17059200
 ] 

Manikandan R edited comment on YARN-10154 at 3/14/20, 8:34 AM:
---

Yes, patch takes care of min and max in above discussed format only.

Updated patch for doc changes. 


was (Author: maniraj...@gmail.com):
Yes, patch takes care of min and max in above discussed format only.

Once [~sunilg] reviewed the patch, will update doc once for all with review 
comments (if any).

> CS Dynamic Queues cannot be configured with absolute resources
> --
>
> Key: YARN-10154
> URL: https://issues.apache.org/jira/browse/YARN-10154
> Project: Hadoop YARN
>  Issue Type: Bug
>Affects Versions: 3.1.3
>Reporter: Sunil G
>Assignee: Manikandan R
>Priority: Major
> Attachments: YARN-10154.001.patch, YARN-10154.002.patch
>
>
> In CS, ManagedParent Queue and its template cannot take absolute resource 
> value like 
> [memory=8192,vcores=8]
>  Thsi Jira is to track and improve the configuration reading module of 
> DynamicQueue to support absolute resource values.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org