[jira] [Created] (YARN-10591) Allow USERLIMIT_FIRST as only valid configuration when FairOrdering is used

2021-01-21 Thread VADAGA ANANYO RAO (Jira)
VADAGA ANANYO RAO created YARN-10591: Summary: Allow USERLIMIT_FIRST as only valid configuration when FairOrdering is used Key: YARN-10591 URL: https://issues.apache.org/jira/browse/YARN-10591 Pro

[jira] [Commented] (YARN-10555) missing access check before getAppAttempts

2021-01-21 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269915#comment-17269915 ] zhuqi commented on YARN-10555: -- Thanks for [~xiaoheipangzi] for this. The patch LGTM. > m

[jira] [Updated] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation loss.

2021-01-21 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10590: - Attachment: YARN-10590.002.patch > Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute > cacula

[jira] [Commented] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation loss.

2021-01-21 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269888#comment-17269888 ] zhuqi commented on YARN-10590: -- cc [~leftnoteasy]  [~sunilg] [~bteke] When i deep into the

[jira] [Updated] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation loss.

2021-01-21 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10590: - Description: Because we have introduced YARN-10504. In auto created leaf queue with absolute mode, the caculatio

[jira] [Updated] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation loss.

2021-01-21 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10590: - Description: Because we have introduced YARN-10504. In auto created leaf queue with absolute mode, the caculatio

[jira] [Updated] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation loss.

2021-01-21 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10590: - Summary: Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation loss. (was: Fix TestCap

[jira] [Created] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation.

2021-01-21 Thread zhuqi (Jira)
zhuqi created YARN-10590: Summary: Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation. Key: YARN-10590 URL: https://issues.apache.org/jira/browse/YARN-10590 Project: Hadoop YARN

[jira] [Updated] (YARN-10519) Refactor QueueMetricsForCustomResources class to move to yarn-common package

2021-01-21 Thread Bibin Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin Chundatt updated YARN-10519: -- Fix Version/s: 3.3.1 > Refactor QueueMetricsForCustomResources class to move to yarn-common pac

[jira] [Commented] (YARN-10519) Refactor QueueMetricsForCustomResources class to move to yarn-common package

2021-01-21 Thread Bibin Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269770#comment-17269770 ] Bibin Chundatt commented on YARN-10519: --- Cherry-picked to branch-3-3 > Refactor Qu

[jira] [Commented] (YARN-10515) Fix flaky test TestCapacitySchedulerAutoQueueCreation.testDynamicAutoQueueCreationWithTags

2021-01-21 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269592#comment-17269592 ] Szilard Nemeth commented on YARN-10515: --- Thanks [~pbacsko], Straightforward patch,

[jira] [Updated] (YARN-10515) Fix flaky test TestCapacitySchedulerAutoQueueCreation.testDynamicAutoQueueCreationWithTags

2021-01-21 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10515: -- Fix Version/s: 3.4.0 > Fix flaky test > TestCapacitySchedulerAutoQueueCreation.testDynamicAuto

[jira] [Commented] (YARN-10588) Percentage of queue and cluster is zero in WebUI

2021-01-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269584#comment-17269584 ] Hadoop QA commented on YARN-10588: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-10490) "yarn top" command not quitting completely with ctrl+c

2021-01-21 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269568#comment-17269568 ] Szilard Nemeth commented on YARN-10490: --- Thanks [~akshink] for working on this. La

[jira] [Updated] (YARN-10490) "yarn top" command not quitting completely with ctrl+c

2021-01-21 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10490: -- Fix Version/s: 3.4.0 > "yarn top" command not quitting completely with ctrl+c > ---

[jira] [Commented] (YARN-10587) Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode.

2021-01-21 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269479#comment-17269479 ] Wangda Tan commented on YARN-10587: --- +1, thanks [~zhuqi] > Fix AutoCreateLeafQueueCrea

[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2021-01-21 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269469#comment-17269469 ] Wangda Tan commented on YARN-10531: --- +1, thanks [~zhuqi], will get it in later today.

[jira] [Commented] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269431#comment-17269431 ] Hadoop QA commented on YARN-10585: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

2021-01-21 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269424#comment-17269424 ] Wangda Tan commented on YARN-10581: --- +1, patch looks good, thanks [~snemeth] > CS Flex

[jira] [Commented] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

2021-01-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269420#comment-17269420 ] Eric Payne commented on YARN-10559: --- Thanks [~ananyo_rao] for bringing up this issue an

[jira] [Commented] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

2021-01-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269416#comment-17269416 ] Hadoop QA commented on YARN-10581: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-21 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10585: -- Attachment: YARN-10585.002.patch > Create a class which can convert from legacy mapping rule fo

[jira] [Updated] (YARN-10588) Percentage of queue and cluster is zero in WebUI

2021-01-21 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-10588: - Attachment: YARN-10588.001.patch > Percentage of queue and cluster is zero in WebUI > --

[jira] [Commented] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-21 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269316#comment-17269316 ] Gergely Pollak commented on YARN-10585: --- Fixed the unit test failures, improved the

[jira] [Updated] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

2021-01-21 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10581: -- Attachment: YARN-10581.003.patch > CS Flexible Auto Queue Creation: Modify RM /scheduler endpoi

[jira] [Comment Edited] (YARN-10564) Support Auto Queue Creation template configurations

2021-01-21 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269289#comment-17269289 ] Andras Gyori edited comment on YARN-10564 at 1/21/21, 1:15 PM:

[jira] [Comment Edited] (YARN-10564) Support Auto Queue Creation template configurations

2021-01-21 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269289#comment-17269289 ] Andras Gyori edited comment on YARN-10564 at 1/21/21, 1:14 PM:

[jira] [Commented] (YARN-10564) Support Auto Queue Creation template configurations

2021-01-21 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269289#comment-17269289 ] Andras Gyori commented on YARN-10564: - Uploaded a patch, that supports template confi

[jira] [Updated] (YARN-10564) Support Auto Queue Creation template configurations

2021-01-21 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10564: Attachment: YARN-10564.001.patch > Support Auto Queue Creation template configurations > --

[jira] [Commented] (YARN-10588) Percentage of queue and cluster is zero in WebUI

2021-01-21 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269264#comment-17269264 ] Bilwa S T commented on YARN-10588: -- I think calc.isInvalidDivisor(cluster) check can be

[jira] [Commented] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

2021-01-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269254#comment-17269254 ] Hadoop QA commented on YARN-10581: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-10589) Improve logic of multi-node allocation

2021-01-21 Thread Tanu Ajmera (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanu Ajmera updated YARN-10589: --- Description: {code:java} for (String partititon : partitions) { if (current++ > start) { break; }

[jira] [Created] (YARN-10589) Improve logic of multi-node allocation

2021-01-21 Thread Tanu Ajmera (Jira)
Tanu Ajmera created YARN-10589: -- Summary: Improve logic of multi-node allocation Key: YARN-10589 URL: https://issues.apache.org/jira/browse/YARN-10589 Project: Hadoop YARN Issue Type: Task A

[jira] [Commented] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

2021-01-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269225#comment-17269225 ] Peter Bacsko commented on YARN-10581: - Yes. +1 from me (pending Jenkins). > CS Flex

[jira] [Commented] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

2021-01-21 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269218#comment-17269218 ] Szilard Nemeth commented on YARN-10581: --- Thanks [~pbacsko] and [~gandras] for the r

[jira] [Commented] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

2021-01-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269181#comment-17269181 ] Peter Bacsko commented on YARN-10581: - I have one question: automatically created lea

[jira] [Comment Edited] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

2021-01-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269181#comment-17269181 ] Peter Bacsko edited comment on YARN-10581 at 1/21/21, 9:47 AM:

[jira] [Commented] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

2021-01-21 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269169#comment-17269169 ] Andras Gyori commented on YARN-10581: - Thanks [~snemeth] for the patch, I have manage

[jira] [Updated] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

2021-01-21 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10581: -- Attachment: YARN-10581.002.patch > CS Flexible Auto Queue Creation: Modify RM /scheduler endpoi

[jira] [Commented] (YARN-10579) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include weight values for queues

2021-01-21 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17269114#comment-17269114 ] Szilard Nemeth commented on YARN-10579: --- Thanks [~wangda], Fixed the whitespace is

[jira] [Updated] (YARN-10579) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include weight values for queues

2021-01-21 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10579: -- Fix Version/s: 3.4.0 > CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to includ