[jira] [Commented] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261196#comment-17261196 ] Hadoop QA commented on YARN-10559: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261232#comment-17261232 ] zhuqi commented on YARN-10504: -- Fixed max absolute update in AutoCreatedLeafQueue. And the 

[jira] [Updated] (YARN-10555) missing access check before getAppAttempts

[ https://issues.apache.org/jira/browse/YARN-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-10555: - Description: It seems that we miss a access check before getAppAttempts, see

[jira] [Updated] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10506: Attachment: YARN-10506.005.patch > Update queue creation logic to use weight mode and allow the

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261321#comment-17261321 ] Hadoop QA commented on YARN-10504: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261167#comment-17261167 ] Andras Gyori commented on YARN-10507: - Thank you [~pbacsko] for the updated patch. It LGTM now +1. >

[jira] [Updated] (YARN-10555) missing access check before getAppAttempts

[ https://issues.apache.org/jira/browse/YARN-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-10555: - Summary: missing access check before getAppAttempts (was: missing security check before getAppAttempts) >

[jira] [Updated] (YARN-10563) Fix dependency exclusion problem in poms

[ https://issues.apache.org/jira/browse/YARN-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10563: Description: Currently, {{hadoop-project/pom.xml}} contains a bunch of exclusions for

[jira] [Commented] (YARN-10528) maxAMShare should only be accepted for leaf queues, not parent queues

[ https://issues.apache.org/jira/browse/YARN-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261255#comment-17261255 ] Szilard Nemeth commented on YARN-10528: --- Thanks [~sahuja] for the new patches. LGTM, committed to

[jira] [Updated] (YARN-10555) missing access check before getAppAttempts

[ https://issues.apache.org/jira/browse/YARN-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-10555: - Description: It seems that we miss a security check before getAppAttempts, see

[jira] [Comment Edited] (YARN-10295) CapacityScheduler NPE can cause apps to get stuck without resources

[ https://issues.apache.org/jira/browse/YARN-10295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261274#comment-17261274 ] Szilard Nemeth edited comment on YARN-10295 at 1/8/21, 12:25 PM: - Hi

[jira] [Updated] (YARN-10528) maxAMShare should only be accepted for leaf queues, not parent queues

[ https://issues.apache.org/jira/browse/YARN-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10528: -- Fix Version/s: 3.2.3 3.1.5 3.3.1 3.4.0

[jira] [Updated] (YARN-10555) missing access check before getAppAttempts

[ https://issues.apache.org/jira/browse/YARN-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-10555: - Description: It seems that we miss a security check before getAppAttempts, see

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261258#comment-17261258 ] Hadoop QA commented on YARN-10506: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10563) Fix dependency exclusion problem in poms

[ https://issues.apache.org/jira/browse/YARN-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10563: Attachment: YARN-10563-001.patch > Fix dependency exclusion problem in poms >

[jira] [Commented] (YARN-10295) CapacityScheduler NPE can cause apps to get stuck without resources

[ https://issues.apache.org/jira/browse/YARN-10295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261274#comment-17261274 ] Szilard Nemeth commented on YARN-10295: --- Hi @wangda, There's a dedicated jira to deal with test

[jira] [Comment Edited] (YARN-10295) CapacityScheduler NPE can cause apps to get stuck without resources

[ https://issues.apache.org/jira/browse/YARN-10295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261274#comment-17261274 ] Szilard Nemeth edited comment on YARN-10295 at 1/8/21, 12:24 PM: - Hi

[jira] [Updated] (YARN-10555) missing access check before getAppAttempts

[ https://issues.apache.org/jira/browse/YARN-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-10555: - Description: It seems that we miss a security check before getAppAttempts, see

[jira] [Updated] (YARN-10555) missing access check before getAppAttempts

[ https://issues.apache.org/jira/browse/YARN-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-10555: - Description: It seems that we miss a security check before getAppAttempts, see

[jira] [Commented] (YARN-10525) Add weight mode conversion to fs2cs

[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261308#comment-17261308 ] Hadoop QA commented on YARN-10525: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10264) Add container launch related env / classpath debug info to container logs when a container fails

[ https://issues.apache.org/jira/browse/YARN-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10264: -- Parent: YARN-10323 Issue Type: Sub-task (was: Task) > Add container launch related

[jira] [Updated] (YARN-10563) Fix dependency exclusion problem in poms

[ https://issues.apache.org/jira/browse/YARN-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10563: Description: Currently, {{hadoop-project/pom.xml}} contains a bunch of exclusions for

[jira] [Updated] (YARN-10563) Fix dependency exclusion problem in poms

[ https://issues.apache.org/jira/browse/YARN-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10563: Description: Currently, {{hadoop-project/pom.xml}} contains a bunch of exclusions for

[jira] [Commented] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261285#comment-17261285 ] Szilard Nemeth commented on YARN-10507: --- Thanks [~pbacsko] for working on this. Checked the latest

[jira] [Updated] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10507: -- Fix Version/s: 3.4.0 > Add the capability to fs2cs to write the converted placement rules

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10504: - Attachment: YARN-10504.004.patch > Implement weight mode in Capacity Scheduler >

[jira] [Updated] (YARN-10555) missing access check before getAppAttempts

[ https://issues.apache.org/jira/browse/YARN-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated YARN-10555: -- Labels: pull-request-available security (was: security) > missing access check before

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261259#comment-17261259 ] Andras Gyori commented on YARN-10506: - Added support for placementContexts. As of now, there are two

[jira] [Updated] (YARN-10555) missing access check before getAppAttempts

[ https://issues.apache.org/jira/browse/YARN-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-10555: - Description: It seems that we miss a security check before getAppAttempts, see

[jira] [Updated] (YARN-10555) missing access check before getAppAttempts

[ https://issues.apache.org/jira/browse/YARN-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-10555: - Description: It seems that we miss a security check before getAppAttempts, see

[jira] [Commented] (YARN-10427) Duplicate Job IDs in SLS output

[ https://issues.apache.org/jira/browse/YARN-10427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261287#comment-17261287 ] Szilard Nemeth commented on YARN-10427: --- Hi [~werd.up], I'm glad that you found it useful. >

[jira] [Updated] (YARN-10525) Add weight mode conversion to fs2cs

[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10525: Attachment: YARN-10525-002.patch > Add weight mode conversion to fs2cs >

[jira] [Updated] (YARN-10555) missing access check before getAppAttempts

[ https://issues.apache.org/jira/browse/YARN-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-10555: - Description: It seems that we miss a access check before getAppAttempts, see

[jira] [Updated] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] VADAGA ANANYO RAO updated YARN-10559: - Attachment: YARN-10559.0002.patch > Fair sharing intra-queue preemption support in

[jira] [Updated] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] VADAGA ANANYO RAO updated YARN-10559: - Attachment: (was: YARN-10559.0002.patch) > Fair sharing intra-queue preemption

[jira] [Updated] (YARN-10555) missing access check before getAppAttempts

[ https://issues.apache.org/jira/browse/YARN-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-10555: - Description: It seems that we miss a security check before getAppAttempts, see

[jira] [Updated] (YARN-10555) missing access check before getAppAttempts

[ https://issues.apache.org/jira/browse/YARN-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-10555: - Description: It seems that we miss a security check before getAppAttempts, see

[jira] [Commented] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261144#comment-17261144 ] Peter Bacsko commented on YARN-10507: - [~gandras] could you check it again? > Add the capability to

[jira] [Resolved] (YARN-10538) Add recommissioning nodes to the list of updated nodes returned to the AM

[ https://issues.apache.org/jira/browse/YARN-10538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin Chundatt resolved YARN-10538. --- Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Committed to trunk

[jira] [Commented] (YARN-10562) Alternate fix for DirectoryCollection.checkDirs() race

[ https://issues.apache.org/jira/browse/YARN-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261490#comment-17261490 ] Hadoop QA commented on YARN-10562: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261510#comment-17261510 ] Hadoop QA commented on YARN-10504: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10562) Alternate fix for DirectoryCollection.checkDirs() race

[ https://issues.apache.org/jira/browse/YARN-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261543#comment-17261543 ] Peter Bacsko commented on YARN-10562: - Thanks for the patch [~Jim_Brennan]. cc [~leftnoteasy]

[jira] [Updated] (YARN-10525) Add weight mode conversion to fs2cs

[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10525: Attachment: YARN-10525-003.patch > Add weight mode conversion to fs2cs >

[jira] [Commented] (YARN-10563) Fix dependency exclusion problem in poms

[ https://issues.apache.org/jira/browse/YARN-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261396#comment-17261396 ] Hadoop QA commented on YARN-10563: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10541) capture the performance metrics of ZKRMStateStore

[ https://issues.apache.org/jira/browse/YARN-10541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated YARN-10541: --- Fix Version/s: 3.3.1 > capture the performance metrics of ZKRMStateStore >

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261549#comment-17261549 ] Benjamin Teke commented on YARN-10504: -- Sharing my latest findings on 

[jira] [Commented] (YARN-10525) Add weight mode conversion to fs2cs

[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261472#comment-17261472 ] Hadoop QA commented on YARN-10525: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Resolved] (YARN-10541) capture the performance metrics of ZKRMStateStore

[ https://issues.apache.org/jira/browse/YARN-10541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved YARN-10541. Resolution: Fixed > capture the performance metrics of ZKRMStateStore >

[jira] [Assigned] (YARN-10541) capture the performance metrics of ZKRMStateStore

[ https://issues.apache.org/jira/browse/YARN-10541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned YARN-10541: -- Assignee: Max Xie > capture the performance metrics of ZKRMStateStore >

[jira] [Updated] (YARN-10541) capture the performance metrics of ZKRMStateStore

[ https://issues.apache.org/jira/browse/YARN-10541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated YARN-10541: --- Fix Version/s: 3.4.0 > capture the performance metrics of ZKRMStateStore >

[jira] [Updated] (YARN-10525) Add weight mode conversion to fs2cs

[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10525: Description: Weight mode will be added to Capacity Scheduler. Currently, we convert FS weights to

[jira] [Commented] (YARN-10562) Alternate fix for DirectoryCollection.checkDirs() race

[ https://issues.apache.org/jira/browse/YARN-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261403#comment-17261403 ] Jim Brennan commented on YARN-10562: patch 003 fixes the new checkstyle issues. > Alternate fix for

[jira] [Updated] (YARN-10562) Alternate fix for DirectoryCollection.checkDirs() race

[ https://issues.apache.org/jira/browse/YARN-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10562: --- Attachment: YARN-10562.003.patch > Alternate fix for DirectoryCollection.checkDirs() race >

[jira] [Commented] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261335#comment-17261335 ] Hadoop QA commented on YARN-10559: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10504: - Attachment: YARN-10504.005.patch > Implement weight mode in Capacity Scheduler >

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261381#comment-17261381 ] Benjamin Teke commented on YARN-10504: -- Hey [~zhuqi], Thanks for your updates. Took the liberty to

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261718#comment-17261718 ] zhuqi commented on YARN-10532: -- [~wangda] [~gandras] The patch is based original capacity auto creation,

[jira] [Resolved] (YARN-10553) Refactor TestDistributedShell

[ https://issues.apache.org/jira/browse/YARN-10553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved YARN-10553. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Refactor

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261774#comment-17261774 ] Wangda Tan commented on YARN-10504: --- 1) AbstractCSQueue, lots of format changes, can we revert all