[jira] [Commented] (YARN-10903) Too many "Failed to accept allocation proposal" because of wrong Headroom check for DRF

2021-09-08 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412281#comment-17412281 ] Tao Yang commented on YARN-10903: - Thanks [~jackwangcs] for raising this issue, which may generate

[jira] [Commented] (YARN-10909) AbstractCSQueue: Check for methods added for test code but not annotated with VisibleForTesting

2021-09-08 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412303#comment-17412303 ] Tao Yang commented on YARN-10909: - Hi, [~jackwangcs]. VisibleForTesting annotation can be used for the

[jira] [Updated] (YARN-10934) LeafQueue activateApplications NPE

2021-09-08 Thread Yuan Luo (Jira)
[ https://issues.apache.org/jira/browse/YARN-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-10934: Attachment: RM-capacity-scheduler.xml RM-yarn-site.xml > LeafQueue activateApplications

[jira] [Comment Edited] (YARN-10934) LeafQueue activateApplications NPE

2021-09-08 Thread Yuan Luo (Jira)
[ https://issues.apache.org/jira/browse/YARN-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411636#comment-17411636 ] Yuan Luo edited comment on YARN-10934 at 9/8/21, 7:26 AM: -- [~snemeth] Thanks for

[jira] [Updated] (YARN-10934) LeafQueue activateApplications NPE

2021-09-08 Thread Yuan Luo (Jira)
[ https://issues.apache.org/jira/browse/YARN-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-10934: Attachment: (was: RM-capacity-scheduler.xml) > LeafQueue activateApplications NPE >

[jira] [Updated] (YARN-10934) LeafQueue activateApplications NPE

2021-09-08 Thread Yuan Luo (Jira)
[ https://issues.apache.org/jira/browse/YARN-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-10934: Attachment: RM-capacity-scheduler.xml > LeafQueue activateApplications NPE >

[jira] [Updated] (YARN-10934) LeafQueue activateApplications NPE

2021-09-08 Thread Yuan Luo (Jira)
[ https://issues.apache.org/jira/browse/YARN-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-10934: Attachment: (was: RM-capacity-scheduler.xml) > LeafQueue activateApplications NPE >

[jira] [Updated] (YARN-10934) LeafQueue activateApplications NPE

2021-09-08 Thread Yuan Luo (Jira)
[ https://issues.apache.org/jira/browse/YARN-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-10934: Attachment: RM-capacity-scheduler.xml > LeafQueue activateApplications NPE >

[jira] [Updated] (YARN-10914) Simplify duplicated code for tracking ResourceUsage in AbstractCSQueue

2021-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/YARN-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated YARN-10914: -- Labels: pull-request-available (was: ) > Simplify duplicated code for tracking ResourceUsage

[jira] [Commented] (YARN-10929) Refrain from creating new Configuration object in AbstractManagedParentQueue#initializeLeafQueueConfigs

2021-09-08 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411903#comment-17411903 ] Szilard Nemeth commented on YARN-10929: --- Hi [~jackwangcs], Please try again, I modified your

[jira] [Updated] (YARN-10576) Update Capacity Scheduler documentation with JSON-based placement mapping

2021-09-08 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10576: -- Summary: Update Capacity Scheduler documentation with JSON-based placement mapping (was:

[jira] [Updated] (YARN-10693) Add documentation for YARN-10623 auto refresh queue conf in CS

2021-09-08 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10693: -- Summary: Add documentation for YARN-10623 auto refresh queue conf in CS (was: Add document

[jira] [Updated] (YARN-10870) Missing user filtering check -> yarn.webapp.filter-entity-list-by-user for RM Scheduler page

2021-09-08 Thread Jira
[ https://issues.apache.org/jira/browse/YARN-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollák updated YARN-10870: -- Attachment: YARN-10870.002.patch > Missing user filtering check ->

[jira] [Commented] (YARN-10576) Update Capacity Scheduler documentation with JSON-based placement mapping

2021-09-08 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411925#comment-17411925 ] Szilard Nemeth commented on YARN-10576: --- Hi [~bteke], Thanks for working on this. The PR looks

[jira] [Updated] (YARN-10522) Document for Flexible Auto Queue Creation in Capacity Scheduler

2021-09-08 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10522: -- Fix Version/s: 3.4.0 > Document for Flexible Auto Queue Creation in Capacity Scheduler >

[jira] [Updated] (YARN-10693) Add documentation for YARN-10623 auto refresh queue conf in CS

2021-09-08 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10693: -- Fix Version/s: 3.4.0 > Add documentation for YARN-10623 auto refresh queue conf in CS >

[jira] [Updated] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

2021-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated YARN-10623: -- Labels: pull-request-available (was: ) > Capacity scheduler should support refresh queue

[jira] [Commented] (YARN-10870) Missing user filtering check -> yarn.webapp.filter-entity-list-by-user for RM Scheduler page

2021-09-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411891#comment-17411891 ] Hadoop QA commented on YARN-10870: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10576) Update Capacity Scheduler documentation with JSON-based placement mapping

2021-09-08 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10576: -- Fix Version/s: 3.4.0 > Update Capacity Scheduler documentation with JSON-based placement

[jira] [Resolved] (YARN-10496) [Umbrella] Support Flexible Auto Queue Creation in Capacity Scheduler

2021-09-08 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke resolved YARN-10496. -- Resolution: Fixed > [Umbrella] Support Flexible Auto Queue Creation in Capacity Scheduler >

[jira] [Updated] (YARN-10646) TestCapacitySchedulerWeightMode test descriptor comments doesn't reflect the correct scenario

2021-09-08 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10646: -- Fix Version/s: 3.4.0 > TestCapacitySchedulerWeightMode test descriptor comments doesn't

[jira] [Assigned] (YARN-10903) Too many "Failed to accept allocation proposal" because of wrong Headroom check for DRF

2021-09-08 Thread jackwangcs (Jira)
[ https://issues.apache.org/jira/browse/YARN-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jackwangcs reassigned YARN-10903: - Assignee: jackwangcs > Too many "Failed to accept allocation proposal" because of wrong

[jira] [Assigned] (YARN-10902) Resources on application blacklisted node with reserved container can not allocate to other applications

2021-09-08 Thread jackwangcs (Jira)
[ https://issues.apache.org/jira/browse/YARN-10902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jackwangcs reassigned YARN-10902: - Assignee: jackwangcs > Resources on application blacklisted node with reserved container can

[jira] [Commented] (YARN-10903) Too many "Failed to accept allocation proposal" because of wrong Headroom check for DRF

2021-09-08 Thread jackwangcs (Jira)
[ https://issues.apache.org/jira/browse/YARN-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411977#comment-17411977 ] jackwangcs commented on YARN-10903: --- Hi [~gandras] [~bteke] [~snemeth], could you help to review this

[jira] [Updated] (YARN-10901) Permission checking error on an existing directory in LogAggregationFileController#verifyAndCreateRemoteLogDir

2021-09-08 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10901: -- Fix Version/s: 3.4.0 > Permission checking error on an existing directory in >

[jira] [Commented] (YARN-10870) Missing user filtering check -> yarn.webapp.filter-entity-list-by-user for RM Scheduler page

2021-09-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411994#comment-17411994 ] Hadoop QA commented on YARN-10870: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9975) Support proxy ACL user for CapacityScheduler

2021-09-08 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412002#comment-17412002 ] Szilard Nemeth commented on YARN-9975: -- Hey [~epayne], Sorry for the late response. Thanks for

[jira] [Updated] (YARN-10919) Remove LeafQueue#scheduler field

2021-09-08 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10919: -- Fix Version/s: 3.4.0 > Remove LeafQueue#scheduler field > - >

[jira] [Commented] (YARN-10919) Remove LeafQueue#scheduler field

2021-09-08 Thread jackwangcs (Jira)
[ https://issues.apache.org/jira/browse/YARN-10919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411972#comment-17411972 ] jackwangcs commented on YARN-10919: --- Sure, thanks for your reminder, I will ask the owner next time. >

[jira] [Assigned] (YARN-9048) Add znode hierarchy in Federation ZK State Store

2021-09-08 Thread jackwangcs (Jira)
[ https://issues.apache.org/jira/browse/YARN-9048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jackwangcs reassigned YARN-9048: Assignee: jackwangcs > Add znode hierarchy in Federation ZK State Store >

[jira] [Assigned] (YARN-9048) Add znode hierarchy in Federation ZK State Store

2021-09-08 Thread jackwangcs (Jira)
[ https://issues.apache.org/jira/browse/YARN-9048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jackwangcs reassigned YARN-9048: Assignee: (was: jackwangcs) > Add znode hierarchy in Federation ZK State Store >

[jira] [Commented] (YARN-9975) Support proxy ACL user for CapacityScheduler

2021-09-08 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412023#comment-17412023 ] Szilard Nemeth commented on YARN-9975: -- [~epayne], Just committed HADOOP-17857. Can you confirm that

[jira] [Assigned] (YARN-10929) Refrain from creating new Configuration object in AbstractManagedParentQueue#initializeLeafQueueConfigs

2021-09-08 Thread jackwangcs (Jira)
[ https://issues.apache.org/jira/browse/YARN-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jackwangcs reassigned YARN-10929: - Assignee: jackwangcs > Refrain from creating new Configuration object in >

[jira] [Resolved] (YARN-10901) Permission checking error on an existing directory in LogAggregationFileController#verifyAndCreateRemoteLogDir

2021-09-08 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth resolved YARN-10901. --- Hadoop Flags: Reviewed Resolution: Fixed > Permission checking error on an existing

[jira] [Assigned] (YARN-10909) AbstractCSQueue: Check for methods added for test code but not annotated with VisibleForTesting

2021-09-08 Thread jackwangcs (Jira)
[ https://issues.apache.org/jira/browse/YARN-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jackwangcs reassigned YARN-10909: - Assignee: jackwangcs > AbstractCSQueue: Check for methods added for test code but not annotated

[jira] [Updated] (YARN-10910) AbstractCSQueue#setupQueueConfigs: Separate validation logic from initialization logic

2021-09-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/YARN-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated YARN-10910: -- Labels: pull-request-available (was: ) > AbstractCSQueue#setupQueueConfigs: Separate

[jira] [Assigned] (YARN-10893) Add metrics for getClusterMetrics and getApplications APIs in FederationClientInterceptor

2021-09-08 Thread Jira
[ https://issues.apache.org/jira/browse/YARN-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned YARN-10893: -- Assignee: Akshat Bordia > Add metrics for getClusterMetrics and getApplications APIs in >

[jira] [Reopened] (YARN-10870) Missing user filtering check -> yarn.webapp.filter-entity-list-by-user for RM Scheduler page

2021-09-08 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reopened YARN-10870: --- Reopening jira, as we discussed [~shuzirra] will upload backport patches for 3.3 / 3.2

[jira] [Updated] (YARN-10870) Missing user filtering check -> yarn.webapp.filter-entity-list-by-user for RM Scheduler page

2021-09-08 Thread Jira
[ https://issues.apache.org/jira/browse/YARN-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollák updated YARN-10870: -- Attachment: YARN-10870.branch-3.2.001.patch > Missing user filtering check ->

[jira] [Updated] (YARN-10870) Missing user filtering check -> yarn.webapp.filter-entity-list-by-user for RM Scheduler page

2021-09-08 Thread Jira
[ https://issues.apache.org/jira/browse/YARN-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollák updated YARN-10870: -- Attachment: YARN-10870.branch-3.3.002.patch > Missing user filtering check ->

[jira] [Updated] (YARN-10870) Missing user filtering check -> yarn.webapp.filter-entity-list-by-user for RM Scheduler page

2021-09-08 Thread Jira
[ https://issues.apache.org/jira/browse/YARN-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollák updated YARN-10870: -- Attachment: YARN-10870.branch-3.2.002.patch YARN-10870.branch-3.1.002.patch >

[jira] [Updated] (YARN-10870) Missing user filtering check -> yarn.webapp.filter-entity-list-by-user for RM Scheduler page

2021-09-08 Thread Jira
[ https://issues.apache.org/jira/browse/YARN-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollák updated YARN-10870: -- Attachment: (was: YARN-10870.branch-3.2.001.patch) > Missing user filtering check ->

[jira] [Commented] (YARN-10870) Missing user filtering check -> yarn.webapp.filter-entity-list-by-user for RM Scheduler page

2021-09-08 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412039#comment-17412039 ] Szilard Nemeth commented on YARN-10870: --- Thanks [~shuzirra] for working on this. Latest patch LGTM,

[jira] [Updated] (YARN-10870) Missing user filtering check -> yarn.webapp.filter-entity-list-by-user for RM Scheduler page

2021-09-08 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10870: -- Fix Version/s: 3.4.0 > Missing user filtering check -> yarn.webapp.filter-entity-list-by-user

[jira] [Commented] (YARN-10870) Missing user filtering check -> yarn.webapp.filter-entity-list-by-user for RM Scheduler page

2021-09-08 Thread Jira
[ https://issues.apache.org/jira/browse/YARN-10870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412085#comment-17412085 ] Gergely Pollák commented on YARN-10870: --- The patch apply cleanly to 3.1, 3.2 and 3.3 (and yes I