[jira] [Created] (YARN-10657) We should make max application per queue to support node label.

2021-02-26 Thread Qi Zhu (Jira)
Qi Zhu created YARN-10657: - Summary: We should make max application per queue to support node label. Key: YARN-10657 URL: https://issues.apache.org/jira/browse/YARN-10657 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-10641) Refactor the max app related update, and fix maxApllications update error when add new queues.

2021-02-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292017#comment-17292017 ] Qi Zhu commented on YARN-10641: --- Thanks [~gandras] for patient review.:D As i added in the todo things,  i

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292016#comment-17292016 ] Qi Zhu commented on YARN-10532: --- Thanks  [~pbacsko] for patient review.:D Waiting for [~gandras]

[jira] [Commented] (YARN-10627) Extend logging to give more information about weight mode

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291919#comment-17291919 ] Peter Bacsko commented on YARN-10627: - Thanks for the patch [~bteke] and [~zhuqi] / [~gandras] for

[jira] [Updated] (YARN-10653) Fixed the findbugs issues introduced by YARN-10647.

2021-02-26 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-10653: --- Fix Version/s: 3.2.3 3.1.5 3.3.1 3.4.0 >

[jira] [Updated] (YARN-10653) Fixed the findbugs issues introduced by YARN-10647.

2021-02-26 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-10653: --- Thanks for the patch, [~zhuqi], and apologies again for my mistake on the previous JIRA. I have

[jira] [Commented] (YARN-10627) Extend logging to give more information about weight mode

2021-02-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291897#comment-17291897 ] Hadoop QA commented on YARN-10627: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10640) Adjust the queue Configured capacity to Configured weight number for weight mode in UI.

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291894#comment-17291894 ] Peter Bacsko commented on YARN-10640: - [~zhuqi] thanks for the patch, it's useful. There is one

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291889#comment-17291889 ] Peter Bacsko commented on YARN-10532: - [~zhuqi] I think it's very good now. Maybe I'll check another

[jira] [Commented] (YARN-10656) Parsing error in CapacityScheduler.md

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291886#comment-17291886 ] Peter Bacsko commented on YARN-10656: - Thanks [~aajisaka] for noticing this. I should have tried it

[jira] [Commented] (YARN-10653) Fixed the findbugs issues introduced by YARN-10647.

2021-02-26 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291877#comment-17291877 ] Eric Badger commented on YARN-10653: Ahhh ok I see it now. The findbugs error is in "trunk Compile

[jira] [Commented] (YARN-10656) Parsing error in CapacityScheduler.md

2021-02-26 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291850#comment-17291850 ] Akira Ajisaka commented on YARN-10656: -- Hi [~pbacsko], would you check

[jira] [Assigned] (YARN-10656) Parsing error in CapacityScheduler.md

2021-02-26 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned YARN-10656: Assignee: Akira Ajisaka > Parsing error in CapacityScheduler.md >

[jira] [Updated] (YARN-10656) Parsing error in CapacityScheduler.md

2021-02-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/YARN-10656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated YARN-10656: -- Labels: pull-request-available (was: ) > Parsing error in CapacityScheduler.md >

[jira] [Commented] (YARN-10656) Parsing error in CapacityScheduler.md

2021-02-26 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291846#comment-17291846 ] Akira Ajisaka commented on YARN-10656: -- How to reproduce: {noformat} $ ./start-build-env.sh $ mvn

[jira] [Created] (YARN-10656) Parsing error in CapacityScheduler.md

2021-02-26 Thread Akira Ajisaka (Jira)
Akira Ajisaka created YARN-10656: Summary: Parsing error in CapacityScheduler.md Key: YARN-10656 URL: https://issues.apache.org/jira/browse/YARN-10656 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-10627) Extend logging to give more information about weight mode

2021-02-26 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10627: - Attachment: YARN-10627.006.patch > Extend logging to give more information about weight mode >

[jira] [Commented] (YARN-10627) Extend logging to give more information about weight mode

2021-02-26 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291759#comment-17291759 ] Benjamin Teke commented on YARN-10627: -- [~pbacsko] sure, fixed it. > Extend logging to give more

[jira] [Comment Edited] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291728#comment-17291728 ] Peter Bacsko edited comment on YARN-10623 at 2/26/21, 4:10 PM: --- Thanks

[jira] [Commented] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291728#comment-17291728 ] Peter Bacsko commented on YARN-10623: - Thanks [~zhuqi] for the update. I missed a couple of things in

[jira] [Commented] (YARN-10627) Extend logging to give more information about weight mode

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291718#comment-17291718 ] Peter Bacsko commented on YARN-10627: - Thanks for the patch [~bteke], could you take care of those

[jira] [Commented] (YARN-10641) Refactor the max app related update, and fix maxApllications update error when add new queues.

2021-02-26 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291708#comment-17291708 ] Andras Gyori commented on YARN-10641: - Hi [~zhuqi], thank you for the patch. I always like the idea

[jira] [Commented] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291657#comment-17291657 ] Andras Gyori commented on YARN-10652: - When I first saw this issue, I implicitly thought about the

[jira] [Created] (YARN-10655) Limit queue creation depth relative to its first static parent

2021-02-26 Thread Andras Gyori (Jira)
Andras Gyori created YARN-10655: --- Summary: Limit queue creation depth relative to its first static parent Key: YARN-10655 URL: https://issues.apache.org/jira/browse/YARN-10655 Project: Hadoop YARN

[jira] [Comment Edited] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291628#comment-17291628 ] Siddharth Ahuja edited comment on YARN-10652 at 2/26/21, 1:01 PM: --

[jira] [Commented] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291628#comment-17291628 ] Siddharth Ahuja commented on YARN-10652: Thanks [~pbacsko] for confirming that this issue has no

[jira] [Commented] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291614#comment-17291614 ] Gergely Pollak commented on YARN-10652: --- The problem here is the consistency. There are multiple

[jira] [Comment Edited] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291612#comment-17291612 ] Peter Bacsko edited comment on YARN-10652 at 2/26/21, 12:26 PM: [~sahuja]

[jira] [Commented] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291612#comment-17291612 ] Peter Bacsko commented on YARN-10652: - [~sahuja] you're right in saying that it has no direct

[jira] [Comment Edited] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291595#comment-17291595 ] Siddharth Ahuja edited comment on YARN-10652 at 2/26/21, 11:53 AM: ---

[jira] [Commented] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

2021-02-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291601#comment-17291601 ] Hadoop QA commented on YARN-10623: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291595#comment-17291595 ] Siddharth Ahuja edited comment on YARN-10652 at 2/26/21, 11:49 AM: ---

[jira] [Comment Edited] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291595#comment-17291595 ] Siddharth Ahuja edited comment on YARN-10652 at 2/26/21, 11:47 AM: ---

[jira] [Commented] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291595#comment-17291595 ] Siddharth Ahuja commented on YARN-10652: Also, yarn.scheduler.capacity..user-settings..weight

[jira] [Comment Edited] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291583#comment-17291583 ] Siddharth Ahuja edited comment on YARN-10652 at 2/26/21, 11:27 AM: ---

[jira] [Comment Edited] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291583#comment-17291583 ] Siddharth Ahuja edited comment on YARN-10652 at 2/26/21, 11:25 AM: ---

[jira] [Comment Edited] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291583#comment-17291583 ] Siddharth Ahuja edited comment on YARN-10652 at 2/26/21, 11:24 AM: ---

[jira] [Commented] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291583#comment-17291583 ] Siddharth Ahuja commented on YARN-10652: Thanks [~rreti] & [~pbacsko] for your comments. However,

[jira] [Created] (YARN-10654) Dots '.' in CSMappingRule path variables should be replaced

2021-02-26 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10654: - Summary: Dots '.' in CSMappingRule path variables should be replaced Key: YARN-10654 URL: https://issues.apache.org/jira/browse/YARN-10654 Project: Hadoop YARN

[jira] [Commented] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291572#comment-17291572 ] Peter Bacsko commented on YARN-10652: - "Dot" in the username is clearly a problem. In FS, there is

[jira] [Commented] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Rudolf Reti (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291563#comment-17291563 ] Rudolf Reti commented on YARN-10652: [~pbacsko] & [~shuzirra] Can you please check this from a

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291515#comment-17291515 ] Qi Zhu commented on YARN-10532: --- [~pbacsko] [~gandras] The test is not related, if you have any other

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291497#comment-17291497 ] Hadoop QA commented on YARN-10532: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

2021-02-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291457#comment-17291457 ] Qi Zhu commented on YARN-10623: --- Fixed the checkstyle in latest patch. > Capacity scheduler should support

[jira] [Updated] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

2021-02-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10623: -- Attachment: YARN-10623.005.patch > Capacity scheduler should support refresh queue automatically by a thread