[jira] [Commented] (YARN-10767) Yarn Logs Command retrying on Standby RM for 30 times

2021-06-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355955#comment-17355955 ] Jim Brennan commented on YARN-10767: [~dmmkr], [~BilwaST], I am not familiar with the RM HA code, so

[jira] [Commented] (YARN-10801) Fix Auto Queue template to properly set all configuration properties

2021-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355941#comment-17355941 ] Hadoop QA commented on YARN-10801: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355919#comment-17355919 ] Hadoop QA commented on YARN-10796: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-10801) Fix Auto Queue template to properly set all configuration properties

2021-06-02 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10801: Attachment: YARN-10801.002.patch > Fix Auto Queue template to properly set all configuration

[jira] [Commented] (YARN-10780) Optimise retrieval of configured node labels in CS queues

2021-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355823#comment-17355823 ] Hadoop QA commented on YARN-10780: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-02 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355820#comment-17355820 ] Benjamin Teke commented on YARN-10796: -- [~pbacsko] the latest patch looks good to me, +1

[jira] [Updated] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10796: Attachment: YARN-10796-003.patch > Capacity Scheduler: dynamic queue cannot scale out properly if

[jira] [Commented] (YARN-10801) Fix Auto Queue template to properly set all configuration properties

2021-06-02 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355812#comment-17355812 ] Benjamin Teke commented on YARN-10801: -- [~gandras] thanks for working on this! An idea for the

[jira] [Commented] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-02 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355805#comment-17355805 ] Andras Gyori commented on YARN-10796: - [~pbacsko] I agree that this is the correct behaviour and

[jira] [Comment Edited] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355804#comment-17355804 ] Peter Bacsko edited comment on YARN-10796 at 6/2/21, 3:32 PM: -- [~gandras] 

[jira] [Commented] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355804#comment-17355804 ] Peter Bacsko commented on YARN-10796: - [~gandras] this is a valid concern. Question is, do we accept

[jira] [Comment Edited] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355804#comment-17355804 ] Peter Bacsko edited comment on YARN-10796 at 6/2/21, 3:28 PM: -- [~gandras] 

[jira] [Commented] (YARN-10780) Optimise retrieval of configured node labels in CS queues

2021-06-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355796#comment-17355796 ] Peter Bacsko commented on YARN-10780: - Ok, I went through the patch. I'm not saying that I have 100%

[jira] [Commented] (YARN-10522) Document for Flexible Auto Queue Creation in Capacity Scheduler.

2021-06-02 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355784#comment-17355784 ] Benjamin Teke commented on YARN-10522: -- [~akumar] do you plan to work on this? If not can I take it

[jira] [Commented] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-02 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355783#comment-17355783 ] Andras Gyori commented on YARN-10796: - Thanks [~pbacsko] for the patch and for creating a unit test

[jira] [Created] (YARN-10802) Change Capacity Scheduler minimum-user-limit-percent to accept decimal values

2021-06-02 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10802: Summary: Change Capacity Scheduler minimum-user-limit-percent to accept decimal values Key: YARN-10802 URL: https://issues.apache.org/jira/browse/YARN-10802 Project:

[jira] [Commented] (YARN-10780) Optimise retrieval of configured node labels in CS queues

2021-06-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355775#comment-17355775 ] Peter Bacsko commented on YARN-10780: - There are a lot of NPE at {{serviceStop()}}, [~gandras] could

[jira] [Commented] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355771#comment-17355771 ] Peter Bacsko commented on YARN-10796: - Thanks [~bteke], this makes sense. > Capacity Scheduler:

[jira] [Comment Edited] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-02 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355758#comment-17355758 ] Benjamin Teke edited comment on YARN-10796 at 6/2/21, 2:15 PM: --- [~pbacsko]

[jira] [Commented] (YARN-10797) Logging parameter issues in scheduler package

2021-06-02 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355759#comment-17355759 ] Szilard Nemeth commented on YARN-10797: --- Thanks [~shuzirra]. Congrats for the first committed

[jira] [Commented] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-02 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355758#comment-17355758 ] Benjamin Teke commented on YARN-10796: -- [~pbacsko] thanks for the patch. One small thing: since the

[jira] [Commented] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355720#comment-17355720 ] Peter Bacsko commented on YARN-10796: - [~bteke], [~gandras], [~snemeth] could you review this please?

[jira] [Commented] (YARN-4783) Log aggregation failure for application when Nodemanager is restarted

2021-06-02 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-4783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355707#comment-17355707 ] Andras Gyori commented on YARN-4783: I think this fix does not worth the risk it might impose. I

[jira] [Updated] (YARN-10780) Optimise retrieval of configured node labels in CS queues

2021-06-02 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10780: Attachment: YARN-10780.002.patch > Optimise retrieval of configured node labels in CS queues >

[jira] [Commented] (YARN-10801) Fix Auto Queue template to properly set all configuration properties

2021-06-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355683#comment-17355683 ] Hadoop QA commented on YARN-10801: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10767) Yarn Logs Command retrying on Standby RM for 30 times

2021-06-02 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355634#comment-17355634 ] Bilwa S T commented on YARN-10767: -- Hi [~dmmkr] Thanks for patch. I have one minor comment: *

[jira] [Updated] (YARN-10801) Fix Auto Queue template to properly set all configuration properties

2021-06-02 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10801: Attachment: (was: YARN-10801.001.patch) > Fix Auto Queue template to properly set all

[jira] [Updated] (YARN-10801) Fix Auto Queue template to properly set all configuration properties

2021-06-02 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10801: Attachment: YARN-10801.001.patch > Fix Auto Queue template to properly set all configuration

[jira] [Updated] (YARN-10801) Fix Auto Queue template to properly set all configuration properties

2021-06-02 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10801: Parent: YARN-10496 Issue Type: Sub-task (was: Bug) > Fix Auto Queue template to properly