[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2020-12-11 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248297#comment-17248297 ] zhuqi commented on YARN-10531: -- [~wangda]  [~pbacsko] [~tangzhankun] I submit a patch to disable user limit

[jira] [Comment Edited] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2020-12-11 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248297#comment-17248297 ] zhuqi edited comment on YARN-10531 at 12/12/20, 6:14 AM: - [~wangda]  [~pbacsko]

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2020-12-11 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248263#comment-17248263 ] Hadoop QA commented on YARN-10506: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2020-12-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248261#comment-17248261 ] Wangda Tan commented on YARN-10506: --- Uploaded a patch, which is based on YARN-10504. It has done the

[jira] [Assigned] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2020-12-11 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi reassigned YARN-10531: Assignee: zhuqi > Be able to disable user limit factor for CapacityScheduler Leaf Queue >

[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2020-12-11 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248260#comment-17248260 ] zhuqi commented on YARN-10531: -- [~wangda] I'm glad to take this. Thanks. > Be able to disable user limit

[jira] [Updated] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2020-12-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10506: -- Attachment: YARN-10506.001.patch > Update queue creation logic to use weight mode and allow the

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2020-12-11 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248194#comment-17248194 ] Hadoop QA commented on YARN-10504: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10494) CLI tool for docker-to-squashfs conversion (pure Java)

2020-12-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248173#comment-17248173 ] Jim Brennan commented on YARN-10494: [~ccondit], [~ebadger] I am OK with including this for now.  >

[jira] [Created] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2020-12-11 Thread Wangda Tan (Jira)
Wangda Tan created YARN-10532: - Summary: Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used Key: YARN-10532 URL: https://issues.apache.org/jira/browse/YARN-10532

[jira] [Commented] (YARN-10526) RMAppManager CS Placement ignores parent path

2020-12-11 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248161#comment-17248161 ] Hadoop QA commented on YARN-10526: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2020-12-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248149#comment-17248149 ] Wangda Tan commented on YARN-10531: --- [~zhuqi] do you want to take a try on this one? Thanks, > Be

[jira] [Created] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2020-12-11 Thread Wangda Tan (Jira)
Wangda Tan created YARN-10531: - Summary: Be able to disable user limit factor for CapacityScheduler Leaf Queue Key: YARN-10531 URL: https://issues.apache.org/jira/browse/YARN-10531 Project: Hadoop YARN

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

2020-12-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.ver-3.patch > Implement weight mode in Capacity Scheduler >

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2020-12-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248114#comment-17248114 ] Wangda Tan commented on YARN-10504: --- [~zhuqi], thank you so much for your review. [~bteke] will take

[jira] [Commented] (YARN-10530) CapacityScheduler ResourceLimits doesn't handle node partition well

2020-12-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248087#comment-17248087 ] Wangda Tan commented on YARN-10530: --- I haven't written any UT yet, but I just want to file the ticket

[jira] [Commented] (YARN-10530) CapacityScheduler ResourceLimits doesn't handle node partition well

2020-12-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248084#comment-17248084 ] Wangda Tan commented on YARN-10530: --- cc: [~sunilg], [~epayne] > CapacityScheduler ResourceLimits

[jira] [Updated] (YARN-10529) The attempt id displayed on the graph-view tab in the YARN-UI2 page is wrong

2020-12-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/YARN-10529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated YARN-10529: -- Labels: pull-request-available (was: ) > The attempt id displayed on the graph-view tab in

[jira] [Updated] (YARN-10529) The attempt id displayed on the graph-view tab in the YARN-UI2 page is wrong

2020-12-11 Thread akiyamaneko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] akiyamaneko updated YARN-10529: --- Attachment: Grid View ApptemptID shows Ok.png > The attempt id displayed on the graph-view tab in

[jira] [Updated] (YARN-10529) The attempt id displayed on the graph-view tab in the YARN-UI2 page is wrong

2020-12-11 Thread akiyamaneko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] akiyamaneko updated YARN-10529: --- Attachment: (was: Graph View ApptemptID shows ok.png) > The attempt id displayed on the

[jira] [Created] (YARN-10529) The attempt id displayed on the graph-view tab in the YARN-UI2 page is wrong

2020-12-11 Thread akiyamaneko (Jira)
akiyamaneko created YARN-10529: -- Summary: The attempt id displayed on the graph-view tab in the YARN-UI2 page is wrong Key: YARN-10529 URL: https://issues.apache.org/jira/browse/YARN-10529 Project:

[jira] [Created] (YARN-10530) CapacityScheduler ResourceLimits doesn't handle node partition well

2020-12-11 Thread Wangda Tan (Jira)
Wangda Tan created YARN-10530: - Summary: CapacityScheduler ResourceLimits doesn't handle node partition well Key: YARN-10530 URL: https://issues.apache.org/jira/browse/YARN-10530 Project: Hadoop YARN

[jira] [Updated] (YARN-10526) RMAppManager CS Placement ignores parent path

2020-12-11 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10526: -- Attachment: YARN-10526.003.patch > RMAppManager CS Placement ignores parent path >

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2020-12-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248048#comment-17248048 ] Wangda Tan commented on YARN-10506: --- I'm looking at PoC of the patch now, and will keep the JIRA

[jira] [Commented] (YARN-10526) RMAppManager CS Placement ignores parent path

2020-12-11 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247980#comment-17247980 ] Hadoop QA commented on YARN-10526: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Issue Comment Deleted] (YARN-10169) Mixed absolute resource value and percentage-based resource value in CapacityScheduler should fail

2020-12-11 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10169: - Comment: was deleted (was: [~leftnoteasy] I look into the source code, and test locally, we allow the scheduler

[jira] [Commented] (YARN-10169) Mixed absolute resource value and percentage-based resource value in CapacityScheduler should fail

2020-12-11 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247954#comment-17247954 ] zhuqi commented on YARN-10169: -- [~leftnoteasy] I look into the source code, and test locally, we allow the 

[jira] [Updated] (YARN-10528) maxAMShare should only be accepted for leaf queues, not parent queues

2020-12-11 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Ahuja updated YARN-10528: --- Description: Based on [Hadoop

[jira] [Updated] (YARN-10528) maxAMShare should only be accepted for leaf queues, not parent queues

2020-12-11 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Ahuja updated YARN-10528: --- Attachment: maxAMShare for root.users (parent queue) has no effect as child queue does not

[jira] [Assigned] (YARN-10528) maxAMShare should only be accepted for leaf queues, not parent queues

2020-12-11 Thread Siddharth Ahuja (Jira)
[ https://issues.apache.org/jira/browse/YARN-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Ahuja reassigned YARN-10528: -- Assignee: Siddharth Ahuja > maxAMShare should only be accepted for leaf queues, not

[jira] [Created] (YARN-10528) maxAMShare should only be accepted for leaf queues, not parent queues

2020-12-11 Thread Siddharth Ahuja (Jira)
Siddharth Ahuja created YARN-10528: -- Summary: maxAMShare should only be accepted for leaf queues, not parent queues Key: YARN-10528 URL: https://issues.apache.org/jira/browse/YARN-10528 Project:

[jira] [Updated] (YARN-10526) RMAppManager CS Placement ignores parent path

2020-12-11 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10526: -- Attachment: YARN-10526.002.patch > RMAppManager CS Placement ignores parent path >

[jira] [Commented] (YARN-10031) Create a general purpose log request with additional query parameters

2020-12-11 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247906#comment-17247906 ] Adam Antal commented on YARN-10031: --- Thanks [~gandras]! LGTM. If there's no other reviews, I will

[jira] [Commented] (YARN-10031) Create a general purpose log request with additional query parameters

2020-12-11 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247884#comment-17247884 ] Hadoop QA commented on YARN-10031: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-1890) Too many unnecessary logs are logged while accessing applicationMaster web UI.

2020-12-11 Thread akiyamaneko (Jira)
[ https://issues.apache.org/jira/browse/YARN-1890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247874#comment-17247874 ] akiyamaneko commented on YARN-1890: --- [~rohithsharma]d Hello, we use hadopo3.1.1+spark3.0.1, this problem

[jira] [Commented] (YARN-4783) Log aggregation failure for application when Nodemanager is restarted

2020-12-11 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-4783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247862#comment-17247862 ] Hadoop QA commented on YARN-4783: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4783) Log aggregation failure for application when Nodemanager is restarted

2020-12-11 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-4783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247844#comment-17247844 ] Hadoop QA commented on YARN-4783: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-10504) Implement weight mode in Capacity Scheduler

2020-12-11 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke reassigned YARN-10504: Assignee: Benjamin Teke (was: zhuqi) > Implement weight mode in Capacity Scheduler >

[jira] [Updated] (YARN-4783) Log aggregation failure for application when Nodemanager is restarted

2020-12-11 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-4783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-4783: --- Attachment: YARN-4783.006.patch > Log aggregation failure for application when Nodemanager is

[jira] [Updated] (YARN-4783) Log aggregation failure for application when Nodemanager is restarted

2020-12-11 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-4783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-4783: --- Attachment: (was: YARN-4783.005.patch) > Log aggregation failure for application when Nodemanager

[jira] [Updated] (YARN-4783) Log aggregation failure for application when Nodemanager is restarted

2020-12-11 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-4783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-4783: --- Attachment: YARN-4783.005.patch > Log aggregation failure for application when Nodemanager is

[jira] [Comment Edited] (YARN-10031) Create a general purpose log request with additional query parameters

2020-12-11 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247773#comment-17247773 ] Andras Gyori edited comment on YARN-10031 at 12/11/20, 9:14 AM: Thank you

[jira] [Commented] (YARN-10031) Create a general purpose log request with additional query parameters

2020-12-11 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247773#comment-17247773 ] Andras Gyori commented on YARN-10031: - Thank you [~adam.antal] for the help. I have addressed the

[jira] [Updated] (YARN-10031) Create a general purpose log request with additional query parameters

2020-12-11 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10031: Attachment: YARN-10031.006.patch > Create a general purpose log request with additional query