[jira] [Updated] (YARN-10608) Extend yarn.nodemanager.delete.debug-delay-sec to support application level.

2021-02-02 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10608: -- Description: Now the yarn.nodemanager.delete.debug-delay-sec is a cluster level setting. In our busy

[jira] [Updated] (YARN-10604) Support auto queue creation without mapping rules

2021-02-02 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10604: -- Fix Version/s: 3.4.0 > Support auto queue creation without mapping rules >

[jira] [Commented] (YARN-10605) Add queue-mappings-override.enable property in FS2CS conversions

2021-02-02 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276932#comment-17276932 ] Szilard Nemeth commented on YARN-10605: --- Thanks [~gandras] for working on this, Patch is

[jira] [Commented] (YARN-10589) Improve logic of multi-node allocation

2021-02-02 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276973#comment-17276973 ] Zhankun Tang commented on YARN-10589: - [~zhuqi], Thanks a lot for the review! [~tanu.ajmera], I'm not

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-02 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276973#comment-17276973 ] Zhankun Tang edited comment on YARN-10589 at 2/2/21, 10:02 AM: --- [~zhuqi],

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277015#comment-17277015 ] Hadoop QA commented on YARN-10532: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10335) Improve scheduling of containers based on node health

2021-02-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/YARN-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated YARN-10335: -- Labels: pull-request-available (was: ) > Improve scheduling of containers based on node

[jira] [Commented] (YARN-10589) Improve logic of multi-node allocation

2021-02-02 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276992#comment-17276992 ] Qi Zhu commented on YARN-10589: --- [~ztang] [~tanu.ajmera] I attached a new patch 003  based 002 , i think

[jira] [Created] (YARN-10608) Extend yarn.nodemanager.delete.debug-delay-sec to support application level.

2021-02-02 Thread Qi Zhu (Jira)
Qi Zhu created YARN-10608: - Summary: Extend yarn.nodemanager.delete.debug-delay-sec to support application level. Key: YARN-10608 URL: https://issues.apache.org/jira/browse/YARN-10608 Project: Hadoop YARN

[jira] [Updated] (YARN-10588) Percentage of queue and cluster is zero in WebUI

2021-02-02 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-10588: - Attachment: YARN-10588.002.patch > Percentage of queue and cluster is zero in WebUI >

[jira] [Commented] (YARN-10589) Improve logic of multi-node allocation

2021-02-02 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277031#comment-17277031 ] Qi Zhu commented on YARN-10589: --- [~tanu.ajmera] I agree with [~ztang] that we need to split the code to

[jira] [Commented] (YARN-10604) Support auto queue creation without mapping rules

2021-02-02 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276923#comment-17276923 ] Szilard Nemeth commented on YARN-10604: --- Hi [~gandras], Thanks for working on this. Patch looks

[jira] [Commented] (YARN-10427) Duplicate Job IDs in SLS output

2021-02-02 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276924#comment-17276924 ] Andras Gyori commented on YARN-10427: - Thank you [~snemeth] for the extremely detailed analysis! I

[jira] [Updated] (YARN-10589) Improve logic of multi-node allocation

2021-02-02 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10589: -- Attachment: YARN-10589-003.patch > Improve logic of multi-node allocation >

[jira] [Created] (YARN-10609) Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue)

2021-02-02 Thread Qi Zhu (Jira)
Qi Zhu created YARN-10609: - Summary: Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue) Key: YARN-10609 URL: https://issues.apache.org/jira/browse/YARN-10609

[jira] [Commented] (YARN-10609) Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue)

2021-02-02 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277137#comment-17277137 ] Qi Zhu commented on YARN-10609: --- cc [~wangda] [~snemeth] [~gandras] [~pbacsko] If you can review and merge

[jira] [Updated] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-02 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10532: -- Attachment: YARN-10532.010.patch > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277166#comment-17277166 ] Hadoop QA commented on YARN-10532: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10609) Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue)

2021-02-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277175#comment-17277175 ] Hadoop QA commented on YARN-10609: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-02 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277186#comment-17277186 ] Andras Gyori commented on YARN-10532: - Thank you [~zhuqi] for the new patch. My additions are: * use

[jira] [Updated] (YARN-10476) Queue metrics for Unmanaged applications

2021-02-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/YARN-10476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated YARN-10476: -- Labels: pull-request-available (was: ) > Queue metrics for Unmanaged applications >

[jira] [Comment Edited] (YARN-10609) Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue)

2021-02-02 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277137#comment-17277137 ] Qi Zhu edited comment on YARN-10609 at 2/2/21, 2:19 PM: cc [~wangda] [~snemeth] 

[jira] [Commented] (YARN-10589) Improve logic of multi-node allocation

2021-02-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277085#comment-17277085 ] Hadoop QA commented on YARN-10589: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10588) Percentage of queue and cluster is zero in WebUI

2021-02-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277104#comment-17277104 ] Hadoop QA commented on YARN-10588: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10588) Percentage of queue and cluster is zero in WebUI

2021-02-02 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-10588: - Attachment: YARN-10588.003.patch > Percentage of queue and cluster is zero in WebUI >

[jira] [Commented] (YARN-10610) Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath.

2021-02-02 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277704#comment-17277704 ] Qi Zhu commented on YARN-10610: --- 1. In our product cluster, we want to migrate fs to cs, but the cs restful

[jira] [Comment Edited] (YARN-10610) Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath.

2021-02-02 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277704#comment-17277704 ] Qi Zhu edited comment on YARN-10610 at 2/3/21, 5:53 AM: 1. In our product

[jira] [Created] (YARN-10610) Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath.

2021-02-02 Thread Qi Zhu (Jira)
Qi Zhu created YARN-10610: - Summary: Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath. Key: YARN-10610 URL: https://issues.apache.org/jira/browse/YARN-10610 Project:

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2021-02-02 Thread Bibin Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277661#comment-17277661 ] Bibin Chundatt commented on YARN-10352: --- Committed YARN-10352-010.patch to trunk . Thank you

[jira] [Updated] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-02 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10532: -- Attachment: YARN-10532.011.patch > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-02 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277660#comment-17277660 ] Qi Zhu commented on YARN-10532: --- Thanks for [~gandras] patient review. I have fixed the above.  But the

[jira] [Comment Edited] (YARN-10610) Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath.

2021-02-02 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277704#comment-17277704 ] Qi Zhu edited comment on YARN-10610 at 2/3/21, 5:54 AM: 1. In our product

[jira] [Updated] (YARN-10610) Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath.

2021-02-02 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10610: -- Description: The cs only have queueName, but not full queuePath.

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277713#comment-17277713 ] Hadoop QA commented on YARN-10532: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10588) Percentage of queue and cluster is zero in WebUI

2021-02-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277260#comment-17277260 ] Hadoop QA commented on YARN-10588: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10588) Percentage of queue and cluster is zero in WebUI

2021-02-02 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277110#comment-17277110 ] Bilwa S T commented on YARN-10588: -- Fixed all UT's in .003 patch > Percentage of queue and cluster is