[jira] [Commented] (YARN-10617) Fifo and Fair intra-queue preemption goes on indefinitely when apps are in pending state due to max AM limit reached

2021-02-08 Thread Sunil G (Jira)
[ https://issues.apache.org/jira/browse/YARN-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281535#comment-17281535 ] Sunil G commented on YARN-10617: Hi [~ananyo_rao] Yes. In the preemption module, we get all apps from the

[jira] [Commented] (YARN-10617) Fifo and Fair intra-queue preemption goes on indefinitely when apps are in pending state due to max AM limit reached

2021-02-08 Thread VADAGA ANANYO RAO (Jira)
[ https://issues.apache.org/jira/browse/YARN-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281513#comment-17281513 ] VADAGA ANANYO RAO commented on YARN-10617: -- Hi [~leftnoteasy] [~sunilg] , could you please

[jira] [Updated] (YARN-10617) Fifo and Fair intra-queue preemption goes on indefinitely when apps are in pending state due to max AM limit reached

2021-02-08 Thread VADAGA ANANYO RAO (Jira)
[ https://issues.apache.org/jira/browse/YARN-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] VADAGA ANANYO RAO updated YARN-10617: - Attachment: YARN-10617.patch > Fifo and Fair intra-queue preemption goes on indefinitely

[jira] [Resolved] (YARN-9650) Set thread names for CapacityScheduler AsyncScheduleThread

2021-02-08 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved YARN-9650. Fix Version/s: 3.4.0 Resolution: Fixed > Set thread names for CapacityScheduler

[jira] [Commented] (YARN-9650) Set thread names for CapacityScheduler AsyncScheduleThread

2021-02-08 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281495#comment-17281495 ] Zhankun Tang commented on YARN-9650: [~zhuqi], Thanks for the review. [~amoghdesai], thanks for the

[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

2021-02-08 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281490#comment-17281490 ] Qi Zhu commented on YARN-9615: -- [~jhung] [~bibinchundatt] Is it going on? I think it is helpful for large

[jira] [Commented] (YARN-10501) Can't remove all node labels after add node label without nodemanager port

2021-02-08 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281350#comment-17281350 ] Eric Badger commented on YARN-10501: [~caozhiqiang], I have some comments on the patch as it is. bq.

[jira] [Updated] (YARN-6977) Node information is not provided for non am containers in RM logs

2021-02-08 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-6977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6977: -- Fix Version/s: 2.10.2 I've cherry-picked this back to branch-2.10 > Node information is not provided

[jira] [Commented] (YARN-10618) RM UI2 Application page shows the AM preempted containers instead of the nonAM ones

2021-02-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281272#comment-17281272 ] Hadoop QA commented on YARN-10618: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-10618) RM UI2 Application page shows the AM preempted containers instead of the nonAM ones

2021-02-08 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10618: - Attachment: YARN-10618.001.patch > RM UI2 Application page shows the AM preempted containers

[jira] [Created] (YARN-10618) RM UI2 Application page shows the AM preempted containers instead of the nonAM ones

2021-02-08 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10618: Summary: RM UI2 Application page shows the AM preempted containers instead of the nonAM ones Key: YARN-10618 URL: https://issues.apache.org/jira/browse/YARN-10618

[jira] [Commented] (YARN-9247) NM fails to start when downgrading from 3.x to 2.7

2021-02-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281132#comment-17281132 ] Hadoop QA commented on YARN-9247: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9247) NM fails to start when downgrading from 3.x to 2.7

2021-02-08 Thread ZheYuan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281130#comment-17281130 ] ZheYuan commented on YARN-9247: --- Thank this issue!! Delete directory in configure file

[jira] [Commented] (YARN-9927) RM multi-thread event processing mechanism

2021-02-08 Thread hcarrot (Jira)
[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281120#comment-17281120 ] hcarrot commented on YARN-9927: --- [~zhuqi] I will be appreciated if you can help to rebase and improve it. >

[jira] [Commented] (YARN-9927) RM multi-thread event processing mechanism

2021-02-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281119#comment-17281119 ] Hadoop QA commented on YARN-9927: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10593) Fix incorrect string comparison in GpuDiscoverer

2021-02-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281049#comment-17281049 ] Hadoop QA commented on YARN-10593: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10593) Fix incorrect string comparison in GpuDiscoverer

2021-02-08 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281042#comment-17281042 ] Qi Zhu commented on YARN-10593: --- Thanks [~pbacsko] for contribution. The patch LGTM. > Fix incorrect

[jira] [Comment Edited] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-08 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280899#comment-17280899 ] Qi Zhu edited comment on YARN-10532 at 2/8/21, 1:11 PM: [~gandras] I have

[jira] [Commented] (YARN-10609) Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue)

2021-02-08 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281039#comment-17281039 ] Qi Zhu commented on YARN-10609: --- Thanks  a lot [~bteke] for review. Your description is more reasonable

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281032#comment-17281032 ] Hadoop QA commented on YARN-10532: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10609) Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue)

2021-02-08 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281017#comment-17281017 ] Benjamin Teke commented on YARN-10609: -- Hi [~zhuqi], Thanks for the patch! Generally the content

[jira] [Updated] (YARN-10593) Fix incorrect string comparison in GpuDiscoverer

2021-02-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10593: Attachment: YARN-10593-001.patch > Fix incorrect string comparison in GpuDiscoverer >

[jira] [Commented] (YARN-10593) Fix incorrect string comparison in GpuDiscoverer

2021-02-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280948#comment-17280948 ] Peter Bacsko commented on YARN-10593: - [~zhuqi] thanks, but I already have a patch in progress, I

[jira] [Comment Edited] (YARN-9927) RM multi-thread event processing mechanism

2021-02-08 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280942#comment-17280942 ] Qi Zhu edited comment on YARN-9927 at 2/8/21, 10:49 AM: [~hcarrot] [~leftnoteasy]

[jira] [Commented] (YARN-9927) RM multi-thread event processing mechanism

2021-02-08 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280942#comment-17280942 ] Qi Zhu commented on YARN-9927: -- [~hcarrot] [~leftnoteasy] [~adam.antal] [~epayne] Is it going on? I think it

[jira] [Comment Edited] (YARN-10609) Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue)

2021-02-08 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277137#comment-17277137 ] Qi Zhu edited comment on YARN-10609 at 2/8/21, 10:44 AM: - cc [~wangda] [~snemeth] 

[jira] [Comment Edited] (YARN-10609) Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue)

2021-02-08 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277137#comment-17277137 ] Qi Zhu edited comment on YARN-10609 at 2/8/21, 10:43 AM: - cc [~wangda] [~snemeth] 

[jira] [Commented] (YARN-10513) CS Flexible Auto Queue Creation RM UIv2 modifications

2021-02-08 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280900#comment-17280900 ] Qi Zhu commented on YARN-10513: --- Thanks  [~gandras] for your contribution. I agree with you, this should

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-08 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280899#comment-17280899 ] Qi Zhu commented on YARN-10532: --- [~gandras] I have updated it in testAutoCreateQueueAfterRemoval in latest

[jira] [Updated] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-08 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10532: -- Attachment: YARN-10532.020.patch > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue

[jira] [Created] (YARN-10617) Fifo and Fair intra-queue preemption goes on indefinitely when apps are in pending state due to max AM limit reached

2021-02-08 Thread VADAGA ANANYO RAO (Jira)
VADAGA ANANYO RAO created YARN-10617: Summary: Fifo and Fair intra-queue preemption goes on indefinitely when apps are in pending state due to max AM limit reached Key: YARN-10617 URL:

[jira] [Commented] (YARN-10513) CS Flexible Auto Queue Creation RM UIv2 modifications

2021-02-08 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280889#comment-17280889 ] Andras Gyori commented on YARN-10513: - Also realised a bug in UI2. The queues are identified by their

[jira] [Updated] (YARN-10513) CS Flexible Auto Queue Creation RM UIv2 modifications

2021-02-08 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10513: Attachment: Screenshot 2021-02-08 at 10.34.32.png > CS Flexible Auto Queue Creation RM UIv2

[jira] [Commented] (YARN-10589) Improve logic of multi-node allocation

2021-02-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280866#comment-17280866 ] Hadoop QA commented on YARN-10589: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-08 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280855#comment-17280855 ] Qi Zhu commented on YARN-10532: --- Thanks a lot [~gandras] for your patient review. You are right, after the

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-08 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280838#comment-17280838 ] Andras Gyori commented on YARN-10532: - Thank you [~zhuqi] for the latest patch, it looks good to me!