[jira] [Commented] (YARN-10677) Logger of SLSFairScheduler is provided with the wrong class

[ https://issues.apache.org/jira/browse/YARN-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297065#comment-17297065 ] Qi Zhu commented on YARN-10677: --- Thanks [~snemeth] for patch, LGTM after fixed the checkstyle. > Logger of

[jira] [Updated] (YARN-9615) Add dispatcher metrics to RM

[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-9615: - Attachment: (was: YARN-9615.008.patch) > Add dispatcher metrics to RM > > >

[jira] [Updated] (YARN-9615) Add dispatcher metrics to RM

[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-9615: - Attachment: YARN-9615.008.patch > Add dispatcher metrics to RM > > >

[jira] [Updated] (YARN-10641) Refactor the max app related update, and fix maxApllications update error when add new queues.

[ https://issues.apache.org/jira/browse/YARN-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10641: -- Attachment: YARN-10641.006.patch > Refactor the max app related update, and fix maxApllications update error

[jira] [Commented] (YARN-10641) Refactor the max app related update, and fix maxApllications update error when add new queues.

[ https://issues.apache.org/jira/browse/YARN-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297081#comment-17297081 ] Qi Zhu commented on YARN-10641: --- [~pbacsko] Fixed the remaining checkstyle, if you have any other advice

[jira] [Commented] (YARN-10616) Nodemanagers cannot detect GPU failures

[ https://issues.apache.org/jira/browse/YARN-10616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297088#comment-17297088 ] Qi Zhu commented on YARN-10616: --- [~ebadger] [~ztang] The detect GPU failures should be realized in  

[jira] [Updated] (YARN-10637) We should support fs to cs support for auto refresh queues when conf changed, after YARN-10623 finished.

[ https://issues.apache.org/jira/browse/YARN-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10637: -- Attachment: YARN-10637.003.patch > We should support fs to cs support for auto refresh queues when conf

[jira] [Commented] (YARN-10658) CapacityScheduler QueueInfo add queue path field to avoid ambiguous QueueName.

[ https://issues.apache.org/jira/browse/YARN-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297040#comment-17297040 ] Qi Zhu commented on YARN-10658: --- [~pbacsko] The test is not related, passed locally, and the checkstyle is  

[jira] [Commented] (YARN-10637) We should support fs to cs support for auto refresh queues when conf changed, after YARN-10623 finished.

[ https://issues.apache.org/jira/browse/YARN-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297095#comment-17297095 ] Qi Zhu commented on YARN-10637: --- [~pbacsko] [~gandras] [~bteke] Fixed checkstyle in latest patch.:D > We

[jira] [Updated] (YARN-9615) Add dispatcher metrics to RM

[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-9615: - Attachment: (was: YARN-9615.008.patch) > Add dispatcher metrics to RM > > >

[jira] [Commented] (YARN-10674) fs2cs: should support auto created queue deletion.

[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297041#comment-17297041 ] Qi Zhu commented on YARN-10674: --- [~pbacsko] [~pbacsko] [~gandras] Could you help review this?  Thanks.:D

[jira] [Updated] (YARN-9615) Add dispatcher metrics to RM

[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-9615: - Attachment: YARN-9615.008.patch > Add dispatcher metrics to RM > > >

[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297061#comment-17297061 ] Qi Zhu commented on YARN-9615: -- [~pbacsko] Rebased and trigger jenkins again. :D > Add dispatcher metrics to

[jira] [Commented] (YARN-10637) We should support fs to cs support for auto refresh queues when conf changed, after YARN-10623 finished.

[ https://issues.apache.org/jira/browse/YARN-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297175#comment-17297175 ] Qi Zhu commented on YARN-10637: --- Thanks [~gandras] for review. I will handle YARN-10674 first. > We

[jira] [Updated] (YARN-10674) fs2cs: should support auto created queue deletion.

[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10674: -- Attachment: YARN-10674.002.patch > fs2cs: should support auto created queue deletion. >

[jira] [Commented] (YARN-10674) fs2cs: should support auto created queue deletion.

[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297185#comment-17297185 ] Qi Zhu commented on YARN-10674: --- Thanks [~gandras] for review. Good suggestion. I have changed in latest

[jira] [Updated] (YARN-9615) Add dispatcher metrics to RM

[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-9615: - Attachment: YARN-9615.009.patch > Add dispatcher metrics to RM > > >

[jira] [Comment Edited] (YARN-9615) Add dispatcher metrics to RM

[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297359#comment-17297359 ] Qi Zhu edited comment on YARN-9615 at 3/8/21, 1:55 PM: --- Thanks [~pbacsko] for reply.

[jira] [Comment Edited] (YARN-9615) Add dispatcher metrics to RM

[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297359#comment-17297359 ] Qi Zhu edited comment on YARN-9615 at 3/8/21, 1:55 PM: --- Thanks [~pbacsko] for reply.

[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297359#comment-17297359 ] Qi Zhu commented on YARN-9615: -- Thanks [~pbacsko] for reply. [~pbacsko] Because the jenkins seem have

[jira] [Updated] (YARN-9615) Add dispatcher metrics to RM

[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-9615: - Attachment: YARN-9615.010.patch > Add dispatcher metrics to RM > > >

[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297483#comment-17297483 ] Qi Zhu commented on YARN-9615: -- [~pbacsko] Fixed the remaining test error caused by test default redundant

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286909#comment-17286909 ] Qi Zhu edited comment on YARN-10589 at 3/9/21, 2:26 AM: [~tanu.ajmera]  Is this

[jira] [Assigned] (YARN-7826) Yarn service status cli does not update lifetime if its updated with -appId

[ https://issues.apache.org/jira/browse/YARN-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu reassigned YARN-7826: Assignee: Qi Zhu (was: Tanu Ajmera) > Yarn service status cli does not update lifetime if its updated

[jira] [Updated] (YARN-9615) Add dispatcher metrics to RM

[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-9615: - Attachment: YARN-9615.011.patch > Add dispatcher metrics to RM > > >

[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297785#comment-17297785 ] Qi Zhu commented on YARN-10178: --- Thanks [~pbacsko] for review and suggestion, it's valid. Let's wait

[jira] [Comment Edited] (YARN-10546) Limit application resource reservation on nodes for non-node/rack specific requests shoud be supported in CS.

[ https://issues.apache.org/jira/browse/YARN-10546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282467#comment-17282467 ] Qi Zhu edited comment on YARN-10546 at 3/9/21, 7:04 AM: [~pbacsko] [~pbacsko] 

[jira] [Created] (YARN-10682) The scheduler monitor policies conf should support trim between ",".

Qi Zhu created YARN-10682: - Summary: The scheduler monitor policies conf should support trim between ",". Key: YARN-10682 URL: https://issues.apache.org/jira/browse/YARN-10682 Project: Hadoop YARN

[jira] [Updated] (YARN-10682) The scheduler monitor policies conf should support trim between ",".

[ https://issues.apache.org/jira/browse/YARN-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10682: -- Description: When i configured  > The scheduler monitor policies conf should support trim between ",". >

[jira] [Updated] (YARN-10682) The scheduler monitor policies conf should support trim between ",".

[ https://issues.apache.org/jira/browse/YARN-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10682: -- Description: When i configured scheduler monitor policies with space, the RM will start with error. The conf

[jira] [Commented] (YARN-7826) Yarn service status cli does not update lifetime if its updated with -appId

[ https://issues.apache.org/jira/browse/YARN-7826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297825#comment-17297825 ] Qi Zhu commented on YARN-7826: -- {code:java} public synchronized ApplicationId getAppId(String serviceName)

[jira] [Comment Edited] (YARN-10641) Refactor the max app related update, and fix maxApllications update error when add new queues.

[ https://issues.apache.org/jira/browse/YARN-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297081#comment-17297081 ] Qi Zhu edited comment on YARN-10641 at 3/9/21, 5:33 AM: [~pbacsko] The logic

[jira] [Comment Edited] (YARN-10641) Refactor the max app related update, and fix maxApllications update error when add new queues.

[ https://issues.apache.org/jira/browse/YARN-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292017#comment-17292017 ] Qi Zhu edited comment on YARN-10641 at 3/1/21, 3:42 AM: Thanks [~gandras] for

[jira] [Commented] (YARN-10658) CapacityScheduler QueueInfo getQueueName should change to queue path to avoid ambiguous QueueName.

[ https://issues.apache.org/jira/browse/YARN-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292638#comment-17292638 ] Qi Zhu commented on YARN-10658: --- [~pbacsko] [~snemeth]  [~shuzirra]  [~gandras]  Could you help review

[jira] [Updated] (YARN-10641) Refactor the max app related update, and fix maxApllications update error when add new queues.

[ https://issues.apache.org/jira/browse/YARN-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10641: -- Attachment: YARN-10641.005.patch > Refactor the max app related update, and fix maxApllications update error

[jira] [Created] (YARN-10658) QueueInfo getQueueName should change to queue path to avoid ambiguous QueueName.

Qi Zhu created YARN-10658: - Summary: QueueInfo getQueueName should change to queue path to avoid ambiguous QueueName. Key: YARN-10658 URL: https://issues.apache.org/jira/browse/YARN-10658 Project: Hadoop

[jira] [Commented] (YARN-10501) Can't remove all node labels after add node label without nodemanager port

[ https://issues.apache.org/jira/browse/YARN-10501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292613#comment-17292613 ] Qi Zhu commented on YARN-10501: --- Thanks [~caozhiqiang] for update. You should handle the fix in YARN-10647

[jira] [Updated] (YARN-10658) CapacityScheduler QueueInfo getQueueName should change to queue path to avoid ambiguous QueueName.

[ https://issues.apache.org/jira/browse/YARN-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10658: -- Summary: CapacityScheduler QueueInfo getQueueName should change to queue path to avoid ambiguous QueueName.

[jira] [Updated] (YARN-10658) CapacityScheduler QueueInfo getQueueName should change to queue path to avoid ambiguous QueueName.

[ https://issues.apache.org/jira/browse/YARN-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10658: -- Description: After the leaf queue can use same name, QueueInfo class getQueueName method should change to

[jira] [Updated] (YARN-10658) QueueInfo getQueueName should change to queue path to avoid ambiguous QueueName.

[ https://issues.apache.org/jira/browse/YARN-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10658: -- Description: After the leaf queue can use same name, QueueInfo class getQueueName method should change to

[jira] [Updated] (YARN-10658) QueueInfo getQueueName should change to queue path to avoid ambiguous QueueName.

[ https://issues.apache.org/jira/browse/YARN-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10658: -- Description: After the leaf queue can use same name, we should  > QueueInfo getQueueName should change to

[jira] [Updated] (YARN-10658) QueueInfo getQueueName should change to queue path to avoid ambiguous QueueName.

[ https://issues.apache.org/jira/browse/YARN-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10658: -- Description: After the leaf queue can use same name, we should change the  (was: After the leaf queue can use

[jira] [Commented] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292122#comment-17292122 ] Qi Zhu commented on YARN-10623: --- Thanks [~pbacsko] for review. I have updated a patch to fix above, and

[jira] [Updated] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10623: -- Attachment: YARN-10623.006.patch > Capacity scheduler should support refresh queue automatically by a thread

[jira] [Commented] (YARN-10640) Adjust the queue Configured capacity to Configured weight number for weight mode in UI.

[ https://issues.apache.org/jira/browse/YARN-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292896#comment-17292896 ] Qi Zhu commented on YARN-10640: --- [~gandras] Thanks for your reply, i agree with you that the Configured

[jira] [Updated] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10532: -- Attachment: YARN-10532.025.patch > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292953#comment-17292953 ] Qi Zhu commented on YARN-10532: --- Thanks a lot [~gandras] for final check. The yarn.scheduler.capacity in

[jira] [Comment Edited] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292953#comment-17292953 ] Qi Zhu edited comment on YARN-10532 at 3/1/21, 3:28 PM: Thanks a lot [~gandras]

[jira] [Comment Edited] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292953#comment-17292953 ] Qi Zhu edited comment on YARN-10532 at 3/1/21, 3:29 PM: Thanks a lot [~gandras]

[jira] [Updated] (YARN-10641) Refactor the max app related update, and fix maxApllications update error when add new queues.

[ https://issues.apache.org/jira/browse/YARN-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10641: -- Attachment: YARN-10641.004.patch > Refactor the max app related update, and fix maxApllications update error

[jira] [Commented] (YARN-10627) Extend logging to give more information about weight mode

[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288809#comment-17288809 ] Qi Zhu commented on YARN-10627: --- Thanks [~bteke] update. Patch LGTM, let's trigger CI again. > Extend

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290651#comment-17290651 ] Qi Zhu commented on YARN-10532: --- Thanks [~pbacsko] for hard work review, i am appreciate with your valid

[jira] [Updated] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10532: -- Attachment: YARN-10532.022.patch > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue

[jira] [Commented] (YARN-10641) Refactor the max app related update, and fix maxApllications update error when add new queues.

[ https://issues.apache.org/jira/browse/YARN-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288972#comment-17288972 ] Qi Zhu commented on YARN-10641: --- The test not related, passed in my local test. > Refactor the max app

[jira] [Commented] (YARN-10650) Create dispatcher metrics interface, and apply to RM async dispatcher.

[ https://issues.apache.org/jira/browse/YARN-10650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289770#comment-17289770 ] Qi Zhu commented on YARN-10650: --- [~ebadger] [~epayne]  Could you help review this to realize the

[jira] [Created] (YARN-10650) Create dispatcher metrics interface, and apply to RM async dispatcher.

Qi Zhu created YARN-10650: - Summary: Create dispatcher metrics interface, and apply to RM async dispatcher. Key: YARN-10650 URL: https://issues.apache.org/jira/browse/YARN-10650 Project: Hadoop YARN

[jira] [Updated] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10623: -- Attachment: YARN-10623.004.patch > Capacity scheduler should support refresh queue automatically by a thread

[jira] [Commented] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290766#comment-17290766 ] Qi Zhu commented on YARN-10623: --- Thanks a lot [~shuzirra] [~pbacsko] for hard work review, and valid

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290779#comment-17290779 ] Qi Zhu commented on YARN-10532: --- Fixed check style in latest patch.:D > Capacity Scheduler Auto Queue

[jira] [Updated] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10532: -- Attachment: YARN-10532.023.patch > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue

[jira] [Commented] (YARN-10639) Queueinfo related capacity, should ajusted to weight mode.

[ https://issues.apache.org/jira/browse/YARN-10639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290815#comment-17290815 ] Qi Zhu commented on YARN-10639: --- Thanks [~shuzirra] for review, i also think  that painlessly add a weight

[jira] [Comment Edited] (YARN-10639) Queueinfo related capacity, should ajusted to weight mode.

[ https://issues.apache.org/jira/browse/YARN-10639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290815#comment-17290815 ] Qi Zhu edited comment on YARN-10639 at 2/25/21, 10:04 AM: -- Thanks [~shuzirra]

[jira] [Commented] (YARN-10645) Fix queue state related update for auto created queue.

[ https://issues.apache.org/jira/browse/YARN-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289716#comment-17289716 ] Qi Zhu commented on YARN-10645: --- [~snemeth]  [~bteke] [~pbacsko]  I tested in my local cluster, i

[jira] [Comment Edited] (YARN-10645) Fix queue state related update for auto created queue.

[ https://issues.apache.org/jira/browse/YARN-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289716#comment-17289716 ] Qi Zhu edited comment on YARN-10645 at 2/24/21, 7:01 AM: - [~snemeth]  [~bteke] 

[jira] [Commented] (YARN-10641) Refactor the max app related update, and fix maxApllications update error when add new queues.

[ https://issues.apache.org/jira/browse/YARN-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288812#comment-17288812 ] Qi Zhu commented on YARN-10641: --- Thanks [~bteke] for review. I have updated in latest patch, and the

[jira] [Updated] (YARN-10637) We should support fs to cs support for auto refresh queues when conf changed, after YARN-10623 finished.

[ https://issues.apache.org/jira/browse/YARN-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10637: -- Attachment: YARN-10637.001.patch > We should support fs to cs support for auto refresh queues when conf

[jira] [Updated] (YARN-10637) We should support fs to cs support for auto refresh queues when conf changed, after YARN-10623 finished.

[ https://issues.apache.org/jira/browse/YARN-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10637: -- Attachment: (was: YARN-10637.001.patch) > We should support fs to cs support for auto refresh queues when

[jira] [Commented] (YARN-10637) We should support fs to cs support for auto refresh queues when conf changed, after YARN-10623 finished.

[ https://issues.apache.org/jira/browse/YARN-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295870#comment-17295870 ] Qi Zhu commented on YARN-10637: --- Since FS supports auto refresh, i updated a patch to fix the fsToCs to

[jira] [Comment Edited] (YARN-9615) Add dispatcher metrics to RM

[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294948#comment-17294948 ] Qi Zhu edited comment on YARN-9615 at 3/5/21, 8:42 AM: --- Thanks a lot [~pbacsko] for

[jira] [Created] (YARN-10674) fs2cs: should support auto created queue deletion.

Qi Zhu created YARN-10674: - Summary: fs2cs: should support auto created queue deletion. Key: YARN-10674 URL: https://issues.apache.org/jira/browse/YARN-10674 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-10673) Fix the spelling errors in TestCapacitySchedulerWeightMode about allocation.

[ https://issues.apache.org/jira/browse/YARN-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10673: -- Attachment: (was: YARN-10673.001.patch) > Fix the spelling errors in TestCapacitySchedulerWeightMode about

[jira] [Updated] (YARN-10658) CapacityScheduler QueueInfo add queue path field to avoid ambiguous QueueName.

[ https://issues.apache.org/jira/browse/YARN-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10658: -- Summary: CapacityScheduler QueueInfo add queue path field to avoid ambiguous QueueName. (was:

[jira] [Updated] (YARN-10658) CapacityScheduler QueueInfo add queue path field to avoid ambiguous QueueName.

[ https://issues.apache.org/jira/browse/YARN-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10658: -- Description: After the leaf queue can use same name, QueueInfo class getQueueName method should have ambiguous

[jira] [Updated] (YARN-10658) CapacityScheduler QueueInfo add queue path field to avoid ambiguous QueueName.

[ https://issues.apache.org/jira/browse/YARN-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10658: -- Attachment: YARN-10658.002.patch > CapacityScheduler QueueInfo add queue path field to avoid ambiguous

[jira] [Commented] (YARN-10658) CapacityScheduler QueueInfo add queue path field to avoid ambiguous QueueName.

[ https://issues.apache.org/jira/browse/YARN-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295970#comment-17295970 ] Qi Zhu commented on YARN-10658: --- [~pbacsko] [~shuzirra] [~snemeth] [~gandras] [~bteke]  Updated a patch to

[jira] [Commented] (YARN-10643) Fix the race condition introduced by YARN-8995.

[ https://issues.apache.org/jira/browse/YARN-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296018#comment-17296018 ] Qi Zhu commented on YARN-10643: --- [~pbacsko] Sure, it is duplicate. Thanks. > Fix the race condition

[jira] [Commented] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292285#comment-17292285 ] Qi Zhu commented on YARN-10623: --- Updated a patch to fix checkstyle and finding bugs. > Capacity scheduler

[jira] [Updated] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10623: -- Attachment: YARN-10623.007.patch > Capacity scheduler should support refresh queue automatically by a thread

[jira] [Updated] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10623: -- Attachment: YARN-10623.008.patch > Capacity scheduler should support refresh queue automatically by a thread

[jira] [Commented] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292428#comment-17292428 ] Qi Zhu commented on YARN-10623: --- Updated a patch to fix local file refresh related test error.:D >

[jira] [Commented] (YARN-10640) Adjust the queue Configured capacity to Configured weight number for weight mode in UI.

[ https://issues.apache.org/jira/browse/YARN-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17292430#comment-17292430 ] Qi Zhu commented on YARN-10640: --- [~pbacsko] [~pbacsko] [~gandras] If you concern about the original 

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Attachment: YARN-10503-branch-3.3.010.patch > Support queue capacity in terms of absolute resources with

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317599#comment-17317599 ] Qi Zhu commented on YARN-10503: --- Thanks [~ebadger] for commit. I have updated a patch to  branch-3.3,

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317801#comment-17317801 ] Qi Zhu commented on YARN-10503: --- [~ebadger] The test is not related to branch-3.3 backport. > Support

[jira] [Commented] (YARN-10564) Support Auto Queue Creation template configurations

[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316834#comment-17316834 ] Qi Zhu commented on YARN-10564: --- Thanks [~pbacsko] review and suggestion,  [~gandras] for update, it's more

[jira] [Commented] (YARN-10637) We should support fs to cs support for auto refresh queues when conf changed, after YARN-10623 finished.

[ https://issues.apache.org/jira/browse/YARN-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316917#comment-17316917 ] Qi Zhu commented on YARN-10637: ---   [~gandras] Could you take a look this when you are free.:D Thanks. >

[jira] [Updated] (YARN-10728) CS should support ensureRootPrefix in queuePath to consistent with FS.

[ https://issues.apache.org/jira/browse/YARN-10728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10728: -- Description: {code:java} private static String ensureRootPrefix(String name) { if

[jira] [Updated] (YARN-10728) CS should support ensureRootPrefix in queuePath to consistent with FS.

[ https://issues.apache.org/jira/browse/YARN-10728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10728: -- Summary: CS should support ensureRootPrefix in queuePath to consistent with FS. (was: CS should support

[jira] [Created] (YARN-10728) CS should support ensureRootPrefix to consistent with FS.

Qi Zhu created YARN-10728: - Summary: CS should support ensureRootPrefix to consistent with FS. Key: YARN-10728 URL: https://issues.apache.org/jira/browse/YARN-10728 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-10728) CS should support ensureRootPrefix to consistent with FS.

[ https://issues.apache.org/jira/browse/YARN-10728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10728: -- Description: {code:java} private static String ensureRootPrefix(String name) { if

[jira] [Updated] (YARN-10728) CS should support ensureRootPrefix to consistent with FS.

[ https://issues.apache.org/jira/browse/YARN-10728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10728: -- Description: {code:java} private static String ensureRootPrefix(String name) { if

[jira] [Commented] (YARN-9927) RM multi-thread event processing mechanism

[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319898#comment-17319898 ] Qi Zhu commented on YARN-9927: -- Fixed the checkstyle in latest patch. cc [~gandras] [~pbacsko] > RM

[jira] [Updated] (YARN-9927) RM multi-thread event processing mechanism

[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-9927: - Attachment: YARN-9927.004.patch > RM multi-thread event processing mechanism >

[jira] [Updated] (YARN-10734) Log aggregation create dir throw failed to setup application log directory, but the log dir not deleted.

[ https://issues.apache.org/jira/browse/YARN-10734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10734: -- Description: As follows log aggregation create dir throw failed to setup application log directory :

[jira] [Created] (YARN-10734) Log aggregation create dir throw failed to setup application log directory, but the dir existed.

Qi Zhu created YARN-10734: - Summary: Log aggregation create dir throw failed to setup application log directory, but the dir existed. Key: YARN-10734 URL: https://issues.apache.org/jira/browse/YARN-10734

[jira] [Updated] (YARN-10734) Log aggregation create dir throw failed to setup application log directory, but the log dir not deleted.

[ https://issues.apache.org/jira/browse/YARN-10734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10734: -- Description: As follows log aggregation create dir throw failed to setup application log directory :

[jira] [Comment Edited] (YARN-10734) Log aggregation create dir throw failed to setup application log directory, but the log dir not deleted.

[ https://issues.apache.org/jira/browse/YARN-10734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320016#comment-17320016 ] Qi Zhu edited comment on YARN-10734 at 4/13/21, 8:14 AM: - cc [~snemeth]

[jira] [Updated] (YARN-10734) Log aggregation create dir throw failed to setup application log directory, but the dir existed.

[ https://issues.apache.org/jira/browse/YARN-10734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10734: -- Attachment: image-2021-04-13-15-33-06-387.png > Log aggregation create dir throw failed to setup application

[jira] [Updated] (YARN-10734) Log aggregation create dir throw failed to setup application log directory, but the log dir not deleted.

[ https://issues.apache.org/jira/browse/YARN-10734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10734: -- Attachment: image-2021-04-13-15-39-27-446.png > Log aggregation create dir throw failed to setup application

[jira] [Commented] (YARN-10648) NM local logs are not cleared after uploading to hdfs

[ https://issues.apache.org/jira/browse/YARN-10648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320022#comment-17320022 ] Qi Zhu commented on YARN-10648: --- Thanks [~dmmkr] for good finding. LGTM +1.  [~brahmareddy] If we need a

<    3   4   5   6   7   8   9   10   11   >