[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276902#comment-17276902 ] zhuqi commented on YARN-10532: -- [~wangda] [~gandras] Attached a new patch for review. Thanks. > Capacity

[jira] [Updated] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10532: - Attachment: YARN-10532.009.patch > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is

[jira] [Comment Edited] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276811#comment-17276811 ] zhuqi edited comment on YARN-10532 at 2/2/21, 5:40 AM: --- Thanks a lot for  

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276811#comment-17276811 ] zhuqi commented on YARN-10532: -- Thanks a lot for  [~gandras]  patient review, it make sense to me. # I used

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi edited comment on YARN-10589 at 2/1/21, 3:08 PM: --- Thanks for [~ztang]

[jira] [Updated] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10589: - Attachment: YARN-10589-002.patch > Improve logic of multi-node allocation >

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi edited comment on YARN-10589 at 2/1/21, 3:00 PM: --- Thanks for [~ztang]

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi edited comment on YARN-10589 at 2/1/21, 2:59 PM: --- Thanks for [~ztang]

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi edited comment on YARN-10589 at 2/1/21, 2:48 PM: --- Thanks for [~ztang]

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi edited comment on YARN-10589 at 2/1/21, 2:46 PM: --- Thanks for [~ztang]

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi edited comment on YARN-10589 at 2/1/21, 2:42 PM: --- Thanks for [~ztang]

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi edited comment on YARN-10589 at 2/1/21, 2:37 PM: --- Thanks for [~ztang]

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi edited comment on YARN-10589 at 2/1/21, 2:36 PM: --- [~ztang] [~tanu.ajmera] I

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi edited comment on YARN-10589 at 2/1/21, 2:35 PM: --- [~ztang] [~tanu.ajmera] I

[jira] [Commented] (YARN-10589) Improve logic of multi-node allocation

2021-02-01 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276369#comment-17276369 ] zhuqi commented on YARN-10589: -- [~ztang] [~tanu.ajmera] I have reviewed the patch, i don't think the logic

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-01-31 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17275832#comment-17275832 ] zhuqi commented on YARN-10532: -- [~wangda] [~gandras] I have updated a new patch to make the code more

[jira] [Updated] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-01-31 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10532: - Attachment: YARN-10532.008.patch > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is

[jira] [Updated] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-01-29 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10178: - Attachment: YARN-10178.004.patch > Global Scheduler async thread crash caused by 'Comparison method violates its

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2021-01-29 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274240#comment-17274240 ] zhuqi commented on YARN-10352: -- Thanks [~ztang] for review.   > Skip schedule on not heartbeated nodes in

[jira] [Updated] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation loss.

2021-01-28 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10590: - Description: "Because as we discussed in YARN-10504 , the initialization of auto created queues from template

[jira] [Comment Edited] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation loss.

2021-01-28 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274178#comment-17274178 ] zhuqi edited comment on YARN-10590 at 1/29/21, 7:09 AM: Thanks [~bteke] for

[jira] [Commented] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation loss.

2021-01-28 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274178#comment-17274178 ] zhuqi commented on YARN-10590: -- Thanks [~bteke] for review. "Because as we discussed in YARN-10504 , the

[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-01-28 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274163#comment-17274163 ] zhuqi commented on YARN-10178: -- [~wangda] [~bteke] I have updated a patch to sort

[jira] [Updated] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-01-28 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10178: - Attachment: YARN-10178.003.patch > Global Scheduler async thread crash caused by 'Comparison method violates its

[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-01-28 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274122#comment-17274122 ] zhuqi commented on YARN-10178: -- Thanks a lot for [~wangda] [~bteke] review. It makes sense to me, [~wangda] 

[jira] [Comment Edited] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-01-28 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270581#comment-17270581 ] zhuqi edited comment on YARN-10178 at 1/28/21, 8:52 AM: cc [~wangda] [~bteke]

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-01-27 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273287#comment-17273287 ] zhuqi commented on YARN-10532: -- [~gandras] Thanks for your review and valid suggestions. It makes sense:

[jira] [Comment Edited] (YARN-10592) Support QueueCapacities to use vector based multi resource types, and update absolute related to use first.

2021-01-26 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271183#comment-17271183 ] zhuqi edited comment on YARN-10592 at 1/26/21, 9:20 AM: cc [~wangda] [~sunilg] 

[jira] [Updated] (YARN-10592) Support QueueCapacities to use vector based multi resource types, and update absolute related to use first.

2021-01-26 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10592: - Attachment: YARN-10592.002.patch > Support QueueCapacities to use vector based multi resource types, and update

[jira] [Comment Edited] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation loss.

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269888#comment-17269888 ] zhuqi edited comment on YARN-10590 at 1/26/21, 2:22 AM: cc [~wangda] [~sunilg] 

[jira] [Comment Edited] (YARN-10592) Support QueueCapacities to use vector based multi resource types, and update absolute related to use first.

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271183#comment-17271183 ] zhuqi edited comment on YARN-10592 at 1/26/21, 2:21 AM: cc [~wangda] [~sunilg] 

[jira] [Commented] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271405#comment-17271405 ] zhuqi commented on YARN-10585: -- Thank [~shuzirra] for working on this. The latest  patch LGTM.   > Create

[jira] [Updated] (YARN-10592) Support QueueCapacities to use vector based multi resource types, and update absolute related to use first.

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10592: - Summary: Support QueueCapacities to use vector based multi resource types, and update absolute related to use

[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271186#comment-17271186 ] zhuqi commented on YARN-10531: -- Thanks [~wangda] for final review.   > Be able to disable user limit

[jira] [Comment Edited] (YARN-10592) Support QueueCapacities to use vector, and update absolute related to use first.

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271183#comment-17271183 ] zhuqi edited comment on YARN-10592 at 1/25/21, 9:16 AM: cc [~leftnoteasy] 

[jira] [Commented] (YARN-10592) Support QueueCapacities to use vector, and update absolute related to use first.

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271183#comment-17271183 ] zhuqi commented on YARN-10592: -- cc [~leftnoteasy]  [~bteke]  [~gandras] Any thoughts about this, we use

[jira] [Updated] (YARN-10592) Support QueueCapacities to use vector, and update absolute related to use first.

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10592: - Description: Because we need to support YARN-10524 and related other multi type support. Support

[jira] [Updated] (YARN-10592) Support QueueCapacities to use vector, and update absolute related to use first.

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10592: - Description: Because we need to support YARN-10524 and related other multi type support. Support

[jira] [Updated] (YARN-10592) Support QueueCapacities to use vector, and update absolute related to use first.

2021-01-25 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10592: - Description: Because we need to support YARN-10524 and related other multi type support. We should support

[jira] [Created] (YARN-10592) Support QueueCapacities to use vector, and update absolute related to use first.

2021-01-25 Thread zhuqi (Jira)
zhuqi created YARN-10592: Summary: Support QueueCapacities to use vector, and update absolute related to use first. Key: YARN-10592 URL: https://issues.apache.org/jira/browse/YARN-10592 Project: Hadoop YARN

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-01-23 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270635#comment-17270635 ] zhuqi edited comment on YARN-10589 at 1/23/21, 2:04 PM: [~tanu.ajmera] The logic

[jira] [Updated] (YARN-10589) Improve logic of multi-node allocation

2021-01-23 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10589: - Fix Version/s: (was: 3.4.0) > Improve logic of multi-node allocation >

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-01-23 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270635#comment-17270635 ] zhuqi edited comment on YARN-10589 at 1/23/21, 11:44 AM: - [~tanu.ajmera] The

[jira] [Comment Edited] (YARN-10589) Improve logic of multi-node allocation

2021-01-23 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270635#comment-17270635 ] zhuqi edited comment on YARN-10589 at 1/23/21, 11:43 AM: - [~tanu.ajmera] The

[jira] [Commented] (YARN-10589) Improve logic of multi-node allocation

2021-01-23 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270635#comment-17270635 ] zhuqi commented on YARN-10589: -- [~tanu.ajmera] The logic has been improved from multi (node->partition) to

[jira] [Updated] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-01-23 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10178: - Attachment: YARN-10178.002.patch > Global Scheduler async thread crash caused by 'Comparison method violates its

[jira] [Updated] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-01-22 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10178: - Target Version/s: 3.4.0 > Global Scheduler async thread crash caused by 'Comparison method violates its >

[jira] [Comment Edited] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-01-22 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270581#comment-17270581 ] zhuqi edited comment on YARN-10178 at 1/23/21, 7:28 AM: cc [~wangda] [~bteke]

[jira] [Comment Edited] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-01-22 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270581#comment-17270581 ] zhuqi edited comment on YARN-10178 at 1/23/21, 7:12 AM: cc [~wangda] [~bteke]

[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-01-22 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270581#comment-17270581 ] zhuqi commented on YARN-10178: -- cc [~wangda] [~bteke] [~BilwaST] Since the bug and related YARN-8737 have

[jira] [Assigned] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-01-22 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi reassigned YARN-10178: Assignee: zhuqi (was: Benjamin Teke) > Global Scheduler async thread crash caused by 'Comparison method

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2021-01-22 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270518#comment-17270518 ] zhuqi commented on YARN-10352: -- Thanks [~bibinchundatt] for review.   > Skip schedule on not heartbeated

[jira] [Commented] (YARN-10555) missing access check before getAppAttempts

2021-01-21 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269915#comment-17269915 ] zhuqi commented on YARN-10555: -- Thanks for [~xiaoheipangzi] for this. The patch LGTM. > missing access

[jira] [Updated] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation loss.

2021-01-21 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10590: - Attachment: YARN-10590.002.patch > Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute >

[jira] [Commented] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation loss.

2021-01-21 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269888#comment-17269888 ] zhuqi commented on YARN-10590: -- cc [~leftnoteasy]  [~sunilg] [~bteke] When i deep into the loss of the

[jira] [Updated] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation loss.

2021-01-21 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10590: - Description: Because we have introduced YARN-10504. In auto created leaf queue with absolute mode, the

[jira] [Updated] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation loss.

2021-01-21 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10590: - Description: Because we have introduced YARN-10504. In auto created leaf queue with absolute mode, the

[jira] [Updated] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation loss.

2021-01-21 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10590: - Summary: Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation loss. (was: Fix

[jira] [Created] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation.

2021-01-21 Thread zhuqi (Jira)
zhuqi created YARN-10590: Summary: Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation. Key: YARN-10590 URL: https://issues.apache.org/jira/browse/YARN-10590 Project: Hadoop YARN

[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2021-01-20 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269009#comment-17269009 ] zhuqi commented on YARN-10531: -- [~wangda] I have fixed above, in latest patch. > Be able to disable user

[jira] [Comment Edited] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2021-01-20 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269009#comment-17269009 ] zhuqi edited comment on YARN-10531 at 1/21/21, 3:29 AM: Thanks [~wangda] for

[jira] [Updated] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2021-01-20 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10531: - Attachment: YARN-10531.007.patch > Be able to disable user limit factor for CapacityScheduler Leaf Queue >

[jira] [Updated] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2021-01-20 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10531: - Attachment: YARN-10531.006.patch > Be able to disable user limit factor for CapacityScheduler Leaf Queue >

[jira] [Commented] (YARN-10587) Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode.

2021-01-20 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268983#comment-17268983 ] zhuqi commented on YARN-10587: -- [~wangda] [~sunilg] Fix related TestAbsoluteResourceConfiguration in latest

[jira] [Updated] (YARN-10587) Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode.

2021-01-20 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10587: - Attachment: YARN-10587.002.patch > Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode.

[jira] [Updated] (YARN-10587) Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode.

2021-01-20 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10587: - Attachment: (was: YARN-10587.001.patch) > Fix AutoCreateLeafQueueCreation cap related caculation when in

[jira] [Updated] (YARN-10587) Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode.

2021-01-20 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10587: - Attachment: (was: YARN-10587.001.patch) > Fix AutoCreateLeafQueueCreation cap related caculation when in

[jira] [Updated] (YARN-10587) Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode.

2021-01-20 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10587: - Attachment: YARN-10587.001.patch > Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode.

[jira] [Commented] (YARN-10587) Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode.

2021-01-20 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268670#comment-17268670 ] zhuqi commented on YARN-10587: -- cc [~leftnoteasy] [~bteke] When i deep into the 

[jira] [Updated] (YARN-10587) Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode.

2021-01-20 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10587: - Description: When introduced YARN-10504. The logic related to auto created leaf queue changed. The test in 

[jira] [Created] (YARN-10587) Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode.

2021-01-20 Thread zhuqi (Jira)
zhuqi created YARN-10587: Summary: Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode. Key: YARN-10587 URL: https://issues.apache.org/jira/browse/YARN-10587 Project: Hadoop YARN

[jira] [Updated] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2021-01-20 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10352: - Attachment: YARN-10352-010.patch > Skip schedule on not heartbeated nodes in Multi Node Placement >

[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2021-01-20 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268457#comment-17268457 ] zhuqi commented on YARN-10531: -- cc [~wangda]  [~sunilg] If you any other advice for this? Thanks. > Be

[jira] [Comment Edited] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2021-01-19 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268387#comment-17268387 ] zhuqi edited comment on YARN-10352 at 1/20/21, 6:35 AM: [~bibinchundatt] 

[jira] [Resolved] (YARN-10572) Merge YARN-8557 and YARN-10352, and rebase based YARN-10380.

2021-01-19 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi resolved YARN-10572. -- Resolution: Duplicate > Merge YARN-8557 and YARN-10352, and rebase based YARN-10380. >

[jira] [Comment Edited] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2021-01-19 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268387#comment-17268387 ] zhuqi edited comment on YARN-10352 at 1/20/21, 6:16 AM: [~bibinchundatt]  I have

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2021-01-19 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268387#comment-17268387 ] zhuqi commented on YARN-10352: -- [~bibinchundatt]  I have rebased it with some changes YARN-8557  which will

[jira] [Updated] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2021-01-19 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10352: - Attachment: YARN-10352.009.patch > Skip schedule on not heartbeated nodes in Multi Node Placement >

[jira] [Commented] (YARN-10572) Merge YARN-8557 and YARN-10352, and rebase based YARN-10380.

2021-01-19 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268383#comment-17268383 ] zhuqi commented on YARN-10572: -- [~sunilg] [~bibinchundatt]  Ok i will close this, rebase this in

[jira] [Updated] (YARN-10524) Support multi resource type based weight mode in CS.

2021-01-19 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10524: - Description: In fair scheduler support multi resource based absolute and pecentage of the cluster.  For

[jira] [Comment Edited] (YARN-10572) Merge YARN-8557 and YARN-10352, and rebase based YARN-10380.

2021-01-19 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264155#comment-17264155 ] zhuqi edited comment on YARN-10572 at 1/19/21, 12:29 PM: - [~wangda]

[jira] [Comment Edited] (YARN-10572) Merge YARN-8557 and YARN-10352, and rebase based YARN-10380.

2021-01-19 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264155#comment-17264155 ] zhuqi edited comment on YARN-10572 at 1/19/21, 12:29 PM: - [~wangda]

[jira] [Updated] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2021-01-19 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10531: - Attachment: YARN-10531.005.patch > Be able to disable user limit factor for CapacityScheduler Leaf Queue >

[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2021-01-19 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267771#comment-17267771 ] zhuqi commented on YARN-10531: -- [~BilwaST] Thanks a lot for your review, fix checkstyle in latest patch.  

[jira] [Updated] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2021-01-19 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10531: - Attachment: YARN-10531.004.patch > Be able to disable user limit factor for CapacityScheduler Leaf Queue >

[jira] [Comment Edited] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-01-19 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267736#comment-17267736 ] zhuqi edited comment on YARN-10532 at 1/19/21, 8:19 AM: [~wangda] [~gandras] The

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-01-19 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267736#comment-17267736 ] zhuqi commented on YARN-10532: -- [~wangda] [~gandras] Now it can be reviewed. Another question is : It

[jira] [Updated] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-01-18 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10532: - Attachment: YARN-10532.007.patch > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-01-18 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267620#comment-17267620 ] zhuqi commented on YARN-10532: -- Fix the test case in patch 006. When policy edit is not finished, may get

[jira] [Updated] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-01-18 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10532: - Attachment: YARN-10532.006.patch > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is

[jira] [Commented] (YARN-10578) Fix Auto Queue Creation parent handling

2021-01-18 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267601#comment-17267601 ] zhuqi commented on YARN-10578: -- [~gandras] If we need created without submit app, we should need write

[jira] [Updated] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-01-18 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10532: - Attachment: YARN-10532.005.patch > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is

[jira] [Comment Edited] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-01-18 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267111#comment-17267111 ] zhuqi edited comment on YARN-10532 at 1/18/21, 1:27 PM: The latest patch, double

[jira] [Comment Edited] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-01-18 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267111#comment-17267111 ] zhuqi edited comment on YARN-10532 at 1/18/21, 1:27 PM: The latest patch, double

[jira] [Comment Edited] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-01-18 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267111#comment-17267111 ] zhuqi edited comment on YARN-10532 at 1/18/21, 1:10 PM: The latest patch, double

[jira] [Comment Edited] (YARN-10572) Merge YARN-8557 and YARN-10352, and rebase based YARN-10380.

2021-01-18 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264155#comment-17264155 ] zhuqi edited comment on YARN-10572 at 1/18/21, 9:34 AM: [~wangda]

[jira] [Updated] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-01-18 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10532: - Attachment: YARN-10532.004.patch > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-01-18 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267111#comment-17267111 ] zhuqi commented on YARN-10532: -- The latest patch, double check the  "An additional requirement we should

[jira] [Comment Edited] (YARN-10572) Merge YARN-8557 and YARN-10352, and rebase based YARN-10380.

2021-01-17 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264155#comment-17264155 ] zhuqi edited comment on YARN-10572 at 1/18/21, 6:30 AM: [~wangda]

[jira] [Comment Edited] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-01-17 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266529#comment-17266529 ] zhuqi edited comment on YARN-10532 at 1/18/21, 5:47 AM: [~wangda] [~gandras] I

  1   2   3   4   >