[jira] [Commented] (YARN-9930) Support max running app logic for CapacityScheduler

2020-06-10 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17132598#comment-17132598 ] Wangda Tan commented on YARN-9930: -- Thanks [~pbacsko], it will be make sense to create a

[jira] [Commented] (YARN-10293) Reserved Containers not allocated from available space of other nodes in CandidateNodeSet in MultiNodePlacement (YARN-10259)

2020-06-12 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134338#comment-17134338 ] Wangda Tan commented on YARN-10293: --- Missed last comments, thanks [~prabhujoseph]/[~Tao

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2020-07-20 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17161615#comment-17161615 ] Wangda Tan commented on YARN-10352: --- [~prabhujoseph], I'm trying to understand this log

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2020-07-20 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17161696#comment-17161696 ] Wangda Tan commented on YARN-10352: --- Thanks [~prabhujoseph],  Then it makes sense, but

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2020-07-20 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17161699#comment-17161699 ] Wangda Tan commented on YARN-10352: --- Also, we need to systematically handle the node he

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

2020-07-21 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17162139#comment-17162139 ] Wangda Tan commented on YARN-10352: --- Hi [~prabhujoseph], thanks for the update, unRegis

[jira] [Created] (YARN-10380) Import logic of multi-node allocation in CapacityScheduler

2020-07-30 Thread Wangda Tan (Jira)
Wangda Tan created YARN-10380: - Summary: Import logic of multi-node allocation in CapacityScheduler Key: YARN-10380 URL: https://issues.apache.org/jira/browse/YARN-10380 Project: Hadoop YARN Issu

[jira] [Commented] (YARN-10380) Import logic of multi-node allocation in CapacityScheduler

2020-07-30 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168116#comment-17168116 ] Wangda Tan commented on YARN-10380: --- cc: [~prabhujoseph], I think we identified more is

[jira] [Commented] (YARN-4971) RM fails to re-bind to wildcard IP after failover in multi homed clusters

2020-09-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194378#comment-17194378 ] Wangda Tan commented on YARN-4971: -- I think we should revisit the patch based on comment

[jira] [Commented] (YARN-8737) Race condition in ParentQueue when reinitializing and sorting child queues in the meanwhile

2020-09-28 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203544#comment-17203544 ] Wangda Tan commented on YARN-8737: -- [~Tao Yang], missed this ticket, we recently got a cu

[jira] [Commented] (YARN-8737) Race condition in ParentQueue when reinitializing and sorting child queues in the meanwhile

2020-09-28 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17203545#comment-17203545 ] Wangda Tan commented on YARN-8737: -- cc: [~snemeth], [~bteke] to help with patch reviews,

[jira] [Commented] (YARN-8737) Race condition in ParentQueue when reinitializing and sorting child queues in the meanwhile

2020-10-19 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17217279#comment-17217279 ] Wangda Tan commented on YARN-8737: -- Rekicked Jenkins, after reviewed the case, the fix lo

[jira] [Commented] (YARN-10178) Global Scheduler asycthread crash caused by 'Comparison method violates its general contract'

2020-10-19 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17217285#comment-17217285 ] Wangda Tan commented on YARN-10178: --- Since recently we have a customer has the same iss

[jira] [Comment Edited] (YARN-10178) Global Scheduler asycthread crash caused by 'Comparison method violates its general contract'

2020-10-19 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17217285#comment-17217285 ] Wangda Tan edited comment on YARN-10178 at 10/20/20, 5:33 AM: -

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-10-26 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17220808#comment-17220808 ] Wangda Tan commented on YARN-10458: --- [~pbacsko],  Thanks for working on the patch,  I

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-10-27 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17221616#comment-17221616 ] Wangda Tan commented on YARN-10458: --- It looks good to me, the only question/ask is sinc

[jira] [Commented] (YARN-10425) Replace the legacy placement engine in CS with the new one

2020-10-27 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17221619#comment-17221619 ] Wangda Tan commented on YARN-10425: --- Thanks [~shuzirra], this is a really big and impor

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-10-29 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223117#comment-17223117 ] Wangda Tan commented on YARN-10458: --- [~pbacsko], there're two issues in the test, one i

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-10-30 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223735#comment-17223735 ] Wangda Tan commented on YARN-10458: --- +1, thanks [~pbacsko], will get it committed later

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-10-30 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17223771#comment-17223771 ] Wangda Tan commented on YARN-10458: --- I just committed the patch to trunk, thanks [~anan

[jira] [Updated] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-10-30 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10458: -- Fix Version/s: 3.4.0 > Hive On Tez queries fails upon submission to dynamically created pools > ---

[jira] [Commented] (YARN-10492) deadlock in rm

2020-11-17 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17233880#comment-17233880 ] Wangda Tan commented on YARN-10492: --- cc: [~snemeth]  , [~pbacsko], [~tangzhankun], [~su

[jira] [Created] (YARN-10496) [Umbrella] Support Flexible Auto Queue Creation in Capacity Scheduler

2020-11-19 Thread Wangda Tan (Jira)
Wangda Tan created YARN-10496: - Summary: [Umbrella] Support Flexible Auto Queue Creation in Capacity Scheduler Key: YARN-10496 URL: https://issues.apache.org/jira/browse/YARN-10496 Project: Hadoop YARN

[jira] [Commented] (YARN-10496) [Umbrella] Support Flexible Auto Queue Creation in Capacity Scheduler

2020-11-19 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17235683#comment-17235683 ] Wangda Tan commented on YARN-10496: --- Worked with [~bteke] for a design doc, see the lin

[jira] [Commented] (YARN-10492) deadlock in rm

2020-11-19 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17235833#comment-17235833 ] Wangda Tan commented on YARN-10492: --- That will be helpful, thanks Jufeng! > deadlock i

[jira] [Commented] (YARN-10482) Capacity Scheduler seems locked,RM cannot submit any new job,and change active RM manually return to normal

2020-11-20 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17236286#comment-17236286 ] Wangda Tan commented on YARN-10482: --- Thanks [~jiwq]! it is very helpful! > Capacity Sc

[jira] [Assigned] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2020-11-20 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-10497: - Assignee: Wangda Tan > Fix an issue in CapacityScheduler which fails to delete queues >

[jira] [Created] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2020-11-20 Thread Wangda Tan (Jira)
Wangda Tan created YARN-10497: - Summary: Fix an issue in CapacityScheduler which fails to delete queues Key: YARN-10497 URL: https://issues.apache.org/jira/browse/YARN-10497 Project: Hadoop YARN

[jira] [Updated] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2020-11-20 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10497: -- Attachment: YARN-10497.001.patch > Fix an issue in CapacityScheduler which fails to delete queues > ---

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2020-11-20 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17236509#comment-17236509 ] Wangda Tan commented on YARN-10497: --- [~snemeth], [~pbacsko], [~shuzirra], [~bteke] can

[jira] [Updated] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2020-11-24 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10497: -- Attachment: YARN-10497.002.patch > Fix an issue in CapacityScheduler which fails to delete queues > ---

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2020-11-24 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238365#comment-17238365 ] Wangda Tan commented on YARN-10497: --- Patch 002, fixed check style issue, and unit test

[jira] [Updated] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2020-11-24 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10497: -- Attachment: YARN-10497.003.patch > Fix an issue in CapacityScheduler which fails to delete queues > ---

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2020-11-24 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238410#comment-17238410 ] Wangda Tan commented on YARN-10497: --- Attached ver.3 patch, fixed checkstyle, and unit t

[jira] [Updated] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2020-11-25 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10497: -- Attachment: YARN-10497.004.patch > Fix an issue in CapacityScheduler which fails to delete queues > ---

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2020-11-25 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238837#comment-17238837 ] Wangda Tan commented on YARN-10497: --- [~shuzirra], I would still prefer to use the Capa

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2020-11-30 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17241173#comment-17241173 ] Wangda Tan commented on YARN-10504: --- [~epayne], This is a feature to allow flexibly add

[jira] [Commented] (YARN-10169) Mixed absolute resource value and percentage-based resource value in CapacityScheduler should fail

2020-12-01 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17241917#comment-17241917 ] Wangda Tan commented on YARN-10169: --- Thanks [~zhuqi] for working on this. We're current

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

2020-12-10 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.ver-1.patch > Implement weight mode in Capacity Scheduler >

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

2020-12-10 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.ver-2.patch > Implement weight mode in Capacity Scheduler >

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2020-12-10 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247614#comment-17247614 ] Wangda Tan commented on YARN-10504: --- Thanks [~zhuqi], as we discussed, we're working on

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2020-12-10 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247615#comment-17247615 ] Wangda Tan commented on YARN-10504: --- The patch doesn't handle auto queue creation well,

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2020-12-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248048#comment-17248048 ] Wangda Tan commented on YARN-10506: --- I'm looking at PoC of the patch now, and will keep

[jira] [Created] (YARN-10530) CapacityScheduler ResourceLimits doesn't handle node partition well

2020-12-11 Thread Wangda Tan (Jira)
Wangda Tan created YARN-10530: - Summary: CapacityScheduler ResourceLimits doesn't handle node partition well Key: YARN-10530 URL: https://issues.apache.org/jira/browse/YARN-10530 Project: Hadoop YARN

[jira] [Commented] (YARN-10530) CapacityScheduler ResourceLimits doesn't handle node partition well

2020-12-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248084#comment-17248084 ] Wangda Tan commented on YARN-10530: --- cc: [~sunilg], [~epayne] > CapacityScheduler Reso

[jira] [Commented] (YARN-10530) CapacityScheduler ResourceLimits doesn't handle node partition well

2020-12-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248087#comment-17248087 ] Wangda Tan commented on YARN-10530: --- I haven't written any UT yet, but I just want to f

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2020-12-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248114#comment-17248114 ] Wangda Tan commented on YARN-10504: --- [~zhuqi], thank you so much for your review. [~bte

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

2020-12-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.ver-3.patch > Implement weight mode in Capacity Scheduler >

[jira] [Created] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2020-12-11 Thread Wangda Tan (Jira)
Wangda Tan created YARN-10531: - Summary: Be able to disable user limit factor for CapacityScheduler Leaf Queue Key: YARN-10531 URL: https://issues.apache.org/jira/browse/YARN-10531 Project: Hadoop YARN

[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

2020-12-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248149#comment-17248149 ] Wangda Tan commented on YARN-10531: --- [~zhuqi] do you want to take a try on this one?

[jira] [Created] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2020-12-11 Thread Wangda Tan (Jira)
Wangda Tan created YARN-10532: - Summary: Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used Key: YARN-10532 URL: https://issues.apache.org/jira/browse/YARN-10532

[jira] [Updated] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2020-12-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10506: -- Attachment: YARN-10506.001.patch > Update queue creation logic to use weight mode and allow the flexibl

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2020-12-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248261#comment-17248261 ] Wangda Tan commented on YARN-10506: --- Uploaded a patch, which is based on YARN-10504. It

[jira] [Commented] (YARN-10295) CapacityScheduler NPE can cause apps to get stuck without resources

2020-12-15 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17249870#comment-17249870 ] Wangda Tan commented on YARN-10295: --- [~snemeth], just come across the issue, I saw a bu

[jira] [Assigned] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2020-12-15 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-10506: - Assignee: Andras Gyori > Update queue creation logic to use weight mode and allow the flexible

[jira] [Created] (YARN-10535) Make changes in queue placement policy to use auto-queue-placement API in CapacityScheduler

2020-12-15 Thread Wangda Tan (Jira)
Wangda Tan created YARN-10535: - Summary: Make changes in queue placement policy to use auto-queue-placement API in CapacityScheduler Key: YARN-10535 URL: https://issues.apache.org/jira/browse/YARN-10535 P

[jira] [Commented] (YARN-10535) Make changes in queue placement policy to use auto-queue-placement API in CapacityScheduler

2020-12-15 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17250003#comment-17250003 ] Wangda Tan commented on YARN-10535: --- cc: [~shuzirra], [~pbacsko] > Make changes in que

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-06 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17260114#comment-17260114 ] Wangda Tan commented on YARN-10504: --- [~gandras], Thanks for updating this, your observ

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-08 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261774#comment-17261774 ] Wangda Tan commented on YARN-10504: --- 1) AbstractCSQueue, lots of format changes, can we

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-09 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261921#comment-17261921 ] Wangda Tan commented on YARN-10504: --- Make sense [~zhuqi]. [~bteke]/[~gandras] , if you

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-09 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261943#comment-17261943 ] Wangda Tan commented on YARN-10504: --- Updated ver.6 patch, which includes the following:

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-09 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.006.patch > Implement weight mode in Capacity Scheduler > --

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-10 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262257#comment-17262257 ] Wangda Tan commented on YARN-10504: --- Thanks [~bteke], I'm checking the failures now. >

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-10 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.008.patch > Implement weight mode in Capacity Scheduler > --

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-10 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262301#comment-17262301 ] Wangda Tan commented on YARN-10504: --- Still see some issues around auto created leaf que

[jira] [Updated] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-10 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10506: -- Attachment: YARN-10506.006.patch > Update queue creation logic to use weight mode and allow the flexibl

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-10 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262302#comment-17262302 ] Wangda Tan commented on YARN-10506: --- Manually rebased patch on top of the latest YARN-1

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-10 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.009.patch > Implement weight mode in Capacity Scheduler > --

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-10 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262321#comment-17262321 ] Wangda Tan commented on YARN-10504: --- Uploaded ver.009, fixed more test failures. I run

[jira] [Updated] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-10 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10506: -- Attachment: YARN-10506.006-combined.patch > Update queue creation logic to use weight mode and allow th

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-10 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262323#comment-17262323 ] Wangda Tan commented on YARN-10506: --- Attached ver.6 combined patch (which includes YARN

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-10 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.010.patch > Implement weight mode in Capacity Scheduler > --

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-10 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.010.patch > Implement weight mode in Capacity Scheduler > --

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-10 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: (was: YARN-10504.010.patch) > Implement weight mode in Capacity Scheduler > ---

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-10 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262394#comment-17262394 ] Wangda Tan commented on YARN-10504: --- Attached ver.010, it should be able to fix all tes

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262751#comment-17262751 ] Wangda Tan commented on YARN-10504: --- Thanks [~zhuqi], [~bteke] and review from [~sunilg

[jira] [Updated] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

2021-01-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10559: -- Fix Version/s: (was: 3.1.4) > Fair sharing intra-queue preemption support in Capacity Scheduler > -

[jira] [Comment Edited] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

2021-01-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262813#comment-17262813 ] Wangda Tan edited comment on YARN-10559 at 1/11/21, 5:21 PM: -

[jira] [Commented] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

2021-01-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262813#comment-17262813 ] Wangda Tan commented on YARN-10559: --- Removed fix version of the Jira. > Fair sharing i

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262853#comment-17262853 ] Wangda Tan commented on YARN-10504: --- It looks like folks are generally OK with getting

[jira] [Comment Edited] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262853#comment-17262853 ] Wangda Tan edited comment on YARN-10504 at 1/11/21, 6:35 PM: -

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

2021-01-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262985#comment-17262985 ] Wangda Tan commented on YARN-10497: --- [~shuzirra], [~pbacsko] can you review the latest

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17263018#comment-17263018 ] Wangda Tan commented on YARN-10504: --- Committed to trunk, thanks to everybody who contri

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Fix Version/s: 3.4.0 > Implement weight mode in Capacity Scheduler > --

[jira] [Comment Edited] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-11 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17263018#comment-17263018 ] Wangda Tan edited comment on YARN-10504 at 1/12/21, 1:58 AM: -

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-12 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17263457#comment-17263457 ] Wangda Tan commented on YARN-10506: --- [~zhuqi], [~gandras] can you check the findbugs wa

[jira] [Assigned] (YARN-10535) Make changes in queue placement policy to use auto-queue-placement API in CapacityScheduler

2021-01-12 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-10535: - Assignee: Gergely Pollak > Make changes in queue placement policy to use auto-queue-placement AP

[jira] [Assigned] (YARN-10564) Support Auto Queue Creation template configurations

2021-01-12 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-10564: - Assignee: zhuqi (was: Andras Gyori) > Support Auto Queue Creation template configurations > ---

[jira] [Commented] (YARN-10564) Support Auto Queue Creation template configurations

2021-01-12 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17263575#comment-17263575 ] Wangda Tan commented on YARN-10564: --- Thanks [~zhuqi], let's get YARN-10506 done shortly

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-12 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17263672#comment-17263672 ] Wangda Tan commented on YARN-10506: --- Thanks for all updates, here's my comments:    1

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-13 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17264237#comment-17264237 ] Wangda Tan commented on YARN-10506: --- Thanks [~zhuqi] and [~gandras] for quick updates! 

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-13 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17264238#comment-17264238 ] Wangda Tan commented on YARN-10506: --- Can we also take care of javac warnings? > Update

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-13 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17264390#comment-17264390 ] Wangda Tan commented on YARN-10506: --- [~zhuqi], [~gandras],  I just took a look at the

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-13 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17264397#comment-17264397 ] Wangda Tan commented on YARN-10506: --- Reg. *2) How we deal with the queue's auto-queue-c

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-13 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17264661#comment-17264661 ] Wangda Tan commented on YARN-10506: --- Thanks [~zhuqi], I don't have further comments, +1

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17265085#comment-17265085 ] Wangda Tan commented on YARN-10506: --- Thanks [~shuzirra], [~pbacsko], posting this comme

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17265149#comment-17265149 ] Wangda Tan commented on YARN-10506: --- [~pbacsko], I see, I think it makes sense. {quote}

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17265521#comment-17265521 ] Wangda Tan commented on YARN-10506: --- Sounds good, thanks [~shuzirra], [~pbacsko]. It ma

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17265652#comment-17265652 ] Wangda Tan commented on YARN-10506: --- Thanks [~zhuqi], the latest patch looks good to me

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-15 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17266292#comment-17266292 ] Wangda Tan commented on YARN-10506: --- Thanks for the additional comments, I +1 to the la

  1   2   3   4   5   6   7   8   9   10   >