[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415053#comment-17415053 ] Wangda Tan commented on YARN-10178: --- [~pbacsko], [~MatthewSharp], I just took a quick look at the patch

[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273944#comment-17273944 ] Wangda Tan commented on YARN-10178: --- [~zhuqi], [~bteke], I'm wondering if it is the right fix, now we

[jira] [Updated] (YARN-10587) Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode.

[ https://issues.apache.org/jira/browse/YARN-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10587: -- Fix Version/s: 3.4.0 > Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode. >

[jira] [Updated] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10531: -- Fix Version/s: 3.4.0 > Be able to disable user limit factor for CapacityScheduler Leaf Queue >

[jira] [Commented] (YARN-10587) Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode.

[ https://issues.apache.org/jira/browse/YARN-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269479#comment-17269479 ] Wangda Tan commented on YARN-10587: --- +1, thanks [~zhuqi] > Fix AutoCreateLeafQueueCreation cap related

[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269469#comment-17269469 ] Wangda Tan commented on YARN-10531: --- +1, thanks [~zhuqi], will get it in later today. > Be able to

[jira] [Commented] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269424#comment-17269424 ] Wangda Tan commented on YARN-10581: --- +1, patch looks good, thanks [~snemeth] > CS Flexible Auto Queue

[jira] [Commented] (YARN-10579) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include weight values for queues

[ https://issues.apache.org/jira/browse/YARN-10579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268857#comment-17268857 ] Wangda Tan commented on YARN-10579: --- Thanks [~snemeth], +1 to the latest patch. > CS Flexible Auto

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268757#comment-17268757 ] Wangda Tan commented on YARN-10352: --- cc: [~ztang] to do a review. > Skip schedule on not heartbeated

[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268755#comment-17268755 ] Wangda Tan commented on YARN-10531: --- Thanks [~zhuqi],  Two minor comments:  1) ParentQueue.java: -

[jira] [Commented] (YARN-10587) Fix AutoCreateLeafQueueCreation cap related caculation when in absolute mode.

[ https://issues.apache.org/jira/browse/YARN-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268743#comment-17268743 ] Wangda Tan commented on YARN-10587: --- Thanks [~zhuqi], I think the fix is correct, but I want [~sunilg] 

[jira] [Commented] (YARN-10578) Fix Auto Queue Creation parent handling

[ https://issues.apache.org/jira/browse/YARN-10578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267508#comment-17267508 ] Wangda Tan commented on YARN-10578: --- +1 to the latest patch, submitted patch to trigger Jenkins. > Fix

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266391#comment-17266391 ] Wangda Tan commented on YARN-10532: --- [~zhuqi], thanks for the patch, I took a brief look (nothing in

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266385#comment-17266385 ] Wangda Tan commented on YARN-10506: --- Verified the test failure is an intermittent one which is not

[jira] [Updated] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10506: -- Attachment: YARN-10506.017.patch > Update queue creation logic to use weight mode and allow the

[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266294#comment-17266294 ] Wangda Tan commented on YARN-10531: --- [~zhuqi], I haven't reviewed details of the patch yet, I'm not

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266292#comment-17266292 ] Wangda Tan commented on YARN-10506: --- Thanks for the additional comments, I +1 to the latest patch, if

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265652#comment-17265652 ] Wangda Tan commented on YARN-10506: --- Thanks [~zhuqi], the latest patch looks good to me! I will wait

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265521#comment-17265521 ] Wangda Tan commented on YARN-10506: --- Sounds good, thanks [~shuzirra], [~pbacsko]. It makes sense to me,

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265149#comment-17265149 ] Wangda Tan commented on YARN-10506: --- [~pbacsko], I see, I think it makes sense. {quote}The logic must

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265085#comment-17265085 ] Wangda Tan commented on YARN-10506: --- Thanks [~shuzirra], [~pbacsko], posting this comment while in the

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264661#comment-17264661 ] Wangda Tan commented on YARN-10506: --- Thanks [~zhuqi], I don't have further comments, +1.  [~gandras] 

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264397#comment-17264397 ] Wangda Tan commented on YARN-10506: --- Reg. *2) How we deal with the queue's auto-queue-creation

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264390#comment-17264390 ] Wangda Tan commented on YARN-10506: --- [~zhuqi], [~gandras],  I just took a look at the latest patch,

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264238#comment-17264238 ] Wangda Tan commented on YARN-10506: --- Can we also take care of javac warnings? > Update queue creation

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264237#comment-17264237 ] Wangda Tan commented on YARN-10506: --- Thanks [~zhuqi] and [~gandras] for quick updates!  *I will review

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263672#comment-17263672 ] Wangda Tan commented on YARN-10506: --- Thanks for all updates, here's my comments:    1)

[jira] [Commented] (YARN-10564) Support Auto Queue Creation template configurations

[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263575#comment-17263575 ] Wangda Tan commented on YARN-10564: --- Thanks [~zhuqi], let's get YARN-10506 done shortly (in a day or

[jira] [Assigned] (YARN-10564) Support Auto Queue Creation template configurations

[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-10564: - Assignee: zhuqi (was: Andras Gyori) > Support Auto Queue Creation template configurations >

[jira] [Assigned] (YARN-10535) Make changes in queue placement policy to use auto-queue-placement API in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-10535: - Assignee: Gergely Pollak > Make changes in queue placement policy to use auto-queue-placement

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263457#comment-17263457 ] Wangda Tan commented on YARN-10506: --- [~zhuqi], [~gandras] can you check the findbugs warning? > Update

[jira] [Comment Edited] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263018#comment-17263018 ] Wangda Tan edited comment on YARN-10504 at 1/12/21, 1:58 AM: - Committed

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Fix Version/s: 3.4.0 > Implement weight mode in Capacity Scheduler >

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263018#comment-17263018 ] Wangda Tan commented on YARN-10504: --- Committed to trunk, thanks to everybody who contributed code

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262985#comment-17262985 ] Wangda Tan commented on YARN-10497: --- [~shuzirra], [~pbacsko] can you review the latest patch when you

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262853#comment-17262853 ] Wangda Tan commented on YARN-10504: --- It looks like folks are generally OK with getting this patch in

[jira] [Comment Edited] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262853#comment-17262853 ] Wangda Tan edited comment on YARN-10504 at 1/11/21, 6:35 PM: - It looks like

[jira] [Commented] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262813#comment-17262813 ] Wangda Tan commented on YARN-10559: --- Removed fix version of the Jira. > Fair sharing intra-queue

[jira] [Comment Edited] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262813#comment-17262813 ] Wangda Tan edited comment on YARN-10559 at 1/11/21, 5:21 PM: - Removed fix

[jira] [Updated] (YARN-10559) Fair sharing intra-queue preemption support in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10559: -- Fix Version/s: (was: 3.1.4) > Fair sharing intra-queue preemption support in Capacity Scheduler >

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262751#comment-17262751 ] Wangda Tan commented on YARN-10504: --- Thanks [~zhuqi], [~bteke] and review from [~sunilg].   I suggest

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262394#comment-17262394 ] Wangda Tan commented on YARN-10504: --- Attached ver.010, it should be able to fix all test failures. >

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: (was: YARN-10504.010.patch) > Implement weight mode in Capacity Scheduler >

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.010.patch > Implement weight mode in Capacity Scheduler >

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.010.patch > Implement weight mode in Capacity Scheduler >

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262323#comment-17262323 ] Wangda Tan commented on YARN-10506: --- Attached ver.6 combined patch (which includes YARN-10506.005

[jira] [Updated] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10506: -- Attachment: YARN-10506.006-combined.patch > Update queue creation logic to use weight mode and allow

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262321#comment-17262321 ] Wangda Tan commented on YARN-10504: --- Uploaded ver.009, fixed more test failures. I run it locally and I

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.009.patch > Implement weight mode in Capacity Scheduler >

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262302#comment-17262302 ] Wangda Tan commented on YARN-10506: --- Manually rebased patch on top of the latest YARN-10504 (008).

[jira] [Updated] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10506: -- Attachment: YARN-10506.006.patch > Update queue creation logic to use weight mode and allow the

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262301#comment-17262301 ] Wangda Tan commented on YARN-10504: --- Still see some issues around auto created leaf queue, fixed a

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.008.patch > Implement weight mode in Capacity Scheduler >

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262257#comment-17262257 ] Wangda Tan commented on YARN-10504: --- Thanks [~bteke], I'm checking the failures now. > Implement

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.006.patch > Implement weight mode in Capacity Scheduler >

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261943#comment-17261943 ] Wangda Tan commented on YARN-10504: --- Updated ver.6 patch, which includes the following:  1) Unit tests

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261921#comment-17261921 ] Wangda Tan commented on YARN-10504: --- Make sense [~zhuqi]. [~bteke]/[~gandras] , if you're not making

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261774#comment-17261774 ] Wangda Tan commented on YARN-10504: --- 1) AbstractCSQueue, lots of format changes, can we revert all

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260114#comment-17260114 ] Wangda Tan commented on YARN-10504: --- [~gandras], Thanks for updating this, your observation is

[jira] [Created] (YARN-10535) Make changes in queue placement policy to use auto-queue-placement API in CapacityScheduler

Wangda Tan created YARN-10535: - Summary: Make changes in queue placement policy to use auto-queue-placement API in CapacityScheduler Key: YARN-10535 URL: https://issues.apache.org/jira/browse/YARN-10535

[jira] [Commented] (YARN-10535) Make changes in queue placement policy to use auto-queue-placement API in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250003#comment-17250003 ] Wangda Tan commented on YARN-10535: --- cc: [~shuzirra], [~pbacsko] > Make changes in queue placement

[jira] [Assigned] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-10506: - Assignee: Andras Gyori > Update queue creation logic to use weight mode and allow the flexible

[jira] [Commented] (YARN-10295) CapacityScheduler NPE can cause apps to get stuck without resources

[ https://issues.apache.org/jira/browse/YARN-10295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17249870#comment-17249870 ] Wangda Tan commented on YARN-10295: --- [~snemeth], just come across the issue, I saw a bunch of failed

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248261#comment-17248261 ] Wangda Tan commented on YARN-10506: --- Uploaded a patch, which is based on YARN-10504. It has done the

[jira] [Updated] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10506: -- Attachment: YARN-10506.001.patch > Update queue creation logic to use weight mode and allow the

[jira] [Created] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

Wangda Tan created YARN-10532: - Summary: Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used Key: YARN-10532 URL: https://issues.apache.org/jira/browse/YARN-10532

[jira] [Commented] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

[ https://issues.apache.org/jira/browse/YARN-10531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248149#comment-17248149 ] Wangda Tan commented on YARN-10531: --- [~zhuqi] do you want to take a try on this one? Thanks, > Be

[jira] [Created] (YARN-10531) Be able to disable user limit factor for CapacityScheduler Leaf Queue

Wangda Tan created YARN-10531: - Summary: Be able to disable user limit factor for CapacityScheduler Leaf Queue Key: YARN-10531 URL: https://issues.apache.org/jira/browse/YARN-10531 Project: Hadoop YARN

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.ver-3.patch > Implement weight mode in Capacity Scheduler >

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248114#comment-17248114 ] Wangda Tan commented on YARN-10504: --- [~zhuqi], thank you so much for your review. [~bteke] will take

[jira] [Commented] (YARN-10530) CapacityScheduler ResourceLimits doesn't handle node partition well

[ https://issues.apache.org/jira/browse/YARN-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248087#comment-17248087 ] Wangda Tan commented on YARN-10530: --- I haven't written any UT yet, but I just want to file the ticket

[jira] [Commented] (YARN-10530) CapacityScheduler ResourceLimits doesn't handle node partition well

[ https://issues.apache.org/jira/browse/YARN-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248084#comment-17248084 ] Wangda Tan commented on YARN-10530: --- cc: [~sunilg], [~epayne] > CapacityScheduler ResourceLimits

[jira] [Created] (YARN-10530) CapacityScheduler ResourceLimits doesn't handle node partition well

Wangda Tan created YARN-10530: - Summary: CapacityScheduler ResourceLimits doesn't handle node partition well Key: YARN-10530 URL: https://issues.apache.org/jira/browse/YARN-10530 Project: Hadoop YARN

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248048#comment-17248048 ] Wangda Tan commented on YARN-10506: --- I'm looking at PoC of the patch now, and will keep the JIRA

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247615#comment-17247615 ] Wangda Tan commented on YARN-10504: --- The patch doesn't handle auto queue creation well, so you will see

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247614#comment-17247614 ] Wangda Tan commented on YARN-10504: --- Thanks [~zhuqi], as we discussed, we're working on the patch in

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.ver-2.patch > Implement weight mode in Capacity Scheduler >

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10504: -- Attachment: YARN-10504.ver-1.patch > Implement weight mode in Capacity Scheduler >

[jira] [Commented] (YARN-10169) Mixed absolute resource value and percentage-based resource value in CapacityScheduler should fail

[ https://issues.apache.org/jira/browse/YARN-10169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241917#comment-17241917 ] Wangda Tan commented on YARN-10169: --- Thanks [~zhuqi] for working on this. We're currently making a

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241173#comment-17241173 ] Wangda Tan commented on YARN-10504: --- [~epayne], This is a feature to allow flexibly add and remove

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238837#comment-17238837 ] Wangda Tan commented on YARN-10497: --- [~shuzirra], I would still prefer to use the

[jira] [Updated] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10497: -- Attachment: YARN-10497.004.patch > Fix an issue in CapacityScheduler which fails to delete queues >

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238410#comment-17238410 ] Wangda Tan commented on YARN-10497: --- Attached ver.3 patch, fixed checkstyle, and unit test. > Fix an

[jira] [Updated] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10497: -- Attachment: YARN-10497.003.patch > Fix an issue in CapacityScheduler which fails to delete queues >

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17238365#comment-17238365 ] Wangda Tan commented on YARN-10497: --- Patch 002, fixed check style issue, and unit test issues. (cc:

[jira] [Updated] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10497: -- Attachment: YARN-10497.002.patch > Fix an issue in CapacityScheduler which fails to delete queues >

[jira] [Commented] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236509#comment-17236509 ] Wangda Tan commented on YARN-10497: --- [~snemeth], [~pbacsko], [~shuzirra], [~bteke] can you help to

[jira] [Updated] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10497: -- Attachment: YARN-10497.001.patch > Fix an issue in CapacityScheduler which fails to delete queues >

[jira] [Created] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

Wangda Tan created YARN-10497: - Summary: Fix an issue in CapacityScheduler which fails to delete queues Key: YARN-10497 URL: https://issues.apache.org/jira/browse/YARN-10497 Project: Hadoop YARN

[jira] [Assigned] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

[ https://issues.apache.org/jira/browse/YARN-10497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-10497: - Assignee: Wangda Tan > Fix an issue in CapacityScheduler which fails to delete queues >

[jira] [Commented] (YARN-10482) Capacity Scheduler seems locked,RM cannot submit any new job,and change active RM manually return to normal

[ https://issues.apache.org/jira/browse/YARN-10482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236286#comment-17236286 ] Wangda Tan commented on YARN-10482: --- Thanks [~jiwq]! it is very helpful! > Capacity Scheduler seems

[jira] [Commented] (YARN-10492) deadlock in rm

[ https://issues.apache.org/jira/browse/YARN-10492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235833#comment-17235833 ] Wangda Tan commented on YARN-10492: --- That will be helpful, thanks Jufeng! > deadlock in rm >

[jira] [Commented] (YARN-10496) [Umbrella] Support Flexible Auto Queue Creation in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-10496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17235683#comment-17235683 ] Wangda Tan commented on YARN-10496: --- Worked with [~bteke] for a design doc, see the linked doc. Would

[jira] [Created] (YARN-10496) [Umbrella] Support Flexible Auto Queue Creation in Capacity Scheduler

Wangda Tan created YARN-10496: - Summary: [Umbrella] Support Flexible Auto Queue Creation in Capacity Scheduler Key: YARN-10496 URL: https://issues.apache.org/jira/browse/YARN-10496 Project: Hadoop YARN

[jira] [Commented] (YARN-10492) deadlock in rm

[ https://issues.apache.org/jira/browse/YARN-10492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17233880#comment-17233880 ] Wangda Tan commented on YARN-10492: --- cc: [~snemeth]  , [~pbacsko], [~tangzhankun],

[jira] [Updated] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-10458: -- Fix Version/s: 3.4.0 > Hive On Tez queries fails upon submission to dynamically created pools >

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223771#comment-17223771 ] Wangda Tan commented on YARN-10458: --- I just committed the patch to trunk, thanks [~anand.srinivasan] 

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223735#comment-17223735 ] Wangda Tan commented on YARN-10458: --- +1, thanks [~pbacsko], will get it committed later today.  > Hive

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223117#comment-17223117 ] Wangda Tan commented on YARN-10458: --- [~pbacsko], there're two issues in the test, one is setup

[jira] [Commented] (YARN-10425) Replace the legacy placement engine in CS with the new one

[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221619#comment-17221619 ] Wangda Tan commented on YARN-10425: --- Thanks [~shuzirra], this is a really big and important effort :). 

  1   2   3   4   5   6   7   8   9   10   >