[jira] [Commented] (YARN-10642) AsyncDispatcher will stuck introduced by YARN-8995.

2021-03-02 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17293863#comment-17293863 ] Benjamin Teke commented on YARN-10642: -- [~zhengchenyu] thanks working on this. Moved it to Submit

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-03-01 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17293008#comment-17293008 ] Benjamin Teke commented on YARN-10532: -- [~zhuqi], Thanks for the patch. Generally looks good to me,

[jira] [Updated] (YARN-10627) Extend logging to give more information about weight mode

2021-02-26 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10627: - Attachment: YARN-10627.006.patch > Extend logging to give more information about weight mode >

[jira] [Commented] (YARN-10627) Extend logging to give more information about weight mode

2021-02-26 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291759#comment-17291759 ] Benjamin Teke commented on YARN-10627: -- [~pbacsko] sure, fixed it. > Extend logging to give more

[jira] [Commented] (YARN-10627) Extend logging to give more information about weight mode

2021-02-25 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290894#comment-17290894 ] Benjamin Teke commented on YARN-10627: -- Thanks [~pbacsko] and [~gandras] for the review. Fixed the

[jira] [Updated] (YARN-10627) Extend logging to give more information about weight mode

2021-02-25 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10627: - Attachment: YARN-10627.005.patch > Extend logging to give more information about weight mode >

[jira] [Updated] (YARN-10627) Extend logging to give more information about weight mode

2021-02-25 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10627: - Attachment: YARN-10627.004.patch > Extend logging to give more information about weight mode >

[jira] [Updated] (YARN-10640) Adjust the queue Configured capacity to Configured weight number for weight mode in UI.

2021-02-24 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10640: - Summary: Adjust the queue Configured capacity to Configured weight number for weight mode in

[jira] [Commented] (YARN-10640) Ajust the queue Configured capacity to Configured weight number for weight mode in UI.

2021-02-24 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289902#comment-17289902 ] Benjamin Teke commented on YARN-10640: -- [~zhuqi], thanks for working on this. LGTM, +1 (non-binding)

[jira] [Commented] (YARN-10627) Extend logging to give more information about weight mode

2021-02-22 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288509#comment-17288509 ] Benjamin Teke commented on YARN-10627: -- [~zhuqi] Uploaded a new patchset with the added UTs. >

[jira] [Commented] (YARN-10641) Refactor the max app related update, and fix maxApllications update error when add new queues.

2021-02-22 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288456#comment-17288456 ] Benjamin Teke commented on YARN-10641: -- [~zhuqi], thanks for working on this, this indeed seems to

[jira] [Created] (YARN-10646) TestCapacitySchedulerWeightMode test descriptor comments doesn't reflect the correct scenario

2021-02-22 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10646: Summary: TestCapacitySchedulerWeightMode test descriptor comments doesn't reflect the correct scenario Key: YARN-10646 URL: https://issues.apache.org/jira/browse/YARN-10646

[jira] [Updated] (YARN-10627) Extend logging to give more information about weight mode

2021-02-22 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10627: - Attachment: YARN-10627.003.patch > Extend logging to give more information about weight mode >

[jira] [Commented] (YARN-10627) Extend logging to give more information about weight mode

2021-02-19 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287213#comment-17287213 ] Benjamin Teke commented on YARN-10627: -- [~zhuqi], indeed, thanks for finding it. Fixed it with the

[jira] [Updated] (YARN-10627) Extend logging to give more information about weight mode

2021-02-19 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10627: - Attachment: YARN-10627.002.patch > Extend logging to give more information about weight mode >

[jira] [Commented] (YARN-10636) CS Auto Queue creation should reject submissions with empty path parts

2021-02-19 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286949#comment-17286949 ] Benjamin Teke commented on YARN-10636: -- Thanks [~shuzirra]. I too think the new test case should be

[jira] [Commented] (YARN-10635) CSMapping rule can return paths with empty parts

2021-02-19 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286947#comment-17286947 ] Benjamin Teke commented on YARN-10635: -- [~shuzirra] Thanks for the patch. I agree with [~gandras].

[jira] [Commented] (YARN-10513) CS Flexible Auto Queue Creation RM UIv2 modifications

2021-02-18 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286547#comment-17286547 ] Benjamin Teke commented on YARN-10513: -- [~gandras], Thanks for the update. This revision is LGTM as

[jira] [Commented] (YARN-10609) Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue)

2021-02-18 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286354#comment-17286354 ] Benjamin Teke commented on YARN-10609: -- Thanks [~zhuqi], the latest patch looks good to me. >

[jira] [Updated] (YARN-10627) Extend logging to give more information about weight mode

2021-02-17 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10627: - Attachment: YARN-10627.001.patch > Extend logging to give more information about weight mode >

[jira] [Commented] (YARN-10609) Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue)

2021-02-17 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17285900#comment-17285900 ] Benjamin Teke commented on YARN-10609: -- [~zhuqi] thanks for the update. There may have been a mixup

[jira] [Comment Edited] (YARN-10513) CS Flexible Auto Queue Creation RM UIv2 modifications

2021-02-16 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17285222#comment-17285222 ] Benjamin Teke edited comment on YARN-10513 at 2/16/21, 2:15 PM:

[jira] [Commented] (YARN-10513) CS Flexible Auto Queue Creation RM UIv2 modifications

2021-02-16 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17285222#comment-17285222 ] Benjamin Teke commented on YARN-10513: -- [~gandras], thanks for working on this. LGTM as well. cc:

[jira] [Commented] (YARN-10609) Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue)

2021-02-16 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17285211#comment-17285211 ] Benjamin Teke commented on YARN-10609: -- [~zhuqi] Thanks! Sorry, I have one more thing :) Maybe if we

[jira] [Created] (YARN-10627) Extend logging to give more information about weight mode

2021-02-15 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10627: Summary: Extend logging to give more information about weight mode Key: YARN-10627 URL: https://issues.apache.org/jira/browse/YARN-10627 Project: Hadoop YARN

[jira] [Commented] (YARN-10625) FairScheduler: add global flag to disable AM-preemption

2021-02-15 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284777#comment-17284777 ] Benjamin Teke commented on YARN-10625: -- [~pbacsko] thanks for the patch. LGTM +1 (non-binding). I

[jira] [Commented] (YARN-10624) Support max queues limit configuration in new auto created queue, consistent with old auto created.

2021-02-13 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284225#comment-17284225 ] Benjamin Teke commented on YARN-10624: -- Hey [~zhuqi],   I agree, this should be supported, thanks

[jira] [Updated] (YARN-10618) RM UI2 Application page shows the AM preempted containers instead of the nonAM ones

2021-02-08 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10618: - Attachment: YARN-10618.001.patch > RM UI2 Application page shows the AM preempted containers

[jira] [Created] (YARN-10618) RM UI2 Application page shows the AM preempted containers instead of the nonAM ones

2021-02-08 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10618: Summary: RM UI2 Application page shows the AM preempted containers instead of the nonAM ones Key: YARN-10618 URL: https://issues.apache.org/jira/browse/YARN-10618

[jira] [Commented] (YARN-10609) Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue)

2021-02-08 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281017#comment-17281017 ] Benjamin Teke commented on YARN-10609: -- Hi [~zhuqi], Thanks for the patch! Generally the content

[jira] [Resolved] (YARN-10614) Add auto-create-v2-enabled to root queue in fs2cs weight mode conversion

2021-02-04 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke resolved YARN-10614. -- Resolution: Invalid Marking it as invalid, it was already implemented at the time of the

[jira] [Updated] (YARN-10614) Add auto-create-v2-enabled to root queue in fs2cs weight mode conversion

2021-02-04 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10614: - Description: Weight mode conversion was added to fs2cs in YARN-10525 and in YARN-10600 changes

[jira] [Created] (YARN-10614) Add auto-create-v2-enabled to root queue in fs2cs weight mode conversion

2021-02-04 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10614: Summary: Add auto-create-v2-enabled to root queue in fs2cs weight mode conversion Key: YARN-10614 URL: https://issues.apache.org/jira/browse/YARN-10614 Project:

[jira] [Commented] (YARN-10605) Add queue-mappings-override.enable property in FS2CS conversions

2021-02-01 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276356#comment-17276356 ] Benjamin Teke commented on YARN-10605: -- [~gandras] thanks for the patch. I have one minor nit about

[jira] [Commented] (YARN-10604) Support auto queue creation without mapping rules

2021-02-01 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276344#comment-17276344 ] Benjamin Teke commented on YARN-10604: -- [~gandras] thanks for the patch. Looks good to me, +1

[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-01-28 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273883#comment-17273883 ] Benjamin Teke commented on YARN-10178: -- [~zhuqi] thanks for the patch. The logic looks good to me,

[jira] [Commented] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase witch related absolute caculation loss.

2021-01-28 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273860#comment-17273860 ] Benjamin Teke commented on YARN-10590: -- Thanks [~zhuqi], for working on this. Can you please

[jira] [Updated] (YARN-10600) Convert root queue in fs2cs weight mode conversion

2021-01-28 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10600: - Attachment: YARN-10600.001.patch > Convert root queue in fs2cs weight mode conversion >

[jira] [Updated] (YARN-10600) Convert root queue in fs2cs weight mode conversion

2021-01-28 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10600: - Description: Weight mode conversion was added to fs2cs in YARN-10525. However root queue doesn't

[jira] [Updated] (YARN-10600) Convert root queue in fs2cs weight mode conversion

2021-01-28 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10600: - Description: Weight mode conversion was added to fs2cs in YARN-10525. However root queue

[jira] [Assigned] (YARN-10600) Convert root queue in fs2cs weight mode conversion

2021-01-28 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke reassigned YARN-10600: Assignee: Benjamin Teke (was: Peter Bacsko) > Convert root queue in fs2cs weight mode

[jira] [Created] (YARN-10600) Convert root queue in fs2cs weight mode conversion

2021-01-28 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10600: Summary: Convert root queue in fs2cs weight mode conversion Key: YARN-10600 URL: https://issues.apache.org/jira/browse/YARN-10600 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-10598) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information

2021-01-27 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272997#comment-17272997 ] Benjamin Teke commented on YARN-10598: -- [~snemeth] Thanks for the review, both of them are valid

[jira] [Updated] (YARN-10598) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information

2021-01-27 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10598: - Attachment: YARN-10598.003.patch > CS Flexible Auto Queue Creation: Modify RM /scheduler

[jira] [Commented] (YARN-10598) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information

2021-01-27 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272881#comment-17272881 ] Benjamin Teke commented on YARN-10598: -- Thank [~gandras] for the review. Fixed the suggestions and

[jira] [Updated] (YARN-10598) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information

2021-01-27 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10598: - Attachment: YARN-10598.002.patch > CS Flexible Auto Queue Creation: Modify RM /scheduler

[jira] [Updated] (YARN-10598) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information

2021-01-26 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10598: - Attachment: YARN-10598.001.patch > CS Flexible Auto Queue Creation: Modify RM /scheduler

[jira] [Updated] (YARN-10598) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information

2021-01-26 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10598: - Description: Under this umbrella (YARN-10496), weight-mode has been implemented for CS with

[jira] [Updated] (YARN-10598) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information

2021-01-26 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10598: - Description: Under this umbrella (YARN-10496), weight-mode has been implemented for CS with

[jira] [Updated] (YARN-10598) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information

2021-01-26 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10598: - Description: Under this umbrella (YARN-10496), weight-mode has been implemented for CS with

[jira] [Assigned] (YARN-10598) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information

2021-01-26 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke reassigned YARN-10598: Assignee: Benjamin Teke (was: Szilard Nemeth) > CS Flexible Auto Queue Creation: Modify

[jira] [Created] (YARN-10598) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information

2021-01-26 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10598: Summary: CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to extend the creation type with additional information Key: YARN-10598 URL:

[jira] [Commented] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271419#comment-17271419 ] Benjamin Teke commented on YARN-10596: -- [~gandras] thanks for the patch. I have a suggestion for

[jira] [Comment Edited] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-25 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271371#comment-17271371 ] Benjamin Teke edited comment on YARN-10585 at 1/25/21, 3:34 PM: Thank

[jira] [Commented] (YARN-10585) Create a class which can convert from legacy mapping rule format to the new JSON format

2021-01-25 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271371#comment-17271371 ] Benjamin Teke commented on YARN-10585: -- Thank [~shuzirra] for working on this. Based on your answers

[jira] [Updated] (YARN-10565) Refactor CS queue initialization to simplify weight mode calculation

2021-01-20 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10565: - Description: In YARN-10504 weight mode support was introduced to CS. This jira is a followup to

[jira] [Updated] (YARN-10565) Refactor CS queue initialization to simplify weight mode calculation

2021-01-20 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10565: - Description: In YARN-10504 weight mode support was introduced to CS. This jira is a followup to

[jira] [Commented] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode and enable it by default

2021-01-18 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267417#comment-17267417 ] Benjamin Teke commented on YARN-10573: -- The findbugs issue should be solved by now (see YARN-10574)

[jira] [Comment Edited] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode and enable it by default

2021-01-18 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267388#comment-17267388 ] Benjamin Teke edited comment on YARN-10573 at 1/18/21, 4:11 PM:

[jira] [Commented] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode and enable it by default

2021-01-18 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267388#comment-17267388 ] Benjamin Teke commented on YARN-10573: -- [~pbacsko] thanks for the patch. Went through it, it looks

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-15 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266036#comment-17266036 ] Benjamin Teke commented on YARN-10506: -- Thanks for working on this! Checked the latest patch,

[jira] [Updated] (YARN-10565) Refactor CS queue initialization to simplify weight mode calculation

2021-01-15 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10565: - Attachment: YARN-10565.002.patch > Refactor CS queue initialization to simplify weight mode

[jira] [Assigned] (YARN-10565) Refactor CS queue initialization to simplify weight mode calculation

2021-01-15 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke reassigned YARN-10565: Assignee: Benjamin Teke > Refactor CS queue initialization to simplify weight mode

[jira] [Commented] (YARN-10512) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include mode of operation for CS

2021-01-15 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266010#comment-17266010 ] Benjamin Teke commented on YARN-10512: -- Thank you [~snemeth] for working on this. Regarding the

[jira] [Commented] (YARN-10496) [Umbrella] Support Flexible Auto Queue Creation in Capacity Scheduler

2021-01-13 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264106#comment-17264106 ] Benjamin Teke commented on YARN-10496: -- [~pbacsko], regarding the max capacity: as of now YARN-10504

[jira] [Commented] (YARN-10565) Refactor CS queue initialization to simplify weight mode calculation

2021-01-13 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264003#comment-17264003 ] Benjamin Teke commented on YARN-10565: -- Added most of the changes from YARN-10506.011 patch, as it

[jira] [Updated] (YARN-10565) Refactor CS queue initialization to simplify weight mode calculation

2021-01-13 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10565: - Attachment: YARN-10565.001.patch > Refactor CS queue initialization to simplify weight mode

[jira] [Assigned] (YARN-10512) CS Flexible Auto Queue Creation Check RM REST API impact

2021-01-13 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke reassigned YARN-10512: Assignee: Benjamin Teke > CS Flexible Auto Queue Creation Check RM REST API impact >

[jira] [Commented] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-12 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263566#comment-17263566 ] Benjamin Teke commented on YARN-10525: -- Thanks [~pbacsko] for working on this. The patch LGTM

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-11 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262884#comment-17262884 ] Benjamin Teke commented on YARN-10504: -- I agree with your comment, so if it got an LGTM lets fix the

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-11 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262720#comment-17262720 ] Benjamin Teke commented on YARN-10504: -- Uploaded patch 11 containing the said modification, however

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-11 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10504: - Attachment: YARN-10504.011.patch > Implement weight mode in Capacity Scheduler >

[jira] [Commented] (YARN-10565) Refactor CS queue initialization to simplify weight mode calculation

2021-01-11 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262597#comment-17262597 ] Benjamin Teke commented on YARN-10565: -- [~sunilg] created this item based on your

[jira] [Created] (YARN-10565) Refactor CS queue initialization to simplify weight mode calculation

2021-01-11 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10565: Summary: Refactor CS queue initialization to simplify weight mode calculation Key: YARN-10565 URL: https://issues.apache.org/jira/browse/YARN-10565 Project: Hadoop

[jira] [Comment Edited] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-11 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262590#comment-17262590 ] Benjamin Teke edited comment on YARN-10504 at 1/11/21, 11:33 AM: -

[jira] [Comment Edited] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-11 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261549#comment-17261549 ] Benjamin Teke edited comment on YARN-10504 at 1/11/21, 11:32 AM: - Sharing

[jira] [Comment Edited] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-11 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261549#comment-17261549 ] Benjamin Teke edited comment on YARN-10504 at 1/11/21, 11:31 AM: - Sharing

[jira] [Comment Edited] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-11 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262590#comment-17262590 ] Benjamin Teke edited comment on YARN-10504 at 1/11/21, 11:29 AM: -

[jira] [Comment Edited] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-11 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262590#comment-17262590 ] Benjamin Teke edited comment on YARN-10504 at 1/11/21, 11:29 AM: -

[jira] [Comment Edited] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-11 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262590#comment-17262590 ] Benjamin Teke edited comment on YARN-10504 at 1/11/21, 11:28 AM: -

[jira] [Comment Edited] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-11 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262590#comment-17262590 ] Benjamin Teke edited comment on YARN-10504 at 1/11/21, 11:27 AM: -

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-11 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262590#comment-17262590 ] Benjamin Teke commented on YARN-10504: -- [~zhuqi], I came to the same conclusion in my comment

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-09 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261961#comment-17261961 ] Benjamin Teke commented on YARN-10504: -- [~wangda], [~zhuqi]   Added a small new patch. ver.6 had a

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-09 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10504: - Attachment: YARN-10504.007.patch > Implement weight mode in Capacity Scheduler >

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-09 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261954#comment-17261954 ] Benjamin Teke commented on YARN-10504: -- [~wangda]/[~zhuqi]/[~gandras],   Let me take care of the

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-08 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261549#comment-17261549 ] Benjamin Teke commented on YARN-10504: -- Sharing my latest findings on 

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-08 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261381#comment-17261381 ] Benjamin Teke commented on YARN-10504: -- Hey [~zhuqi], Thanks for your updates. Took the liberty to

[jira] [Updated] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-08 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10504: - Attachment: YARN-10504.005.patch > Implement weight mode in Capacity Scheduler >

[jira] [Comment Edited] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-06 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260292#comment-17260292 ] Benjamin Teke edited comment on YARN-10504 at 1/7/21, 7:53 AM: --- [~wangda],

[jira] [Commented] (YARN-10504) Implement weight mode in Capacity Scheduler

2021-01-06 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260292#comment-17260292 ] Benjamin Teke commented on YARN-10504: -- [~wangda],   Regarding the AutoCreatedLeafQueue: we are

[jira] [Assigned] (YARN-10504) Implement weight mode in Capacity Scheduler

2020-12-11 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke reassigned YARN-10504: Assignee: Benjamin Teke (was: zhuqi) > Implement weight mode in Capacity Scheduler >

[jira] [Updated] (YARN-10512) CS Auto Queue Creation Check RM REST API impact

2020-12-03 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10512: - Summary: CS Auto Queue Creation Check RM REST API impact (was: CS Auto Queue Creation Check RM

[jira] [Updated] (YARN-10513) CS Flexible Auto Queue Creation RM UIv2 modifications

2020-12-03 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10513: - Summary: CS Flexible Auto Queue Creation RM UIv2 modifications (was: CS Auto Queue Creation RM

[jira] [Updated] (YARN-10512) CS Flexible Auto Queue Creation Check RM REST API impact

2020-12-03 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10512: - Summary: CS Flexible Auto Queue Creation Check RM REST API impact (was: CS Auto Queue Creation

[jira] [Updated] (YARN-10512) CS Auto Queue Creation Check RM rest API impact

2020-12-03 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10512: - Summary: CS Auto Queue Creation Check RM rest API impact (was: Check RM rest API impact) > CS

[jira] [Created] (YARN-10513) CS Auto Queue Creation RM UIv2 modifications

2020-12-03 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10513: Summary: CS Auto Queue Creation RM UIv2 modifications Key: YARN-10513 URL: https://issues.apache.org/jira/browse/YARN-10513 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-10512) Check RM rest API impact

2020-12-03 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10512: Summary: Check RM rest API impact Key: YARN-10512 URL: https://issues.apache.org/jira/browse/YARN-10512 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-10496) [Umbrella] Support Flexible Auto Queue Creation in Capacity Scheduler

2020-11-30 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17240870#comment-17240870 ] Benjamin Teke commented on YARN-10496: -- Added subtasks for approach#1. > [Umbrella] Support

[jira] [Created] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2020-11-30 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10506: Summary: Update queue creation logic to use weight mode and allow the flexible static/dynamic creation Key: YARN-10506 URL: https://issues.apache.org/jira/browse/YARN-10506

[jira] [Created] (YARN-10505) Extend the maximum-capacity property to react to weight mode changes

2020-11-30 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10505: Summary: Extend the maximum-capacity property to react to weight mode changes Key: YARN-10505 URL: https://issues.apache.org/jira/browse/YARN-10505 Project: Hadoop

<    1   2   3   4   5   6   >