[jira] [Comment Edited] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-10-29 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222860#comment-17222860 ] Peter Bacsko edited comment on YARN-10458 at 10/29/20, 12:24 PM: -

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-10-30 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223564#comment-17223564 ] Peter Bacsko commented on YARN-10458: - Many thanks [~wangda]. The test works with the proposed

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-11-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224551#comment-17224551 ] Peter Bacsko commented on YARN-10458: - I uploaded a patch to branch-3.3. Older branches don't contain

[jira] [Updated] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-11-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10458: Attachment: YARN-10458-branch-3.3.001.patch > Hive On Tez queries fails upon submission to

[jira] [Commented] (YARN-10458) Hive On Tez queries fails upon submission to dynamically created pools

2020-11-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17224773#comment-17224773 ] Peter Bacsko commented on YARN-10458: - Test failures seem to be unrelated. [~leftnoteasy] I think

[jira] [Updated] (YARN-10563) Fix dependency exclusion problem in poms

2021-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10563: Description: Currently, {{hadoop-project/pom.xml}} contains a bunch of exclusions for

[jira] [Updated] (YARN-10563) Fix dependency exclusion problem in poms

2021-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10563: Attachment: YARN-10563-001.patch > Fix dependency exclusion problem in poms >

[jira] [Updated] (YARN-10563) Fix dependency exclusion problem in poms

2021-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10563: Description: Currently, {{hadoop-project/pom.xml}} contains a bunch of exclusions for

[jira] [Updated] (YARN-10563) Fix dependency exclusion problem in poms

2021-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10563: Description: Currently, {{hadoop-project/pom.xml}} contains a bunch of exclusions for

[jira] [Updated] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10525: Attachment: YARN-10525-002.patch > Add weight mode conversion to fs2cs >

[jira] [Commented] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

2021-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261144#comment-17261144 ] Peter Bacsko commented on YARN-10507: - [~gandras] could you check it again? > Add the capability to

[jira] [Commented] (YARN-10562) Alternate fix for DirectoryCollection.checkDirs() race

2021-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261543#comment-17261543 ] Peter Bacsko commented on YARN-10562: - Thanks for the patch [~Jim_Brennan]. cc [~leftnoteasy]

[jira] [Updated] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10525: Attachment: YARN-10525-003.patch > Add weight mode conversion to fs2cs >

[jira] [Updated] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10525: Description: Weight mode will be added to Capacity Scheduler. Currently, we convert FS weights to

[jira] [Commented] (YARN-10579) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include weight values for queues

2021-01-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268665#comment-17268665 ] Peter Bacsko commented on YARN-10579: - +1 pending Jenkins. > CS Flexible Auto Queue Creation: Modify

[jira] [Commented] (YARN-10535) Make queue placement in CapacityScheduler compliant with auto-queue-placement

2021-01-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265947#comment-17265947 ] Peter Bacsko commented on YARN-10535: - Initial review: 1. Remove star imports: {{import

[jira] [Comment Edited] (YARN-10535) Make queue placement in CapacityScheduler compliant with auto-queue-placement

2021-01-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265947#comment-17265947 ] Peter Bacsko edited comment on YARN-10535 at 1/15/21, 11:41 AM: Initial

[jira] [Created] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-15 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10573: --- Summary: Enhance placement rule conversion in fs2cs in weight mode Key: YARN-10573 URL: https://issues.apache.org/jira/browse/YARN-10573 Project: Hadoop YARN

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Description: If we're using weight mode, we have much more freedom when it comes to placement

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Description: If we're using weight mode, we have much more freedom when it comes to placement

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Description: If we're using weight mode, we have much more freedom when it comes to placement

[jira] [Commented] (YARN-10512) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include mode of operation for CS

2021-01-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267894#comment-17267894 ] Peter Bacsko commented on YARN-10512: - I just have very minor nits: {noformat}

[jira] [Comment Edited] (YARN-10512) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include mode of operation for CS

2021-01-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267894#comment-17267894 ] Peter Bacsko edited comment on YARN-10512 at 1/19/21, 1:51 PM: --- I just have

[jira] [Comment Edited] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

2021-01-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269181#comment-17269181 ] Peter Bacsko edited comment on YARN-10581 at 1/21/21, 9:47 AM: --- I have one

[jira] [Commented] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

2021-01-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269181#comment-17269181 ] Peter Bacsko commented on YARN-10581: - I have one question: automatically created leaf queues are now

[jira] [Commented] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

2021-01-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269225#comment-17269225 ] Peter Bacsko commented on YARN-10581: - Yes. +1 from me (pending Jenkins). > CS Flexible Auto Queue

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264903#comment-17264903 ] Peter Bacsko commented on YARN-10506: - Hi guys. I haven't really contributed to this patch and

[jira] [Comment Edited] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264903#comment-17264903 ] Peter Bacsko edited comment on YARN-10506 at 1/14/21, 1:50 PM: --- Hi guys. I

[jira] [Comment Edited] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264977#comment-17264977 ] Peter Bacsko edited comment on YARN-10506 at 1/14/21, 3:56 PM: ---

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264977#comment-17264977 ] Peter Bacsko commented on YARN-10506: - *Clarification comment* I turned out I misunderstood

[jira] [Comment Edited] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271342#comment-17271342 ] Peter Bacsko edited comment on YARN-10596 at 1/25/21, 2:53 PM: --- [~gandras]

[jira] [Commented] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271342#comment-17271342 ] Peter Bacsko commented on YARN-10596: - [~gandras] I have a question. {noformat} // Auto created

[jira] [Comment Edited] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271342#comment-17271342 ] Peter Bacsko edited comment on YARN-10596 at 1/25/21, 2:38 PM: --- [~gandras]

[jira] [Comment Edited] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271355#comment-17271355 ] Peter Bacsko edited comment on YARN-10596 at 1/25/21, 3:04 PM: --- Ok, I've

[jira] [Commented] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271355#comment-17271355 ] Peter Bacsko commented on YARN-10596: - Ok, I've just read this sentence: _Since it is not an edge

[jira] [Commented] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267282#comment-17267282 ] Peter Bacsko commented on YARN-10573: - Ok, tiny checkstyle problem handled in patch v2. [~bteke]

[jira] [Created] (YARN-10577) Automatically convert placement rules in fs2cs

2021-01-18 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10577: --- Summary: Automatically convert placement rules in fs2cs Key: YARN-10577 URL: https://issues.apache.org/jira/browse/YARN-10577 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-10577) Automatically convert placement rules in fs2cs

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10577: Attachment: YARN-10573-002.patch > Automatically convert placement rules in fs2cs >

[jira] [Updated] (YARN-10577) Automatically convert placement rules in fs2cs

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10577: Attachment: (was: YARN-10573-002.patch) > Automatically convert placement rules in fs2cs >

[jira] [Updated] (YARN-10577) Automatically convert placement rules in fs2cs

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10577: Attachment: YARN-10577-001.patch > Automatically convert placement rules in fs2cs >

[jira] [Commented] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267355#comment-17267355 ] Peter Bacsko commented on YARN-10573: - Note: I merged the contents of YARN-10577 into this patch.

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Attachment: YARN-10573-003.patch > Enhance placement rule conversion in fs2cs in weight mode >

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode and enable it by default

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Summary: Enhance placement rule conversion in fs2cs in weight mode and enable it by default (was:

[jira] [Updated] (YARN-10577) Automatically convert placement rules in fs2cs

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10577: Description: Currently, users have to use "\-m" or "\-\-convert-placement-rules" switch to

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode and enable it by default

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Description: If we're using weight mode, we have much more freedom when it comes to placement

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode and enable it by default

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Description: If we're using weight mode, we have much more freedom when it comes to placement

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Attachment: YARN-10573-002.patch > Enhance placement rule conversion in fs2cs in weight mode >

[jira] [Created] (YARN-10576) Update Capacity Scheduler about JSON-based placement mapping

2021-01-18 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10576: --- Summary: Update Capacity Scheduler about JSON-based placement mapping Key: YARN-10576 URL: https://issues.apache.org/jira/browse/YARN-10576 Project: Hadoop YARN

[jira] [Updated] (YARN-10576) Update Capacity Scheduler about JSON-based placement mapping

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10576: Description: The weight mode and AQC also affects how the new placement engine in CS works and

[jira] [Commented] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode and enable it by default

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267523#comment-17267523 ] Peter Bacsko commented on YARN-10573: - [~snemeth] that's actually a XOR, and yes, it's intentional.

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265144#comment-17265144 ] Peter Bacsko commented on YARN-10506: - "_It is possible when the rule checks, the queue allow

[jira] [Updated] (YARN-10562) Follow up changes for YARN-9833

2021-01-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10562: Labels: resourcemanager (was: ) > Follow up changes for YARN-9833 >

[jira] [Updated] (YARN-10576) Update Capacity Scheduler documentation about JSON-based placement mapping

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10576: Summary: Update Capacity Scheduler documentation about JSON-based placement mapping (was: Update

[jira] [Created] (YARN-10593) Fix incorrect string comparison in GpuDiscoverer

2021-01-25 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10593: --- Summary: Fix incorrect string comparison in GpuDiscoverer Key: YARN-10593 URL: https://issues.apache.org/jira/browse/YARN-10593 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-10593) Fix incorrect string comparison in GpuDiscoverer

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271298#comment-17271298 ] Peter Bacsko commented on YARN-10593: - Unfortunately, Zoltan Siegl's comment has not been addressed: 

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Labels: fs2cs (was: ) > Enhance placement rule conversion in fs2cs in weight mode >

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Attachment: YARN-10573-001.patch > Enhance placement rule conversion in fs2cs in weight mode >

[jira] [Commented] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264096#comment-17264096 ] Peter Bacsko commented on YARN-10525: - [~zhuqi] thanks for the review, I believe the checkstyle is

[jira] [Updated] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10525: Summary: Add weight mode conversion to fs2cs (was: Support FS Convert to CS with weight mode

[jira] [Assigned] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-10525: --- Assignee: Peter Bacsko (was: zhuqi) > Add weight mode conversion to fs2cs >

[jira] [Updated] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

2021-01-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10507: Attachment: YARN-10507-007.patch > Add the capability to fs2cs to write the converted placement

[jira] [Commented] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

2021-01-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258219#comment-17258219 ] Peter Bacsko commented on YARN-10507: - Thanks [~gandras] I updated the patch with your suggestions.

[jira] [Commented] (YARN-10562) Alternate fix for DirectoryCollection.checkDirs() race

2021-01-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263493#comment-17263493 ] Peter Bacsko commented on YARN-10562: - I was looking at the patch. I *think* I probably understand

[jira] [Commented] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263583#comment-17263583 ] Peter Bacsko commented on YARN-10525: - I retriggered it, let's wait for the results. > Add weight

[jira] [Commented] (YARN-10562) Follow up changes for YARN-9833

2021-01-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263710#comment-17263710 ] Peter Bacsko commented on YARN-10562: - LGTM +1 from me. > Follow up changes for YARN-9833 >

[jira] [Updated] (YARN-10599) fs2cs should generate new "auto-queue-creation-v2.enabled" properties for all parents

2021-01-27 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10599: Attachment: YARN-10599-002.patch > fs2cs should generate new "auto-queue-creation-v2.enabled"

[jira] [Commented] (YARN-10600) Convert root queue in fs2cs weight mode conversion

2021-01-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273966#comment-17273966 ] Peter Bacsko commented on YARN-10600: - +1. Thanks for the patch [~bteke] and [~gandras] for the

[jira] [Updated] (YARN-10576) Update Capacity Scheduler documentation about JSON-based placement mapping

2021-01-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10576: Attachment: YARN-10576-001.patch > Update Capacity Scheduler documentation about JSON-based

[jira] [Updated] (YARN-10599) fs2cs should generate new "auto-queue-creation-v2.enabled" properties for all parents

2021-01-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10599: Description: The property {{yarn.scheduler.capacity..auto-queue-creation-v2.enabled}} is not

[jira] [Created] (YARN-10599) fs2cs should generate new "auto-queue-creation-v2.enabled" properties for all parents

2021-01-26 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10599: --- Summary: fs2cs should generate new "auto-queue-creation-v2.enabled" properties for all parents Key: YARN-10599 URL: https://issues.apache.org/jira/browse/YARN-10599

[jira] [Updated] (YARN-10599) fs2cs should generate new "auto-queue-creation-v2.enabled" properties for all parents

2021-01-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10599: Description: The property {{yarn.scheduler.capacity..auto-queue-creation-v2.enabled}} is not

[jira] [Commented] (YARN-10780) Optimise retrieval of configured node labels in CS queues

2021-06-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367259#comment-17367259 ] Peter Bacsko commented on YARN-10780: - [~gandras] looks good, could you take care of the checkstyle

[jira] [Commented] (YARN-10780) Optimise retrieval of configured node labels in CS queues

2021-06-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17369025#comment-17369025 ] Peter Bacsko commented on YARN-10780: - +1 Thanks [~gandras], latest patch LGTM. Committed to trunk.

[jira] [Commented] (YARN-10571) Refactor dynamic queue handling logic

2021-05-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342462#comment-17342462 ] Peter Bacsko commented on YARN-10571: - Finally, no javac issues! [~gandras] please check the test

[jira] [Updated] (YARN-10642) Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

2021-05-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10642: Attachment: YARN-10642-branch-3.1.001.patch > Race condition: AsyncDispatcher can get stuck by the

[jira] [Reopened] (YARN-10642) Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

2021-05-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reopened YARN-10642: - > Race condition: AsyncDispatcher can get stuck by the changes introduced in > YARN-8995 >

[jira] [Updated] (YARN-9615) Add dispatcher metrics to RM

2021-05-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9615: --- Attachment: YARN-9615-branch-3.3-001.patch > Add dispatcher metrics to RM >

[jira] [Reopened] (YARN-9615) Add dispatcher metrics to RM

2021-05-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reopened YARN-9615: > Add dispatcher metrics to RM > > > Key: YARN-9615 >

[jira] [Assigned] (YARN-10763) add the speed of containers assigned metrics to ClusterMetrics

2021-05-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-10763: --- Assignee: chaosju > add the speed of containers assigned metrics to ClusterMetrics >

[jira] [Commented] (YARN-10763) add the speed of containers assigned metrics to ClusterMetrics

2021-05-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343152#comment-17343152 ] Peter Bacsko commented on YARN-10763: - Some further comments: 1. {{private volatile AtomicLong

[jira] [Commented] (YARN-10763) add the speed of containers assigned metrics to ClusterMetrics

2021-05-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343139#comment-17343139 ] Peter Bacsko commented on YARN-10763: - [~chaosju] I added you to the list of contributors so you can

[jira] [Commented] (YARN-10571) Refactor dynamic queue handling logic

2021-05-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343227#comment-17343227 ] Peter Bacsko commented on YARN-10571: - +1 LGTM > Refactor dynamic queue handling logic >

[jira] [Commented] (YARN-10571) Refactor dynamic queue handling logic

2021-05-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343250#comment-17343250 ] Peter Bacsko commented on YARN-10571: - Thanks [~gandras], committed to trunk. > Refactor dynamic

[jira] [Commented] (YARN-10763) add the speed of containers assigned metrics to ClusterMetrics

2021-05-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342360#comment-17342360 ] Peter Bacsko commented on YARN-10763: - [~chaosju] some comments: 1. {{Timer}} / {{TimerTask}} are

[jira] [Comment Edited] (YARN-10759) Encapsulate queue config modes

2021-05-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344573#comment-17344573 ] Peter Bacsko edited comment on YARN-10759 at 5/14/21, 12:54 PM: Thanks

[jira] [Commented] (YARN-10759) Encapsulate queue config modes

2021-05-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344573#comment-17344573 ] Peter Bacsko commented on YARN-10759: - Thanks [~gandras] for the patch. I just have one to note. I

[jira] [Commented] (YARN-10763) add the speed of containers assigned metrics to ClusterMetrics

2021-05-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344518#comment-17344518 ] Peter Bacsko commented on YARN-10763: - Thanks [~chaosju] just a final update, very minor things: 1.

[jira] [Reopened] (YARN-10258) Add metrics for 'ApplicationsRunning' in NodeManager

2021-05-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reopened YARN-10258: - > Add metrics for 'ApplicationsRunning' in NodeManager >

[jira] [Updated] (YARN-10258) Add metrics for 'ApplicationsRunning' in NodeManager

2021-05-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10258: Attachment: YARN-10258-branch-3.3.001.patch > Add metrics for 'ApplicationsRunning' in NodeManager

[jira] [Created] (YARN-10779) Add option to disable lowecase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-19 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10779: --- Summary: Add option to disable lowecase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl Key: YARN-10779 URL:

[jira] [Updated] (YARN-10779) Add option to disable lowecase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10779: Attachment: YARN-10779-POC.patch > Add option to disable lowecase conversion in

[jira] [Updated] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10779: Summary: Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and

[jira] [Commented] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347481#comment-17347481 ] Peter Bacsko commented on YARN-10779: - Uploaded a POC without tests. > Add option to disable

[jira] [Updated] (YARN-10258) Add metrics for 'ApplicationsRunning' in NodeManager

2021-05-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10258: Fix Version/s: 3.3.1 > Add metrics for 'ApplicationsRunning' in NodeManager >

[jira] [Commented] (YARN-10258) Add metrics for 'ApplicationsRunning' in NodeManager

2021-05-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347419#comment-17347419 ] Peter Bacsko commented on YARN-10258: - Backported to branch-3.3. > Add metrics for

[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

2021-05-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17340163#comment-17340163 ] Peter Bacsko commented on YARN-9615: [~BilwaST] I'm currently on vacation, I can get back to this on

[jira] [Updated] (YARN-10763) Add the number of containers assigned per second metrics to ClusterMetrics

2021-05-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10763: Summary: Add the number of containers assigned per second metrics to ClusterMetrics (was: add

[jira] [Commented] (YARN-10258) Add metrics for 'ApplicationsRunning' in NodeManager

2021-05-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346154#comment-17346154 ] Peter Bacsko commented on YARN-10258: - [~BilwaST] yes, I'll check this out. > Add metrics for

[jira] [Commented] (YARN-10763) Add the number of containers assigned per second metrics to ClusterMetrics

2021-05-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346098#comment-17346098 ] Peter Bacsko commented on YARN-10763: - +1 Thanks [~chaosju] for the patch and [~zhuqi] for the

[jira] [Commented] (YARN-10258) Add metrics for 'ApplicationsRunning' in NodeManager

2021-05-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346396#comment-17346396 ] Peter Bacsko commented on YARN-10258: - +1 Thanks for the patch [~gb.ana...@gmail.com] and

<    9   10   11   12   13   14   15   16   17   >