[jira] [Updated] (YARN-10620) fs2cs: parentQueue for certain placement rules are not set during conversion

2021-02-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10620: Attachment: YARN-10620-001.patch > fs2cs: parentQueue for certain placement rules are not set

[jira] [Updated] (YARN-10620) fs2cs: parentQueue for certain placement rules are not set during conversion

2021-02-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10620: Description: There are some placement rules in FS which are currently not handled properly by

[jira] [Created] (YARN-10620) fs2cs: parentQueue for certain placement rules are not set during conversion

2021-02-09 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10620: --- Summary: fs2cs: parentQueue for certain placement rules are not set during conversion Key: YARN-10620 URL: https://issues.apache.org/jira/browse/YARN-10620 Project:

[jira] [Updated] (YARN-10593) Fix incorrect string comparison in GpuDiscoverer

2021-02-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10593: Attachment: YARN-10593-001.patch > Fix incorrect string comparison in GpuDiscoverer >

[jira] [Commented] (YARN-10593) Fix incorrect string comparison in GpuDiscoverer

2021-02-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280948#comment-17280948 ] Peter Bacsko commented on YARN-10593: - [~zhuqi] thanks, but I already have a patch in progress, I

[jira] [Commented] (YARN-10615) Fix Auto Queue Creation hierarchy construction to use queue path instead of short queue name

2021-02-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279660#comment-17279660 ] Peter Bacsko commented on YARN-10615: - Retriggered Jenkins. > Fix Auto Queue Creation hierarchy

[jira] [Commented] (YARN-10600) Convert root queue in fs2cs weight mode conversion

2021-01-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17273966#comment-17273966 ] Peter Bacsko commented on YARN-10600: - +1. Thanks for the patch [~bteke] and [~gandras] for the

[jira] [Updated] (YARN-10599) fs2cs should generate new "auto-queue-creation-v2.enabled" properties for all parents

2021-01-27 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10599: Attachment: YARN-10599-002.patch > fs2cs should generate new "auto-queue-creation-v2.enabled"

[jira] [Updated] (YARN-10599) fs2cs should generate new "auto-queue-creation-v2.enabled" properties for all parents

2021-01-27 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10599: Attachment: YARN-10599-001.patch > fs2cs should generate new "auto-queue-creation-v2.enabled"

[jira] [Comment Edited] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-27 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272778#comment-17272778 ] Peter Bacsko edited comment on YARN-10596 at 1/27/21, 11:17 AM: Just for

[jira] [Commented] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-27 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272778#comment-17272778 ] Peter Bacsko commented on YARN-10596: - Just for proper documentation: this solution means that

[jira] [Updated] (YARN-10599) fs2cs should generate new "auto-queue-creation-v2.enabled" properties for all parents

2021-01-27 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10599: Description: The property {{yarn.scheduler.capacity..auto-queue-creation-v2.enabled}} is not

[jira] [Updated] (YARN-10599) fs2cs should generate new "auto-queue-creation-v2.enabled" properties for all parents

2021-01-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10599: Description: The property {{yarn.scheduler.capacity..auto-queue-creation-v2.enabled}} is not

[jira] [Updated] (YARN-10599) fs2cs should generate new "auto-queue-creation-v2.enabled" properties for all parents

2021-01-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10599: Description: The property {{yarn.scheduler.capacity..auto-queue-creation-v2.enabled}} is not

[jira] [Updated] (YARN-10599) fs2cs should generate new "auto-queue-creation-v2.enabled" properties for all parents

2021-01-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10599: Description: The property {{yarn.scheduler.capacity..auto-queue-creation-v2.enabled}} is not

[jira] [Created] (YARN-10599) fs2cs should generate new "auto-queue-creation-v2.enabled" properties for all parents

2021-01-26 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10599: --- Summary: fs2cs should generate new "auto-queue-creation-v2.enabled" properties for all parents Key: YARN-10599 URL: https://issues.apache.org/jira/browse/YARN-10599

[jira] [Updated] (YARN-10576) Update Capacity Scheduler documentation about JSON-based placement mapping

2021-01-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10576: Attachment: YARN-10576-001.patch > Update Capacity Scheduler documentation about JSON-based

[jira] [Comment Edited] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271355#comment-17271355 ] Peter Bacsko edited comment on YARN-10596 at 1/25/21, 3:04 PM: --- Ok, I've

[jira] [Commented] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271355#comment-17271355 ] Peter Bacsko commented on YARN-10596: - Ok, I've just read this sentence: _Since it is not an edge

[jira] [Comment Edited] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271342#comment-17271342 ] Peter Bacsko edited comment on YARN-10596 at 1/25/21, 2:53 PM: --- [~gandras]

[jira] [Comment Edited] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271342#comment-17271342 ] Peter Bacsko edited comment on YARN-10596 at 1/25/21, 2:38 PM: --- [~gandras]

[jira] [Commented] (YARN-10596) Allow static definition of childless ParentQueues with auto-queue-creation-v2 enabled

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271342#comment-17271342 ] Peter Bacsko commented on YARN-10596: - [~gandras] I have a question. {noformat} // Auto created

[jira] [Commented] (YARN-10593) Fix incorrect string comparison in GpuDiscoverer

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271298#comment-17271298 ] Peter Bacsko commented on YARN-10593: - Unfortunately, Zoltan Siegl's comment has not been addressed: 

[jira] [Created] (YARN-10593) Fix incorrect string comparison in GpuDiscoverer

2021-01-25 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10593: --- Summary: Fix incorrect string comparison in GpuDiscoverer Key: YARN-10593 URL: https://issues.apache.org/jira/browse/YARN-10593 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-10576) Update Capacity Scheduler documentation about JSON-based placement mapping

2021-01-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10576: Summary: Update Capacity Scheduler documentation about JSON-based placement mapping (was: Update

[jira] [Commented] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

2021-01-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269225#comment-17269225 ] Peter Bacsko commented on YARN-10581: - Yes. +1 from me (pending Jenkins). > CS Flexible Auto Queue

[jira] [Commented] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

2021-01-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269181#comment-17269181 ] Peter Bacsko commented on YARN-10581: - I have one question: automatically created leaf queues are now

[jira] [Comment Edited] (YARN-10581) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include queue creation type for queues

2021-01-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17269181#comment-17269181 ] Peter Bacsko edited comment on YARN-10581 at 1/21/21, 9:47 AM: --- I have one

[jira] [Commented] (YARN-10579) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include weight values for queues

2021-01-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268665#comment-17268665 ] Peter Bacsko commented on YARN-10579: - +1 pending Jenkins. > CS Flexible Auto Queue Creation: Modify

[jira] [Comment Edited] (YARN-10512) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include mode of operation for CS

2021-01-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267894#comment-17267894 ] Peter Bacsko edited comment on YARN-10512 at 1/19/21, 1:51 PM: --- I just have

[jira] [Commented] (YARN-10512) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include mode of operation for CS

2021-01-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267894#comment-17267894 ] Peter Bacsko commented on YARN-10512: - I just have very minor nits: {noformat}

[jira] [Commented] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode and enable it by default

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267523#comment-17267523 ] Peter Bacsko commented on YARN-10573: - [~snemeth] that's actually a XOR, and yes, it's intentional.

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode and enable it by default

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Description: If we're using weight mode, we have much more freedom when it comes to placement

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode and enable it by default

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Description: If we're using weight mode, we have much more freedom when it comes to placement

[jira] [Updated] (YARN-10577) Automatically convert placement rules in fs2cs

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10577: Description: Currently, users have to use "\-m" or "\-\-convert-placement-rules" switch to

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode and enable it by default

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Summary: Enhance placement rule conversion in fs2cs in weight mode and enable it by default (was:

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Attachment: YARN-10573-003.patch > Enhance placement rule conversion in fs2cs in weight mode >

[jira] [Commented] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267355#comment-17267355 ] Peter Bacsko commented on YARN-10573: - Note: I merged the contents of YARN-10577 into this patch.

[jira] [Updated] (YARN-10577) Automatically convert placement rules in fs2cs

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10577: Attachment: YARN-10577-001.patch > Automatically convert placement rules in fs2cs >

[jira] [Updated] (YARN-10577) Automatically convert placement rules in fs2cs

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10577: Attachment: YARN-10573-002.patch > Automatically convert placement rules in fs2cs >

[jira] [Updated] (YARN-10577) Automatically convert placement rules in fs2cs

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10577: Attachment: (was: YARN-10573-002.patch) > Automatically convert placement rules in fs2cs >

[jira] [Created] (YARN-10577) Automatically convert placement rules in fs2cs

2021-01-18 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10577: --- Summary: Automatically convert placement rules in fs2cs Key: YARN-10577 URL: https://issues.apache.org/jira/browse/YARN-10577 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-10576) Update Capacity Scheduler about JSON-based placement mapping

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10576: Description: The weight mode and AQC also affects how the new placement engine in CS works and

[jira] [Created] (YARN-10576) Update Capacity Scheduler about JSON-based placement mapping

2021-01-18 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10576: --- Summary: Update Capacity Scheduler about JSON-based placement mapping Key: YARN-10576 URL: https://issues.apache.org/jira/browse/YARN-10576 Project: Hadoop YARN

[jira] [Commented] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267282#comment-17267282 ] Peter Bacsko commented on YARN-10573: - Ok, tiny checkstyle problem handled in patch v2. [~bteke]

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Attachment: YARN-10573-002.patch > Enhance placement rule conversion in fs2cs in weight mode >

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Labels: fs2cs (was: ) > Enhance placement rule conversion in fs2cs in weight mode >

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Attachment: YARN-10573-001.patch > Enhance placement rule conversion in fs2cs in weight mode >

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Description: If we're using weight mode, we have much more freedom when it comes to placement

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Description: If we're using weight mode, we have much more freedom when it comes to placement

[jira] [Updated] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10573: Description: If we're using weight mode, we have much more freedom when it comes to placement

[jira] [Created] (YARN-10573) Enhance placement rule conversion in fs2cs in weight mode

2021-01-15 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10573: --- Summary: Enhance placement rule conversion in fs2cs in weight mode Key: YARN-10573 URL: https://issues.apache.org/jira/browse/YARN-10573 Project: Hadoop YARN

[jira] [Comment Edited] (YARN-10535) Make queue placement in CapacityScheduler compliant with auto-queue-placement

2021-01-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265947#comment-17265947 ] Peter Bacsko edited comment on YARN-10535 at 1/15/21, 11:41 AM: Initial

[jira] [Commented] (YARN-10535) Make queue placement in CapacityScheduler compliant with auto-queue-placement

2021-01-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265947#comment-17265947 ] Peter Bacsko commented on YARN-10535: - Initial review: 1. Remove star imports: {{import

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265144#comment-17265144 ] Peter Bacsko commented on YARN-10506: - "_It is possible when the rule checks, the queue allow

[jira] [Comment Edited] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264977#comment-17264977 ] Peter Bacsko edited comment on YARN-10506 at 1/14/21, 3:56 PM: ---

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264977#comment-17264977 ] Peter Bacsko commented on YARN-10506: - *Clarification comment* I turned out I misunderstood

[jira] [Comment Edited] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264903#comment-17264903 ] Peter Bacsko edited comment on YARN-10506 at 1/14/21, 1:50 PM: --- Hi guys. I

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264903#comment-17264903 ] Peter Bacsko commented on YARN-10506: - Hi guys. I haven't really contributed to this patch and

[jira] [Commented] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264096#comment-17264096 ] Peter Bacsko commented on YARN-10525: - [~zhuqi] thanks for the review, I believe the checkstyle is

[jira] [Updated] (YARN-10562) Follow up changes for YARN-9833

2021-01-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10562: Labels: resourcemanager (was: ) > Follow up changes for YARN-9833 >

[jira] [Commented] (YARN-10562) Follow up changes for YARN-9833

2021-01-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263710#comment-17263710 ] Peter Bacsko commented on YARN-10562: - LGTM +1 from me. > Follow up changes for YARN-9833 >

[jira] [Commented] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263583#comment-17263583 ] Peter Bacsko commented on YARN-10525: - I retriggered it, let's wait for the results. > Add weight

[jira] [Commented] (YARN-10562) Alternate fix for DirectoryCollection.checkDirs() race

2021-01-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17263493#comment-17263493 ] Peter Bacsko commented on YARN-10562: - I was looking at the patch. I *think* I probably understand

[jira] [Updated] (YARN-10570) Remove "experimental" warning message from fs2cs

2021-01-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10570: Labels: fs2cs (was: ) > Remove "experimental" warning message from fs2cs >

[jira] [Updated] (YARN-10570) Remove "experimental" warning message from fs2cs

2021-01-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10570: Attachment: YARN-10570-001.patch > Remove "experimental" warning message from fs2cs >

[jira] [Created] (YARN-10570) Remove "experimental" warning message from fs2cs

2021-01-12 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10570: --- Summary: Remove "experimental" warning message from fs2cs Key: YARN-10570 URL: https://issues.apache.org/jira/browse/YARN-10570 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10525: Attachment: YARN-10525-005.patch > Add weight mode conversion to fs2cs >

[jira] [Updated] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10525: Attachment: YARN-10525-004.patch > Add weight mode conversion to fs2cs >

[jira] [Commented] (YARN-10562) Alternate fix for DirectoryCollection.checkDirs() race

2021-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261543#comment-17261543 ] Peter Bacsko commented on YARN-10562: - Thanks for the patch [~Jim_Brennan]. cc [~leftnoteasy]

[jira] [Updated] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10525: Description: Weight mode will be added to Capacity Scheduler. Currently, we convert FS weights to

[jira] [Updated] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10525: Attachment: YARN-10525-003.patch > Add weight mode conversion to fs2cs >

[jira] [Updated] (YARN-10563) Fix dependency exclusion problem in poms

2021-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10563: Attachment: YARN-10563-001.patch > Fix dependency exclusion problem in poms >

[jira] [Updated] (YARN-10563) Fix dependency exclusion problem in poms

2021-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10563: Description: Currently, {{hadoop-project/pom.xml}} contains a bunch of exclusions for

[jira] [Updated] (YARN-10563) Fix dependency exclusion problem in poms

2021-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10563: Description: Currently, {{hadoop-project/pom.xml}} contains a bunch of exclusions for

[jira] [Updated] (YARN-10563) Fix dependency exclusion problem in poms

2021-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10563: Description: Currently, {{hadoop-project/pom.xml}} contains a bunch of exclusions for

[jira] [Updated] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10525: Attachment: YARN-10525-002.patch > Add weight mode conversion to fs2cs >

[jira] [Commented] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

2021-01-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17261144#comment-17261144 ] Peter Bacsko commented on YARN-10507: - [~gandras] could you check it again? > Add the capability to

[jira] [Commented] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17260791#comment-17260791 ] Peter Bacsko commented on YARN-10525: - Uploaded first version of this patch. We need some changes in

[jira] [Updated] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10525: Attachment: YARN-10525-001.patch > Add weight mode conversion to fs2cs >

[jira] [Updated] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

2021-01-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10507: Attachment: YARN-10507-008.patch > Add the capability to fs2cs to write the converted placement

[jira] [Created] (YARN-10563) Fix dependency exclusion problem in poms

2021-01-07 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10563: --- Summary: Fix dependency exclusion problem in poms Key: YARN-10563 URL: https://issues.apache.org/jira/browse/YARN-10563 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

2021-01-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258219#comment-17258219 ] Peter Bacsko commented on YARN-10507: - Thanks [~gandras] I updated the patch with your suggestions.

[jira] [Updated] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

2021-01-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10507: Attachment: YARN-10507-007.patch > Add the capability to fs2cs to write the converted placement

[jira] [Assigned] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-10525: --- Assignee: Peter Bacsko (was: zhuqi) > Add weight mode conversion to fs2cs >

[jira] [Updated] (YARN-10525) Add weight mode conversion to fs2cs

2021-01-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10525: Summary: Add weight mode conversion to fs2cs (was: Support FS Convert to CS with weight mode

[jira] [Commented] (YARN-9833) Race condition when DirectoryCollection.checkDirs() runs during container launch

2020-12-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248343#comment-17248343 ] Peter Bacsko commented on YARN-9833: [~ebadger] [~Jim_Brennan] thanks for sharing some thougts on

[jira] [Updated] (YARN-10515) Fix flaky test TestCapacitySchedulerAutoQueueCreation.testDynamicAutoQueueCreationWithTags

2020-12-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10515: Component/s: test > Fix flaky test >

[jira] [Commented] (YARN-10496) [Umbrella] Support Flexible Auto Queue Creation in Capacity Scheduler

2020-12-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243149#comment-17243149 ] Peter Bacsko commented on YARN-10496: - _"From the design doc, one proposal is to define max capacity

[jira] [Updated] (YARN-10515) Fix flaky test TestCapacitySchedulerAutoQueueCreation.testDynamicAutoQueueCreationWithTags

2020-12-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10515: Attachment: YARN-10515-001.patch > Fix flaky test >

[jira] [Updated] (YARN-10515) Fix flaky test TestCapacitySchedulerAutoQueueCreation.testDynamicAutoQueueCreationWithTags

2020-12-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10515: Description: The testcase

[jira] [Created] (YARN-10515) Fix flaky test TestCapacitySchedulerAutoQueueCreation.testDynamicAutoQueueCreationWithTags

2020-12-03 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10515: --- Summary: Fix flaky test TestCapacitySchedulerAutoQueueCreation.testDynamicAutoQueueCreationWithTags Key: YARN-10515 URL: https://issues.apache.org/jira/browse/YARN-10515

[jira] [Commented] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

2020-12-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243080#comment-17243080 ] Peter Bacsko commented on YARN-10507: - Failed tests are unrelated but I know how to fix

[jira] [Commented] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

2020-12-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17243075#comment-17243075 ] Peter Bacsko commented on YARN-10507: - [~snemeth] could you review this? There might be parts which

[jira] [Updated] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

2020-12-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10507: Attachment: YARN-10507-006.patch > Add the capability to fs2cs to write the converted placement

[jira] [Updated] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

2020-12-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10507: Attachment: YARN-10507-005.patch > Add the capability to fs2cs to write the converted placement

[jira] [Comment Edited] (YARN-10496) [Umbrella] Support Flexible Auto Queue Creation in Capacity Scheduler

2020-12-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242282#comment-17242282 ] Peter Bacsko edited comment on YARN-10496 at 12/2/20, 11:48 AM: My take:

[jira] [Commented] (YARN-10496) [Umbrella] Support Flexible Auto Queue Creation in Capacity Scheduler

2020-12-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242282#comment-17242282 ] Peter Bacsko commented on YARN-10496: - My take: clearly I think it's between #1 and #2. Both require

[jira] [Comment Edited] (YARN-10496) [Umbrella] Support Flexible Auto Queue Creation in Capacity Scheduler

2020-12-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242282#comment-17242282 ] Peter Bacsko edited comment on YARN-10496 at 12/2/20, 11:42 AM: My take:

[jira] [Updated] (YARN-10507) Add the capability to fs2cs to write the converted placement rules inside capacity-scheduler.xml

2020-12-01 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10507: Attachment: YARN-10507-004.patch > Add the capability to fs2cs to write the converted placement

<    1   2   3   4   5   6   7   8   9   10   >