[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264855#comment-17264855 ] Gergely Pollak commented on YARN-10506: --- Hi [~gandras] [~wangda], *1) How we deal with "create"

[jira] [Comment Edited] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264855#comment-17264855 ] Gergely Pollak edited comment on YARN-10506 at 1/14/21, 12:15 PM: -- Hi

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264903#comment-17264903 ] Peter Bacsko commented on YARN-10506: - Hi guys. I haven't really contributed to this patch and

[jira] [Comment Edited] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264903#comment-17264903 ] Peter Bacsko edited comment on YARN-10506 at 1/14/21, 1:50 PM: --- Hi guys. I

[jira] [Comment Edited] (YARN-7200) SLS generates a realtimetrack.json file but that file is missing the closing ']'

2021-01-14 Thread Agshin Kazimli (Jira)
[ https://issues.apache.org/jira/browse/YARN-7200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264853#comment-17264853 ] Agshin Kazimli edited comment on YARN-7200 at 1/14/21, 12:12 PM: -

[jira] [Commented] (YARN-7200) SLS generates a realtimetrack.json file but that file is missing the closing ']'

2021-01-14 Thread Agshin Kazimli (Jira)
[ https://issues.apache.org/jira/browse/YARN-7200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264853#comment-17264853 ] Agshin Kazimli commented on YARN-7200: -- [~snemeth] Thanks for your thoughts. I've changed the error

[jira] [Comment Edited] (YARN-10572) Merge YARN-8557 and YARN-10352, and rebase based YARN-10380.

2021-01-14 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264155#comment-17264155 ] zhuqi edited comment on YARN-10572 at 1/14/21, 9:03 AM: [~wangda]

[jira] [Commented] (YARN-10564) Support Auto Queue Creation template configurations

2021-01-14 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264919#comment-17264919 ] Andras Gyori commented on YARN-10564: - [~zhuqi] is it okay if I retake this issue, because I have

[jira] [Commented] (YARN-10564) Support Auto Queue Creation template configurations

2021-01-14 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264929#comment-17264929 ] zhuqi commented on YARN-10564: -- [~gandras] Ok, you can take it based the poc , i'm glad to work with you.

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264683#comment-17264683 ] zhuqi commented on YARN-10506: --  [~gandras]  When submit without enabled mapping rules(auto create

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264673#comment-17264673 ] Andras Gyori commented on YARN-10506: - Thank you [~wangda] and [~zhuqi] for the reviews and fixes! I

[jira] [Comment Edited] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264683#comment-17264683 ] zhuqi edited comment on YARN-10506 at 1/14/21, 8:17 AM: Thanks for  [~gandras] 

[jira] [Comment Edited] (YARN-10572) Merge YARN-8557 and YARN-10352, and rebase based YARN-10380.

2021-01-14 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264155#comment-17264155 ] zhuqi edited comment on YARN-10572 at 1/14/21, 9:00 AM: [~leftnoteasy]

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264689#comment-17264689 ] Hadoop QA commented on YARN-10506: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-10572) Merge YARN-8557 and YARN-10352, and rebase based YARN-10380.

2021-01-14 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264155#comment-17264155 ] zhuqi edited comment on YARN-10572 at 1/14/21, 9:01 AM: [~wangda]

[jira] [Comment Edited] (YARN-10572) Merge YARN-8557 and YARN-10352, and rebase based YARN-10380.

2021-01-14 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264155#comment-17264155 ] zhuqi edited comment on YARN-10572 at 1/14/21, 9:02 AM: [~wangda]

[jira] [Comment Edited] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264977#comment-17264977 ] Peter Bacsko edited comment on YARN-10506 at 1/14/21, 3:56 PM: ---

[jira] [Assigned] (YARN-10564) Support Auto Queue Creation template configurations

2021-01-14 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori reassigned YARN-10564: --- Assignee: Andras Gyori (was: zhuqi) > Support Auto Queue Creation template configurations

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265085#comment-17265085 ] Wangda Tan commented on YARN-10506: --- Thanks [~shuzirra], [~pbacsko], posting this comment while in the

[jira] [Comment Edited] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264855#comment-17264855 ] Gergely Pollak edited comment on YARN-10506 at 1/14/21, 3:46 PM: - Hi

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264977#comment-17264977 ] Peter Bacsko commented on YARN-10506: - *Clarification comment* I turned out I misunderstood

[jira] [Comment Edited] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264855#comment-17264855 ] Gergely Pollak edited comment on YARN-10506 at 1/14/21, 3:46 PM: - Hi

[jira] [Commented] (YARN-10535) Make queue placement in CapacityScheduler compliant with auto-queue-placement

2021-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265520#comment-17265520 ] Hadoop QA commented on YARN-10535: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265521#comment-17265521 ] Wangda Tan commented on YARN-10506: --- Sounds good, thanks [~shuzirra], [~pbacsko]. It makes sense to me,

[jira] [Commented] (YARN-10512) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include mode of operation for CS

2021-01-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265403#comment-17265403 ] Szilard Nemeth commented on YARN-10512: --- Added first patch. Just realized that the tests should not

[jira] [Updated] (YARN-10535) Make queue placement in CapacityScheduler compliant with auto-queue-placement

2021-01-14 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10535: -- Attachment: YARN-10535.001.patch > Make queue placement in CapacityScheduler compliant with

[jira] [Updated] (YARN-10512) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include mode of operation for CS

2021-01-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10512: -- Description: Under this umbrella (YARN-10496), weight-mode has been implemented for CS with

[jira] [Updated] (YARN-10512) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include mode of operation for CS

2021-01-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10512: -- Attachment: YARN-10512.001.patch > CS Flexible Auto Queue Creation: Modify RM /scheduler

[jira] [Commented] (YARN-10535) Make queue placement in CapacityScheduler compliant with auto-queue-placement

2021-01-14 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265402#comment-17265402 ] Gergely Pollak commented on YARN-10535: --- The first iteration of the patch includes all

[jira] [Updated] (YARN-10512) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include mode of operation for CS

2021-01-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10512: -- Description: Under this umbrella (YARN-10496), weight-mode has been implemented for CS with

[jira] [Updated] (YARN-10512) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include mode of operation for CS

2021-01-14 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10512: -- Summary: CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include mode of

[jira] [Updated] (YARN-10535) Make changes in queue placement policy to be compliant with auto-queue-placement in CapacityScheduler

2021-01-14 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10535: -- Summary: Make changes in queue placement policy to be compliant with auto-queue-placement in

[jira] [Updated] (YARN-10535) Make queue placement in CapacityScheduler compliant with auto-queue-placement

2021-01-14 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10535: -- Summary: Make queue placement in CapacityScheduler compliant with auto-queue-placement (was:

[jira] [Comment Edited] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265208#comment-17265208 ] Gergely Pollak edited comment on YARN-10506 at 1/14/21, 8:29 PM: - Thank

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265208#comment-17265208 ] Gergely Pollak commented on YARN-10506: --- Actually the queue creation checks were present in the

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265144#comment-17265144 ] Peter Bacsko commented on YARN-10506: - "_It is possible when the rule checks, the queue allow

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265149#comment-17265149 ] Wangda Tan commented on YARN-10506: --- [~pbacsko], I see, I think it makes sense. {quote}The logic must

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265651#comment-17265651 ] zhuqi commented on YARN-10506: -- I update this and fix the check style in 013 patch. Thanks all for patient

[jira] [Comment Edited] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265651#comment-17265651 ] zhuqi edited comment on YARN-10506 at 1/15/21, 2:56 AM: I update this and fix the

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265713#comment-17265713 ] Hadoop QA commented on YARN-10506: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10512) CS Flexible Auto Queue Creation: Modify RM /scheduler endpoint to include mode of operation for CS

2021-01-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265613#comment-17265613 ] Hadoop QA commented on YARN-10512: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265618#comment-17265618 ] zhuqi commented on YARN-10506: -- It makes sense to me. Thanks to [~shuzirra]  [~pbacsko] for your patient

[jira] [Updated] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10506: - Attachment: YARN-10506-013.patch > Update queue creation logic to use weight mode and allow the flexible >

[jira] [Commented] (YARN-10506) Update queue creation logic to use weight mode and allow the flexible static/dynamic creation

2021-01-14 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17265652#comment-17265652 ] Wangda Tan commented on YARN-10506: --- Thanks [~zhuqi], the latest patch looks good to me! I will wait