[jira] [Commented] (YARN-10425) Replace the legacy placement engine in CS with the new one

2020-10-30 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223701#comment-17223701 ] Gergely Pollak commented on YARN-10425: --- Thank you for the review [~pbacsko], [~BilwaST] and

[jira] [Updated] (YARN-10425) Replace the legacy placement engine in CS with the new one

2020-10-30 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10425: -- Attachment: YARN-10425.005.patch > Replace the legacy placement engine in CS with the new one

[jira] [Commented] (YARN-10425) Replace the legacy placement engine in CS with the new one

2020-10-29 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222918#comment-17222918 ] Gergely Pollak commented on YARN-10425: --- Patch#4 is about bugfixes again, this time probably all of

[jira] [Updated] (YARN-10425) Replace the legacy placement engine in CS with the new one

2020-10-29 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10425: -- Attachment: YARN-10425.004.patch > Replace the legacy placement engine in CS with the new one

[jira] [Commented] (YARN-10425) Replace the legacy placement engine in CS with the new one

2020-10-28 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1777#comment-1777 ] Gergely Pollak commented on YARN-10425: --- Patch#3 is a rebased version and addressing a major issue

[jira] [Updated] (YARN-10425) Replace the legacy placement engine in CS with the new one

2020-10-28 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10425: -- Attachment: YARN-10425.003.patch > Replace the legacy placement engine in CS with the new one

[jira] [Commented] (YARN-10425) Replace the legacy placement engine in CS with the new one

2020-10-27 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221487#comment-17221487 ] Gergely Pollak commented on YARN-10425: --- Reuploading patch#1 as patch#2 as the test results have

[jira] [Updated] (YARN-10425) Replace the legacy placement engine in CS with the new one

2020-10-27 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10425: -- Attachment: YARN-10425.002.patch > Replace the legacy placement engine in CS with the new one

[jira] [Assigned] (YARN-10457) Add a configuration switch to change between legacy and JSON placement rule format.

2020-10-12 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak reassigned YARN-10457: - Assignee: Gergely Pollak > Add a configuration switch to change between legacy and JSON

[jira] [Created] (YARN-10457) Add a configuration switch to change between legacy and JSON placement rule format.

2020-10-12 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10457: - Summary: Add a configuration switch to change between legacy and JSON placement rule format. Key: YARN-10457 URL: https://issues.apache.org/jira/browse/YARN-10457

[jira] [Updated] (YARN-10425) Replace the legacy placement engine in CS with the new one

2020-10-07 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10425: -- Attachment: YARN-10425.001.patch > Replace the legacy placement engine in CS with the new one

[jira] [Commented] (YARN-10413) Change fs2cs to generate mapping rules in the new format

2020-09-22 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17200070#comment-17200070 ] Gergely Pollak commented on YARN-10413: --- [~pbacsko] thank you for the update. LGTM+1 (Non-binding)

[jira] [Commented] (YARN-10413) Change fs2cs to generate mapping rules in the new format

2020-09-18 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198361#comment-17198361 ] Gergely Pollak commented on YARN-10413: --- Thank you [~pbacsko] for the patch, I don't see any major

[jira] [Commented] (YARN-10387) Implement logic which returns MappingRule objects based on mapping rules

2020-09-09 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192768#comment-17192768 ] Gergely Pollak commented on YARN-10387: --- Thank you [~pbacsko] for the changes, LGTM +1

[jira] [Commented] (YARN-10387) Implement logic which returns MappingRule objects based on mapping rules

2020-09-08 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17192198#comment-17192198 ] Gergely Pollak commented on YARN-10387: --- Hi [~pbacsko] thank you for the patch it's really clean

[jira] [Updated] (YARN-10415) Create a group matcher which checks ALL groups of the user

2020-09-07 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10415: -- Attachment: YARN-10415.003.patch > Create a group matcher which checks ALL groups of the user

[jira] [Created] (YARN-10426) Cleanup CSMappingPlacementRule remaining minor issues

2020-09-04 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10426: - Summary: Cleanup CSMappingPlacementRule remaining minor issues Key: YARN-10426 URL: https://issues.apache.org/jira/browse/YARN-10426 Project: Hadoop YARN

[jira] [Assigned] (YARN-10425) Replace the legacy placement engine in CS with the new one

2020-09-04 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak reassigned YARN-10425: - Assignee: Gergely Pollak > Replace the legacy placement engine in CS with the new one >

[jira] [Created] (YARN-10425) Replace the legacy placement engine in CS with the new one

2020-09-04 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10425: - Summary: Replace the legacy placement engine in CS with the new one Key: YARN-10425 URL: https://issues.apache.org/jira/browse/YARN-10425 Project: Hadoop YARN

[jira] [Updated] (YARN-10415) Create a group matcher which checks ALL groups of the user

2020-09-04 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10415: -- Attachment: YARN-10415.002.patch > Create a group matcher which checks ALL groups of the user

[jira] [Updated] (YARN-10411) Create an allowCreate flag for MappingRuleAction

2020-09-04 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10411: -- Attachment: (was: YARN-10415.002.patch) > Create an allowCreate flag for MappingRuleAction

[jira] [Updated] (YARN-10411) Create an allowCreate flag for MappingRuleAction

2020-09-04 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10411: -- Attachment: YARN-10415.002.patch > Create an allowCreate flag for MappingRuleAction >

[jira] [Updated] (YARN-10411) Create an allowCreate flag for MappingRuleAction

2020-09-04 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10411: -- Attachment: YARN-10411.002.patch > Create an allowCreate flag for MappingRuleAction >

[jira] [Updated] (YARN-10376) Create a class that covers the functionality of UserGroupMappingPlacementRule and AppNameMappingPlacementRule using the new mapping rules

2020-09-04 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10376: -- Attachment: YARN-10376.003.patch > Create a class that covers the functionality of

[jira] [Commented] (YARN-10376) Create a class that covers the functionality of UserGroupMappingPlacementRule and AppNameMappingPlacementRule using the new mapping rules

2020-09-04 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190725#comment-17190725 ] Gergely Pollak commented on YARN-10376: --- Thank you for the feedback [~snemeth] and [~pbacsko], I've

[jira] [Created] (YARN-10420) Update CS MappingRule documentation with the new format and features

2020-09-02 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10420: - Summary: Update CS MappingRule documentation with the new format and features Key: YARN-10420 URL: https://issues.apache.org/jira/browse/YARN-10420 Project: Hadoop

[jira] [Updated] (YARN-10411) Create an allowCreate flag for MappingRuleAction

2020-09-02 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10411: -- Attachment: YARN-10411.001.patch > Create an allowCreate flag for MappingRuleAction >

[jira] [Updated] (YARN-10411) Create an allowCreate flag for MappingRuleAction

2020-09-02 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10411: -- Attachment: (was: YARN-10370.001.patch) > Create an allowCreate flag for MappingRuleAction

[jira] [Updated] (YARN-10415) Create a group matcher which checks ALL groups of the user

2020-09-02 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10415: -- Attachment: YARN-10415.001.patch > Create a group matcher which checks ALL groups of the user

[jira] [Updated] (YARN-10372) Create MappingRule class to represent each CS mapping rule

2020-09-02 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10372: -- Attachment: YARN-10372.003.patch > Create MappingRule class to represent each CS mapping rule

[jira] [Updated] (YARN-10376) Create a class that covers the functionality of UserGroupMappingPlacementRule and AppNameMappingPlacementRule using the new mapping rules

2020-09-02 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10376: -- Attachment: YARN-10376.002.patch > Create a class that covers the functionality of

[jira] [Updated] (YARN-10375) CS Mapping rule config parser should return MappingRule objects

2020-09-02 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10375: -- Attachment: YARN-10375.002.patch > CS Mapping rule config parser should return MappingRule

[jira] [Updated] (YARN-10374) Create Actions for CS mapping rules

2020-09-01 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10374: -- Attachment: YARN-10374.003.patch > Create Actions for CS mapping rules >

[jira] [Updated] (YARN-10372) Create MappingRule class to represent each CS mapping rule

2020-08-31 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10372: -- Attachment: YARN-10372.002.patch > Create MappingRule class to represent each CS mapping rule

[jira] [Commented] (YARN-10374) Create Actions for CS mapping rules

2020-08-31 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187844#comment-17187844 ] Gergely Pollak commented on YARN-10374: --- Test failure is unrelated, fixed checkstyle warnings.

[jira] [Updated] (YARN-10374) Create Actions for CS mapping rules

2020-08-31 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10374: -- Attachment: YARN-10374.002.patch > Create Actions for CS mapping rules >

[jira] [Created] (YARN-10415) Create a group matcher which checks ALL groups of the user

2020-08-29 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10415: - Summary: Create a group matcher which checks ALL groups of the user Key: YARN-10415 URL: https://issues.apache.org/jira/browse/YARN-10415 Project: Hadoop YARN

[jira] [Commented] (YARN-10373) Create Matchers for CS mapping rules

2020-08-29 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17186948#comment-17186948 ] Gergely Pollak commented on YARN-10373: --- Fxied the typos and checkstyle issues. For the logging and

[jira] [Updated] (YARN-10373) Create Matchers for CS mapping rules

2020-08-29 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10373: -- Attachment: YARN-10373.002.patch > Create Matchers for CS mapping rules >

[jira] [Updated] (YARN-10371) Create variable context class for CS queue mapping rules

2020-08-29 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10371: -- Attachment: YARN-10371.002.patch > Create variable context class for CS queue mapping rules >

[jira] [Commented] (YARN-10371) Create variable context class for CS queue mapping rules

2020-08-29 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17186934#comment-17186934 ] Gergely Pollak commented on YARN-10371: --- Fixed the checkstyle issues. Testcase failure is obviously

[jira] [Created] (YARN-10414) Improve logging in CS placement rules to help debuggability

2020-08-29 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10414: - Summary: Improve logging in CS placement rules to help debuggability Key: YARN-10414 URL: https://issues.apache.org/jira/browse/YARN-10414 Project: Hadoop YARN

[jira] [Created] (YARN-10412) Move CS placement rule related changes to a separate package

2020-08-29 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10412: - Summary: Move CS placement rule related changes to a separate package Key: YARN-10412 URL: https://issues.apache.org/jira/browse/YARN-10412 Project: Hadoop YARN

[jira] [Commented] (YARN-10409) Improve MockQueueHierarchyBuilder to detect queue ambiguity

2020-08-29 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17186932#comment-17186932 ] Gergely Pollak commented on YARN-10409: --- Fixed the checkstyle warning. Test failures are unrelated,

[jira] [Updated] (YARN-10409) Improve MockQueueHierarchyBuilder to detect queue ambiguity

2020-08-29 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10409: -- Attachment: YARN-10409.002.patch > Improve MockQueueHierarchyBuilder to detect queue ambiguity

[jira] [Updated] (YARN-10411) Create an allowCreate flag for MappingRuleAction

2020-08-29 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10411: -- Summary: Create an allowCreate flag for MappingRuleAction (was: Create an allowCreate flag

[jira] [Created] (YARN-10411) Create an allowCreate flag for MappingRules

2020-08-28 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10411: - Summary: Create an allowCreate flag for MappingRules Key: YARN-10411 URL: https://issues.apache.org/jira/browse/YARN-10411 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-10386) Create new JSON schema for Placement Rules

2020-08-27 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17185790#comment-17185790 ] Gergely Pollak commented on YARN-10386: --- I'm not sure I understand your defaultQueue comment

[jira] [Updated] (YARN-10372) Create MappingRule class to represent each CS mapping rule

2020-08-25 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10372: -- Attachment: YARN-10372.001.patch > Create MappingRule class to represent each CS mapping rule

[jira] [Updated] (YARN-10373) Create Matchers for CS mapping rules

2020-08-25 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10373: -- Attachment: YARN-10373.001.patch > Create Matchers for CS mapping rules >

[jira] [Updated] (YARN-10371) Create variable context class for CS queue mapping rules

2020-08-25 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10371: -- Attachment: YARN-10371.001.patch > Create variable context class for CS queue mapping rules >

[jira] [Updated] (YARN-10408) Extract MockQueueHierarchyBuilder to a separate class

2020-08-25 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10408: -- Attachment: YARN-10408.001.patch > Extract MockQueueHierarchyBuilder to a separate class >

[jira] [Updated] (YARN-10409) Improve MockQueueHierarchyBuilder to detect queue ambiguity

2020-08-25 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10409: -- Attachment: YARN-10409.001.patch > Improve MockQueueHierarchyBuilder to detect queue ambiguity

[jira] [Updated] (YARN-10408) Extract MockQueueHierarchyBuilder to a separate class

2020-08-25 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10408: -- Attachment: (was: 0001-YARN-10408-Extract-MockQueueHierarchyBuilder-to-a-se.patch) >

[jira] [Updated] (YARN-10409) Improve MockQueueHierarchyBuilder to detect queue ambiguity

2020-08-25 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10409: -- Attachment: (was: 0002-YARN-10409-Improve-MockQueueHierarchyBuilder-to-dete.patch) >

[jira] [Updated] (YARN-10371) Create variable context class for CS queue mapping rules

2020-08-25 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10371: -- Attachment: (was: 0003-YARN-10371-Create-variable-context-class-for-CS-queu.patch) >

[jira] [Updated] (YARN-10376) Create a class that covers the functionality of UserGroupMappingPlacementRule and AppNameMappingPlacementRule using the new mapping rules

2020-08-25 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10376: -- Summary: Create a class that covers the functionality of UserGroupMappingPlacementRule and

[jira] [Assigned] (YARN-10409) Improve MockQueueHierarchyBuilder to detect queue ambiguity

2020-08-25 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak reassigned YARN-10409: - Assignee: Gergely Pollak > Improve MockQueueHierarchyBuilder to detect queue ambiguity

[jira] [Created] (YARN-10409) Improve MockQueueHierarchyBuilder to detect queue ambiguity

2020-08-25 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10409: - Summary: Improve MockQueueHierarchyBuilder to detect queue ambiguity Key: YARN-10409 URL: https://issues.apache.org/jira/browse/YARN-10409 Project: Hadoop YARN

[jira] [Created] (YARN-10408) Extract MockQueueHierarchyBuilder to a separate class

2020-08-25 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10408: - Summary: Extract MockQueueHierarchyBuilder to a separate class Key: YARN-10408 URL: https://issues.apache.org/jira/browse/YARN-10408 Project: Hadoop YARN

[jira] [Updated] (YARN-10376) Replace the UserGroupMappingPlacementRule and AppNameMappingPlacementRule classes with a generic one

2020-07-28 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10376: -- Description: As per the design document attached to the umbrella Jira (YARN-10370), we need to

[jira] [Created] (YARN-10376) Replace the UserGroupMappingPlacementRule and AppNameMappingPlacementRule classes with a generic one

2020-07-28 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10376: - Summary: Replace the UserGroupMappingPlacementRule and AppNameMappingPlacementRule classes with a generic one Key: YARN-10376 URL:

[jira] [Updated] (YARN-10375) CS Mapping rule config parser should return MappingRule objects

2020-07-28 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10375: -- Description: As per the design document attached to the umbrella Jira (YARN-10370), we need to

[jira] [Created] (YARN-10375) CS Mapping rule config parser should return MappingRule objects

2020-07-28 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10375: - Summary: CS Mapping rule config parser should return MappingRule objects Key: YARN-10375 URL: https://issues.apache.org/jira/browse/YARN-10375 Project: Hadoop YARN

[jira] [Updated] (YARN-10374) Create Actions for CS mapping rules

2020-07-28 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10374: -- Description: As per the design document attached to the umbrella Jira (YARN-10370), we need to

[jira] [Created] (YARN-10374) Create Actions for CS mapping rules

2020-07-28 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10374: - Summary: Create Actions for CS mapping rules Key: YARN-10374 URL: https://issues.apache.org/jira/browse/YARN-10374 Project: Hadoop YARN Issue Type: New

[jira] [Updated] (YARN-10373) Create Matchers for CS mapping rules

2020-07-28 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10373: -- Description: As per the design document attached to the umbrella Jira (YARN-10370), we need to

[jira] [Created] (YARN-10373) Create Matchers for CS mapping rules

2020-07-28 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10373: - Summary: Create Matchers for CS mapping rules Key: YARN-10373 URL: https://issues.apache.org/jira/browse/YARN-10373 Project: Hadoop YARN Issue Type: New

[jira] [Updated] (YARN-10372) Create MappingRule class to represent each CS mapping rule

2020-07-28 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10372: -- Description: As per the design document attached to the umbrella Jira (YARN-10370), we need a

[jira] [Created] (YARN-10372) Create MappingRule class to represent each CS mapping rule

2020-07-28 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10372: - Summary: Create MappingRule class to represent each CS mapping rule Key: YARN-10372 URL: https://issues.apache.org/jira/browse/YARN-10372 Project: Hadoop YARN

[jira] [Updated] (YARN-10371) Create variable context class for CS queue mapping rules

2020-07-28 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10371: -- Component/s: yarn > Create variable context class for CS queue mapping rules >

[jira] [Created] (YARN-10371) Create variable context class for CS queue mapping rules

2020-07-28 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10371: - Summary: Create variable context class for CS queue mapping rules Key: YARN-10371 URL: https://issues.apache.org/jira/browse/YARN-10371 Project: Hadoop YARN

[jira] [Updated] (YARN-10370) [Umbrella] Reduce the feature gap between FS Placement Rules and CS Queue Mapping rules

2020-07-28 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10370: -- Attachment: Possible extensions of mapping rule format in Capacity Scheduler.pdf > [Umbrella]

[jira] [Created] (YARN-10370) [Umbrella] Reduce the feature gap between FS Placement Rules and CS Queue Mapping rules

2020-07-28 Thread Gergely Pollak (Jira)
Gergely Pollak created YARN-10370: - Summary: [Umbrella] Reduce the feature gap between FS Placement Rules and CS Queue Mapping rules Key: YARN-10370 URL: https://issues.apache.org/jira/browse/YARN-10370

[jira] [Commented] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-06-26 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17146264#comment-17146264 ] Gergely Pollak commented on YARN-10278: --- Thank you [~snemeth] for the patch, it is already much

[jira] [Commented] (YARN-10277) CapacityScheduler test TestUserGroupMappingPlacementRule should build proper hierarchy

2020-06-23 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143035#comment-17143035 ] Gergely Pollak commented on YARN-10277: --- Thank you for the fix [~snemeth] , the patch seems fine to

[jira] [Commented] (YARN-10279) Avoid unnecessary QueueMappingEntity creations

2020-06-23 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17142786#comment-17142786 ] Gergely Pollak commented on YARN-10279: --- [~mhudaky] thank you for the patch, LGTM+1 (non-binding),

[jira] [Commented] (YARN-10277) CapacityScheduler test TestUserGroupMappingPlacementRule should build proper hierarchy

2020-06-18 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139459#comment-17139459 ] Gergely Pollak commented on YARN-10277: --- Thank you for the path [~snemeth], I really like the

[jira] [Commented] (YARN-10321) Break down TestUserGroupMappingPlacementRule#testMapping into test scenarios

2020-06-18 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139399#comment-17139399 ] Gergely Pollak commented on YARN-10321: --- Thank you [~snemeth] for the patch, I think it makes much

[jira] [Updated] (YARN-10281) Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule

2020-06-17 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10281: -- Attachment: YARN-10281.branch-3.3.001.patch > Redundant QueuePath usage in

[jira] [Updated] (YARN-10281) Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule

2020-06-16 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10281: -- Attachment: YARN-10281.004.patch > Redundant QueuePath usage in UserGroupMappingPlacementRule

[jira] [Updated] (YARN-10274) Merge QueueMapping and QueueMappingEntity

2020-06-16 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10274: -- Attachment: YARN-10274.branch-3.3.003.patch > Merge QueueMapping and QueueMappingEntity >

[jira] [Updated] (YARN-10274) Merge QueueMapping and QueueMappingEntity

2020-06-09 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10274: -- Attachment: YARN-10274.branch-3.3.002.patch > Merge QueueMapping and QueueMappingEntity >

[jira] [Updated] (YARN-10281) Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule

2020-06-09 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10281: -- Attachment: YARN-10281.003.patch > Redundant QueuePath usage in UserGroupMappingPlacementRule

[jira] [Updated] (YARN-10274) Merge QueueMapping and QueueMappingEntity

2020-06-08 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10274: -- Attachment: YARN-10274.branch-3.3.001.patch > Merge QueueMapping and QueueMappingEntity >

[jira] [Updated] (YARN-10281) Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule

2020-06-08 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10281: -- Attachment: YARN-10281.002.patch > Redundant QueuePath usage in UserGroupMappingPlacementRule

[jira] [Commented] (YARN-10275) CapacityScheduler QueuePath object should be able to parse paths

2020-06-04 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125837#comment-17125837 ] Gergely Pollak commented on YARN-10275: --- This Jira is very likely to become invalid, since during

[jira] [Commented] (YARN-10281) Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule

2020-06-03 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124905#comment-17124905 ] Gergely Pollak commented on YARN-10281: --- This probably will fail, since the dependency is not

[jira] [Updated] (YARN-10281) Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule

2020-06-03 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10281: -- Attachment: YARN-10281.001.patch > Redundant QueuePath usage in UserGroupMappingPlacementRule

[jira] [Updated] (YARN-10274) Merge QueueMapping and QueueMappingEntity

2020-06-03 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10274: -- Attachment: YARN-10274.003.patch > Merge QueueMapping and QueueMappingEntity >

[jira] [Updated] (YARN-10274) Merge QueueMapping and QueueMappingEntity

2020-06-02 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10274: -- Attachment: YARN-10274.002.patch > Merge QueueMapping and QueueMappingEntity >

[jira] [Updated] (YARN-10274) Merge QueueMapping and QueueMappingEntity

2020-05-28 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10274: -- Attachment: YARN-10274.001.patch > Merge QueueMapping and QueueMappingEntity >

[jira] [Commented] (YARN-10274) Merge QueueMapping and QueueMappingEntity

2020-05-28 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118651#comment-17118651 ] Gergely Pollak commented on YARN-10274: --- Kept QueueMapping, and replaced all uses of 

[jira] [Commented] (YARN-10276) Check and improve memory footprint of CapacityScheduler CSQueueStore

2020-05-27 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117694#comment-17117694 ] Gergely Pollak commented on YARN-10276: --- I've conducted the following test: Replaced the actual

[jira] [Resolved] (YARN-10276) Check and improve memory footprint of CapacityScheduler CSQueueStore

2020-05-27 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak resolved YARN-10276. --- Resolution: Won't Fix > Check and improve memory footprint of CapacityScheduler CSQueueStore

[jira] [Commented] (YARN-10254) CapacityScheduler incorrect User Group Mapping after leaf queue change

2020-05-27 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117684#comment-17117684 ] Gergely Pollak commented on YARN-10254: --- YARN-10108 Have been backported to 3.3, so I upload a 3.3

[jira] [Updated] (YARN-10254) CapacityScheduler incorrect User Group Mapping after leaf queue change

2020-05-27 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10254: -- Attachment: YARN-10254.branch-3.3.001.patch > CapacityScheduler incorrect User Group Mapping

[jira] [Commented] (YARN-10108) FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping

2020-05-21 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113648#comment-17113648 ] Gergely Pollak commented on YARN-10108: --- Thank you [~snemeth], it seems the build for 3.3 was

[jira] [Updated] (YARN-10108) FS-CS converter: nestedUserQueue with default rule results in invalid queue mapping

2020-05-21 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10108: -- Attachment: YARN-10108.branch-3.3.002.patch > FS-CS converter: nestedUserQueue with default

[jira] [Updated] (YARN-10254) CapacityScheduler incorrect User Group Mapping after leaf queue change

2020-05-21 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10254: -- Attachment: YARN-10254.005.patch > CapacityScheduler incorrect User Group Mapping after leaf

  1   2   3   >