[jira] [Commented] (YARN-10929) Refrain from creating new Configuration object in AbstractManagedParentQueue#initializeLeafQueueConfigs

2021-09-06 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17410665#comment-17410665 ] Szilard Nemeth commented on YARN-10929: --- Hi [~jackwangcs], As a general rule of thumb: Could you

[jira] [Updated] (YARN-10906) AbstractCSQueue: Create QueueConfig object for generic queue-specific fields

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10906: -- Description: This is about config fields in AbstractCSQueue. Document if a config is only

[jira] [Assigned] (YARN-10906) AbstractCSQueue: Create QueueConfig object for generic queue-specific fields

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10906: - Assignee: Szilard Nemeth > AbstractCSQueue: Create QueueConfig object for generic

[jira] [Updated] (YARN-10906) AbstractCSQueue: Create QueueConfig object for generic queue-specific fields

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10906: -- Summary: AbstractCSQueue: Create QueueConfig object for generic queue-specific fields (was:

[jira] [Assigned] (YARN-10922) Investigation: Verify if legacy AQC works as documented

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10922: - Assignee: Benjamin Teke > Investigation: Verify if legacy AQC works as documented >

[jira] [Updated] (YARN-10909) AbstractCSQueue: Check for methods added for test code but not annotated with VisibleForTesting

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10909: -- Labels: newbie (was: ) > AbstractCSQueue: Check for methods added for test code but not

[jira] [Assigned] (YARN-10908) Investigate: Why AbstractCSQueue#authorizer is constructed for each queue

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10908: - Assignee: Szilard Nemeth > Investigate: Why AbstractCSQueue#authorizer is constructed

[jira] [Assigned] (YARN-10912) AbstractCSQueue#updateConfigurableResourceRequirement: Separate validation logic from initialization logic

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10912: - Assignee: Tamas Domok > AbstractCSQueue#updateConfigurableResourceRequirement: Separate

[jira] [Assigned] (YARN-10917) Investigate and simplify CapacitySchedulerConfigValidator#validateQueueHierarchy

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10917: - Assignee: Tamas Domok > Investigate and simplify >

[jira] [Assigned] (YARN-10914) Simplify duplicated code for tracking ResourceUsage in AbstractCSQueue

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10914: - Assignee: Tamas Domok > Simplify duplicated code for tracking ResourceUsage in

[jira] [Updated] (YARN-10914) Simplify duplicated code for tracking ResourceUsage in AbstractCSQueue

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10914: -- Summary: Simplify duplicated code for tracking ResourceUsage in AbstractCSQueue (was:

[jira] [Assigned] (YARN-10924) Clean up CapacityScheduler#initScheduler

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10924: - Assignee: Gergely Pollák > Clean up CapacityScheduler#initScheduler >

[jira] [Assigned] (YARN-10910) AbstractCSQueue#setupQueueConfigs: Separate validation logic from initialization logic

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10910: - Assignee: Benjamin Teke > AbstractCSQueue#setupQueueConfigs: Separate validation logic

[jira] [Assigned] (YARN-10919) Remove LeafQueue#scheduler field

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10919: - Assignee: Benjamin Teke > Remove LeafQueue#scheduler field >

[jira] [Assigned] (YARN-10911) AbstractCSQueue: Create a separate class for usernames and weights that are travelling in a Map

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10911: - Assignee: Szilard Nemeth > AbstractCSQueue: Create a separate class for usernames and

[jira] [Assigned] (YARN-10905) Investigate if AbstractCSQueue#configuredNodeLabels vs. QueueCapacities#getExistingNodeLabels holds the same data

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10905: - Assignee: Szilard Nemeth > Investigate if AbstractCSQueue#configuredNodeLabels vs. >

[jira] [Assigned] (YARN-10904) Investigate: Remove unnecessary fields from AbstractCSQueue or group fields by feature if possible

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10904: - Assignee: Szilard Nemeth > Investigate: Remove unnecessary fields from AbstractCSQueue

[jira] [Assigned] (YARN-10918) Simplify method: CapacitySchedulerQueueManager#parseQueue

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10918: - Assignee: Andras Gyori > Simplify method: CapacitySchedulerQueueManager#parseQueue >

[jira] [Assigned] (YARN-10915) AbstractCSQueue: Simplify complex logic in methods: deriveCapacityFromAbsoluteConfigurations and updateEffectiveResources

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10915: - Assignee: Benjamin Teke > AbstractCSQueue: Simplify complex logic in methods: >

[jira] [Assigned] (YARN-10913) AbstractCSQueue: Group preemption methods and fields into a separate class

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10913: - Assignee: Szilard Nemeth > AbstractCSQueue: Group preemption methods and fields into a

[jira] [Updated] (YARN-10904) Investigate: Remove unnecessary fields from AbstractCSQueue or group fields by feature if possible

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10904: -- Summary: Investigate: Remove unnecessary fields from AbstractCSQueue or group fields by

[jira] [Assigned] (YARN-10925) Simplify AbstractCSQueue#setupQueueConfigs

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10925: - Assignee: Benjamin Teke > Simplify AbstractCSQueue#setupQueueConfigs >

[jira] [Assigned] (YARN-10907) Investigate: Minimize usages of AbstractCSQueue#csContext

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10907: - Assignee: Benjamin Teke > Investigate: Minimize usages of AbstractCSQueue#csContext >

[jira] [Updated] (YARN-10906) Create QueueConfig object for generic queue-specific fields

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10906: -- Summary: Create QueueConfig object for generic queue-specific fields (was: Create QueueConfig

[jira] [Updated] (YARN-10906) Create QueueConfig object for generic queue-specifie=c fields

2021-08-31 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10906: -- Summary: Create QueueConfig object for generic queue-specifie=c fields (was: Create

[jira] [Created] (YARN-10929) Refrain from creating new Configuration object in AbstractManagedParentQueue#initializeLeafQueueConfigs

2021-08-30 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10929: - Summary: Refrain from creating new Configuration object in AbstractManagedParentQueue#initializeLeafQueueConfigs Key: YARN-10929 URL:

[jira] [Updated] (YARN-10565) Refactor CS queue initialization to simplify weight mode calculation

2021-08-30 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10565: -- Description: In YARN-10504 weight mode support was introduced to CS. This jira is a followup

[jira] [Created] (YARN-10927) Explain assertion literals in testcases of CapacityScheduler and related test classes

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10927: - Summary: Explain assertion literals in testcases of CapacityScheduler and related test classes Key: YARN-10927 URL: https://issues.apache.org/jira/browse/YARN-10927

[jira] [Created] (YARN-10926) Test validation after YARN-10504 and YARN-10506: Check if modified test expectations are correct or not

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10926: - Summary: Test validation after YARN-10504 and YARN-10506: Check if modified test expectations are correct or not Key: YARN-10926 URL:

[jira] [Created] (YARN-10925) Simplify AbstractCSQueue#setupQueueConfigs

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10925: - Summary: Simplify AbstractCSQueue#setupQueueConfigs Key: YARN-10925 URL: https://issues.apache.org/jira/browse/YARN-10925 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-10918) Simplify method: CapacitySchedulerQueueManager#parseQueue

2021-08-29 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10918: -- Description: Ideas for simplifying this method: - Define a queue factory - Separate validation

[jira] [Created] (YARN-10924) Clean up CapacityScheduler#initScheduler

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10924: - Summary: Clean up CapacityScheduler#initScheduler Key: YARN-10924 URL: https://issues.apache.org/jira/browse/YARN-10924 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-10923) Investigate if creating separate classes for Dynamic Leaf / Dynamic Parent queues makes sense

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10923: - Summary: Investigate if creating separate classes for Dynamic Leaf / Dynamic Parent queues makes sense Key: YARN-10923 URL: https://issues.apache.org/jira/browse/YARN-10923

[jira] [Created] (YARN-10922) Investigation: Verify if legacy AQC works as documented

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10922: - Summary: Investigation: Verify if legacy AQC works as documented Key: YARN-10922 URL: https://issues.apache.org/jira/browse/YARN-10922 Project: Hadoop YARN

[jira] [Created] (YARN-10921) AbstractCSQueue: Node Labels logic is scattered and iteration logic is repeated all over the place

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10921: - Summary: AbstractCSQueue: Node Labels logic is scattered and iteration logic is repeated all over the place Key: YARN-10921 URL:

[jira] [Assigned] (YARN-10920) Created a dedicated class for Node Labels

2021-08-29 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-10920: - Assignee: Szilard Nemeth > Created a dedicated class for Node Labels >

[jira] [Created] (YARN-10920) Created a dedicated class for Node Labels

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10920: - Summary: Created a dedicated class for Node Labels Key: YARN-10920 URL: https://issues.apache.org/jira/browse/YARN-10920 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-10919) Remove LeafQueue#scheduler field

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10919: - Summary: Remove LeafQueue#scheduler field Key: YARN-10919 URL: https://issues.apache.org/jira/browse/YARN-10919 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-10918) Simplify method: CapacitySchedulerQueueManager#parseQueue

2021-08-29 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10918: -- Summary: Simplify method: CapacitySchedulerQueueManager#parseQueue (was: Simplify code of

[jira] [Created] (YARN-10918) Simplify code of method: CapacitySchedulerQueueManager#parseQueue

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10918: - Summary: Simplify code of method: CapacitySchedulerQueueManager#parseQueue Key: YARN-10918 URL: https://issues.apache.org/jira/browse/YARN-10918 Project: Hadoop

[jira] [Created] (YARN-10917) Investigate and simplify CapacitySchedulerConfigValidator#validateQueueHierarchy

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10917: - Summary: Investigate and simplify CapacitySchedulerConfigValidator#validateQueueHierarchy Key: YARN-10917 URL: https://issues.apache.org/jira/browse/YARN-10917

[jira] [Created] (YARN-10916) Investigate and simplify GuaranteedOrZeroCapacityOverTimePolicy#computeQueueManagementChanges

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10916: - Summary: Investigate and simplify GuaranteedOrZeroCapacityOverTimePolicy#computeQueueManagementChanges Key: YARN-10916 URL: https://issues.apache.org/jira/browse/YARN-10916

[jira] [Created] (YARN-10915) AbstractCSQueue: Simplify complex logic in methods: deriveCapacityFromAbsoluteConfigurations and updateEffectiveResources

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10915: - Summary: AbstractCSQueue: Simplify complex logic in methods: deriveCapacityFromAbsoluteConfigurations and updateEffectiveResources Key: YARN-10915 URL:

[jira] [Created] (YARN-10914) Simplify duplicated code for tracking ResourceUsage

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10914: - Summary: Simplify duplicated code for tracking ResourceUsage Key: YARN-10914 URL: https://issues.apache.org/jira/browse/YARN-10914 Project: Hadoop YARN

[jira] [Created] (YARN-10913) AbstractCSQueue: Group preemption methods and fields into a separate class

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10913: - Summary: AbstractCSQueue: Group preemption methods and fields into a separate class Key: YARN-10913 URL: https://issues.apache.org/jira/browse/YARN-10913 Project:

[jira] [Created] (YARN-10912) AbstractCSQueue#updateConfigurableResourceRequirement: Separate validation logic from initialization logic

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10912: - Summary: AbstractCSQueue#updateConfigurableResourceRequirement: Separate validation logic from initialization logic Key: YARN-10912 URL:

[jira] [Created] (YARN-10911) AbstractCSQueue: Create a separate class for usernames and weights that are travelling in a Map

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10911: - Summary: AbstractCSQueue: Create a separate class for usernames and weights that are travelling in a Map Key: YARN-10911 URL: https://issues.apache.org/jira/browse/YARN-10911

[jira] [Created] (YARN-10910) AbstractCSQueue#setupQueueConfigs: Separate validation logic from initialization logic

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10910: - Summary: AbstractCSQueue#setupQueueConfigs: Separate validation logic from initialization logic Key: YARN-10910 URL: https://issues.apache.org/jira/browse/YARN-10910

[jira] [Created] (YARN-10909) AbstractCSQueue: Check for methods added for test code but not annotated with VisibleForTesting

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10909: - Summary: AbstractCSQueue: Check for methods added for test code but not annotated with VisibleForTesting Key: YARN-10909 URL: https://issues.apache.org/jira/browse/YARN-10909

[jira] [Created] (YARN-10908) Investigate: Why AbstractCSQueue#authorizer is constructed for each queue

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10908: - Summary: Investigate: Why AbstractCSQueue#authorizer is constructed for each queue Key: YARN-10908 URL: https://issues.apache.org/jira/browse/YARN-10908 Project:

[jira] [Created] (YARN-10907) Investigate: Minimize usages of AbstractCSQueue#csContext

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10907: - Summary: Investigate: Minimize usages of AbstractCSQueue#csContext Key: YARN-10907 URL: https://issues.apache.org/jira/browse/YARN-10907 Project: Hadoop YARN

[jira] [Created] (YARN-10906) Create QueueConfig object for generic queue-specifiec fields

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10906: - Summary: Create QueueConfig object for generic queue-specifiec fields Key: YARN-10906 URL: https://issues.apache.org/jira/browse/YARN-10906 Project: Hadoop YARN

[jira] [Created] (YARN-10905) Investigate if AbstractCSQueue#configuredNodeLabels vs. QueueCapacities#getExistingNodeLabels holds the same data

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10905: - Summary: Investigate if AbstractCSQueue#configuredNodeLabels vs. QueueCapacities#getExistingNodeLabels holds the same data Key: YARN-10905 URL:

[jira] [Created] (YARN-10904) Investigate: Remove unnecessary fields from AbstractCSQueue

2021-08-29 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10904: - Summary: Investigate: Remove unnecessary fields from AbstractCSQueue Key: YARN-10904 URL: https://issues.apache.org/jira/browse/YARN-10904 Project: Hadoop YARN

[jira] [Resolved] (YARN-10891) Extend QueueInfo with max-parallel-apps in CapacityScheduler

2021-08-27 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth resolved YARN-10891. --- Hadoop Flags: Reviewed Resolution: Fixed > Extend QueueInfo with max-parallel-apps in

[jira] [Updated] (YARN-10891) Extend QueueInfo with max-parallel-apps in CapacityScheduler

2021-08-27 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10891: -- Fix Version/s: 3.4.0 > Extend QueueInfo with max-parallel-apps in CapacityScheduler >

[jira] [Updated] (YARN-10889) [Umbrella] Queue Creation in Capacity Scheduler - Tech debts

2021-08-26 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10889: -- Summary: [Umbrella] Queue Creation in Capacity Scheduler - Tech debts (was: [Umbrella]

[jira] [Commented] (YARN-10838) Implement an optimised version of Configuration getPropsWithPrefix

2021-08-24 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403797#comment-17403797 ] Szilard Nemeth commented on YARN-10838: --- Thanks [~bteke] for uploading the new patch, Latest patch

[jira] [Updated] (YARN-10838) Implement an optimised version of Configuration getPropsWithPrefix

2021-08-24 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10838: -- Fix Version/s: 3.4.0 > Implement an optimised version of Configuration getPropsWithPrefix >

[jira] [Commented] (YARN-10814) YARN shouldn't start with empty hadoop.http.authentication.signature.secret.file

2021-08-24 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403774#comment-17403774 ] Szilard Nemeth commented on YARN-10814: --- Hi [~tdomok], Committed patch to branch-3.3 as well.

[jira] [Updated] (YARN-10814) YARN shouldn't start with empty hadoop.http.authentication.signature.secret.file

2021-08-24 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10814: -- Fix Version/s: 3.3.2 > YARN shouldn't start with empty >

[jira] [Updated] (YARN-10522) Document for Flexible Auto Queue Creation in Capacity Scheduler

2021-08-24 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10522: -- Summary: Document for Flexible Auto Queue Creation in Capacity Scheduler (was: Document for

[jira] [Updated] (YARN-10814) YARN shouldn't start with empty hadoop.http.authentication.signature.secret.file

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10814: -- Fix Version/s: 3.3.1 3.2.3 > YARN shouldn't start with empty >

[jira] [Resolved] (YARN-9904) Investigate how resource allocation configuration could be more consistent in CapacityScheduler

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth resolved YARN-9904. -- Resolution: Duplicate Duplicate of YARN-10888 > Investigate how resource allocation

[jira] [Commented] (YARN-10505) Extend the maximum-capacity property to support Fair Scheduler migration

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400999#comment-17400999 ] Szilard Nemeth commented on YARN-10505: --- This jira has been split to three other jiras: YARN-9936

[jira] [Resolved] (YARN-10505) Extend the maximum-capacity property to support Fair Scheduler migration

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth resolved YARN-10505. --- Resolution: Duplicate > Extend the maximum-capacity property to support Fair Scheduler

[jira] [Updated] (YARN-10759) Encapsulate queue config modes

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10759: -- Parent: YARN-10889 Issue Type: Sub-task (was: Improvement) > Encapsulate queue config

[jira] [Updated] (YARN-10887) Investigation: Decouple capacity and max-capacity modes

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10887: -- Parent Issue: YARN-10888 (was: YARN-10496) > Investigation: Decouple capacity and

[jira] [Updated] (YARN-10886) Cluster based and parent based max capacity in Capacity Scheduler

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10886: -- Parent Issue: YARN-10888 (was: YARN-10496) > Cluster based and parent based max capacity in

[jira] [Updated] (YARN-10632) Make maximum depth allowed to be configurable

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10632: -- Parent: YARN-10889 (was: YARN-10496) > Make maximum depth allowed to be configurable >

[jira] [Updated] (YARN-10888) [Umbrella] New capacity modes for CS

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10888: -- Description: *Investigate how resource allocation configuration could be more consistent in

[jira] [Updated] (YARN-10889) [Umbrella] Flexible Auto Queue Creation in Capacity Scheduler - Tech debts

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10889: -- Description: Follow-up of YARN-10496 > [Umbrella] Flexible Auto Queue Creation in Capacity

[jira] [Updated] (YARN-10888) [Umbrella] New capacity modes for CS

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10888: -- Description: *Investigate how resource allocation configuration could be more consistent in

[jira] [Updated] (YARN-10888) [Umbrella] New capacity modes for CS

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10888: -- Description: *Investigate how resource allocation configuration could be more consistent in

[jira] [Updated] (YARN-10758) Mixed mode: Allow relative and absolute mode in the same queue hierarchy

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10758: -- Parent Issue: YARN-10888 (was: YARN-10843) > Mixed mode: Allow relative and absolute mode in

[jira] [Updated] (YARN-9936) Support vector of capacity percentages in Capacity Scheduler configuration

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9936: - Parent Issue: YARN-10888 (was: YARN-10843) > Support vector of capacity percentages in Capacity

[jira] [Updated] (YARN-10582) Increase the test coverage for CSMappingPlacementRule

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10582: -- Parent: YARN-10889 (was: YARN-10496) > Increase the test coverage for CSMappingPlacementRule

[jira] [Updated] (YARN-10565) Refactor CS queue initialization to simplify weight mode calculation

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10565: -- Parent: YARN-10889 (was: YARN-10496) > Refactor CS queue initialization to simplify weight

[jira] [Updated] (YARN-10590) Fix TestCapacitySchedulerAutoCreatedQueueBase with related absolute calculation loss

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10590: -- Parent: YARN-10889 (was: YARN-10496) > Fix TestCapacitySchedulerAutoCreatedQueueBase with

[jira] [Updated] (YARN-10584) Move the functionality of MappingRuleValidationHelper to CSQueueManager

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10584: -- Parent: YARN-10889 (was: YARN-10496) > Move the functionality of MappingRuleValidationHelper

[jira] [Updated] (YARN-10583) Increase the test coverage for validation in MappingRuleValidationHelper

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10583: -- Parent: YARN-10889 (was: YARN-10496) > Increase the test coverage for validation in

[jira] [Updated] (YARN-10646) TestCapacitySchedulerWeightMode test descriptor comments doesn't reflect the correct scenario

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10646: -- Parent Issue: YARN-10888 (was: YARN-10496) > TestCapacitySchedulerWeightMode test descriptor

[jira] [Updated] (YARN-10592) Support QueueCapacities to use vector based multi resource types, and update absolute related to use first.

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10592: -- Parent Issue: YARN-10888 (was: YARN-10496) > Support QueueCapacities to use vector based

[jira] [Updated] (YARN-10505) Extend the maximum-capacity property to support Fair Scheduler migration

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10505: -- Parent Issue: YARN-10888 (was: YARN-10496) > Extend the maximum-capacity property to support

[jira] [Created] (YARN-10889) [Umbrella] Flexible Auto Queue Creation in Capacity Scheduler - Tech debts

2021-08-18 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10889: - Summary: [Umbrella] Flexible Auto Queue Creation in Capacity Scheduler - Tech debts Key: YARN-10889 URL: https://issues.apache.org/jira/browse/YARN-10889 Project:

[jira] [Created] (YARN-10888) [Umbrella] New capacity modes for CS

2021-08-18 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10888: - Summary: [Umbrella] New capacity modes for CS Key: YARN-10888 URL: https://issues.apache.org/jira/browse/YARN-10888 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-10887) Investigation: Decouple capacity and max-capacity modes

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10887: -- Parent: YARN-10496 Issue Type: Sub-task (was: Improvement) > Investigation: Decouple

[jira] [Created] (YARN-10887) Investigation: Decouple capacity and max-capacity modes

2021-08-18 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10887: - Summary: Investigation: Decouple capacity and max-capacity modes Key: YARN-10887 URL: https://issues.apache.org/jira/browse/YARN-10887 Project: Hadoop YARN

[jira] [Updated] (YARN-10886) Cluster based and parent based max capacity in Capacity Scheduler

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10886: -- Parent: YARN-10496 Issue Type: Sub-task (was: Improvement) > Cluster based and parent

[jira] [Created] (YARN-10886) Cluster based and parent based max capacity in Capacity Scheduler

2021-08-18 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10886: - Summary: Cluster based and parent based max capacity in Capacity Scheduler Key: YARN-10886 URL: https://issues.apache.org/jira/browse/YARN-10886 Project: Hadoop

[jira] [Comment Edited] (YARN-10505) Extend the maximum-capacity property to support Fair Scheduler migration

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400919#comment-17400919 ] Szilard Nemeth edited comment on YARN-10505 at 8/18/21, 9:09 AM: - Keeping

[jira] [Commented] (YARN-10505) Extend the maximum-capacity property to support Fair Scheduler migration

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400919#comment-17400919 ] Szilard Nemeth commented on YARN-10505: --- Splitting this jira up. > Extend the maximum-capacity

[jira] [Commented] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400916#comment-17400916 ] Szilard Nemeth commented on YARN-7621: -- This was implemented in YARN-9879. Resolving jira as

[jira] [Updated] (YARN-9700) Documentation about how to migrate from FS to CS config

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9700: - Summary: Documentation about how to migrate from FS to CS config (was: Docs about how to migrate

[jira] [Updated] (YARN-9748) Allow capacity-scheduler configuration on HDFS and support reload from HDFS

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9748: - Parent: (was: YARN-10843) Issue Type: Improvement (was: Sub-task) > Allow

[jira] [Updated] (YARN-9709) When we expanding queue list the scheduler page will not show any applications

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9709: - Parent: (was: YARN-10843) Issue Type: Bug (was: Sub-task) > When we expanding queue

[jira] [Updated] (YARN-9759) Document Queue and App Ordering Policy for CS

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9759: - Parent: (was: YARN-10843) Issue Type: Improvement (was: Sub-task) > Document Queue

[jira] [Updated] (YARN-9892) Capacity Scheduler: Support DRF ordering policy on queue level

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9892: - Parent: (was: YARN-10843) Issue Type: New Feature (was: Sub-task) > Capacity

[jira] [Updated] (YARN-9892) Capacity Scheduler: Support DRF ordering policy on queue level

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9892: - Summary: Capacity Scheduler: Support DRF ordering policy on queue level (was: Capacity

[jira] [Updated] (YARN-9892) Capacity scheduler: Support DRF ordering policy on queue level

2021-08-18 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9892: - Summary: Capacity scheduler: Support DRF ordering policy on queue level (was: Capacity

<    1   2   3   4   5   6   7   8   9   10   >