[jira] [Commented] (YARN-9606) Set sslfactory for AuthenticatedURL() while creating LogsCLI#webServiceClient

2021-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17419159#comment-17419159 ] Peter Bacsko commented on YARN-9606: Thanks [~BilwaST] for the backport, committed to branch-3.3. >

[jira] [Commented] (YARN-9606) Set sslfactory for AuthenticatedURL() while creating LogsCLI#webServiceClient

2021-09-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418683#comment-17418683 ] Peter Bacsko commented on YARN-9606: [~BilwaST] yeah, sorry, I completely forgot about it. I'll commit

[jira] [Created] (YARN-10958) Use correct configuration for Group service init in CSMappingPlacementRule

2021-09-16 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10958: --- Summary: Use correct configuration for Group service init in CSMappingPlacementRule Key: YARN-10958 URL: https://issues.apache.org/jira/browse/YARN-10958 Project:

[jira] [Commented] (YARN-10848) Vcore allocation problem with DefaultResourceCalculator

2021-08-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17403793#comment-17403793 ] Peter Bacsko commented on YARN-10848: - Thanks for the comment [~prabhujoseph], so you're saying that

[jira] [Commented] (YARN-10576) Update Capacity Scheduler documentation about JSON-based placement mapping

2021-08-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401337#comment-17401337 ] Peter Bacsko commented on YARN-10576: - Thanks [~bteke], I'm not sure if I'll have time to work on

[jira] [Commented] (YARN-9907) Make YARN Service AM RPC port configurable

2021-07-30 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390495#comment-17390495 ] Peter Bacsko commented on YARN-9907: [~tarunparimi] [~prabhujoseph] to me it looks the same as

[jira] [Commented] (YARN-10848) Vcore allocation problem with DefaultResourceCalculator

2021-07-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1732#comment-1732 ] Peter Bacsko commented on YARN-10848: - [~minni31] the problem is that if you have a node with a lots

[jira] [Commented] (YARN-10848) Vcore allocation problem with DefaultResourceCalculator

2021-07-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17377446#comment-17377446 ] Peter Bacsko commented on YARN-10848: - [~minni31] sure, you can take it and I can review the patch if

[jira] [Assigned] (YARN-10848) Vcore allocation problem with DefaultResourceCalculator

2021-07-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-10848: --- Assignee: Minni Mittal > Vcore allocation problem with DefaultResourceCalculator >

[jira] [Commented] (YARN-10849) Clarify testcase documentation for TestServiceAM#testContainersReleasedWhenPreLaunchFails

2021-07-07 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376630#comment-17376630 ] Peter Bacsko commented on YARN-10849: - [~snemeth] patch v2 seems to undo what v1 introduced. >

[jira] [Updated] (YARN-10848) Vcore allocation problem with DefaultResourceCalculator

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10848: Attachment: TestTooManyContainers.java > Vcore allocation problem with DefaultResourceCalculator >

[jira] [Updated] (YARN-10848) Vcore allocation problem with DefaultResourceCalculator

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10848: Attachment: (was: TestTooManyContainers.java) > Vcore allocation problem with

[jira] [Updated] (YARN-10848) Vcore allocation problem with DefaultResourceCalculator

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10848: Attachment: TestTooManyContainers.java > Vcore allocation problem with DefaultResourceCalculator >

[jira] [Updated] (YARN-10848) Vcore allocation problem with DefaultResourceCalculator

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10848: Summary: Vcore allocation problem with DefaultResourceCalculator (was: Vcore usage problem with

[jira] [Created] (YARN-10848) Vcore usage problem with Default/DominantResourceCalculator

2021-07-06 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10848: --- Summary: Vcore usage problem with Default/DominantResourceCalculator Key: YARN-10848 URL: https://issues.apache.org/jira/browse/YARN-10848 Project: Hadoop YARN

[jira] [Updated] (YARN-10843) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler - part II

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10843: Component/s: capacityscheduler capacity scheduler > [Umbrella] Tools to help

[jira] [Updated] (YARN-10843) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler - part II

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10843: Labels: fs2cs (was: ) > [Umbrella] Tools to help migration from Fair Scheduler to Capacity

[jira] [Updated] (YARN-10843) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler - part II

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10843: Description: Remaining tasks for fs2cs converter. Phase I was completed under YARN-9698. >

[jira] [Resolved] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko resolved YARN-9698. Fix Version/s: 3.4.0 Resolution: Fixed > [Umbrella] Tools to help migration from Fair

[jira] [Commented] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17375649#comment-17375649 ] Peter Bacsko commented on YARN-9698: Remaining subtasks have been moved under YARN-10843. Closing

[jira] [Updated] (YARN-10171) Add support for increment-allocation of custom resource types

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10171: Parent Issue: YARN-10843 (was: YARN-9698) > Add support for increment-allocation of custom

[jira] [Updated] (YARN-10758) Mixed mode: Allow relative and absolute mode in the same queue hierarchy

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10758: Parent Issue: YARN-10843 (was: YARN-9698) > Mixed mode: Allow relative and absolute mode in the

[jira] [Updated] (YARN-10693) Add document for YARN-10623 auto refresh queue conf in cs.

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10693: Parent Issue: YARN-10843 (was: YARN-9698) > Add document for YARN-10623 auto refresh queue conf

[jira] [Updated] (YARN-9936) Support vector of capacity percentages in Capacity Scheduler configuration

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9936: --- Parent Issue: YARN-10843 (was: YARN-9698) > Support vector of capacity percentages in Capacity

[jira] [Updated] (YARN-10049) FIFOOrderingPolicy Improvements

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10049: Parent Issue: YARN-10843 (was: YARN-9698) > FIFOOrderingPolicy Improvements >

[jira] [Updated] (YARN-9975) Support proxy acl user for CapacityScheduler

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9975: --- Parent Issue: YARN-10843 (was: YARN-9698) > Support proxy acl user for CapacityScheduler >

[jira] [Updated] (YARN-9904) Investigate how resource allocation configuration could be more consistent in CapacityScheduler

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9904: --- Parent Issue: YARN-10843 (was: YARN-9698) > Investigate how resource allocation configuration could

[jira] [Updated] (YARN-9892) Capacity scheduler: support DRF ordering policy on queue level

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9892: --- Parent Issue: YARN-10843 (was: YARN-9698) > Capacity scheduler: support DRF ordering policy on queue

[jira] [Updated] (YARN-9748) Allow capacity-scheduler configuration on HDFS and support reload from HDFS

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9748: --- Parent Issue: YARN-10843 (was: YARN-9698) > Allow capacity-scheduler configuration on HDFS and

[jira] [Updated] (YARN-9759) Document Queue and App Ordering Policy for CS

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9759: --- Parent Issue: YARN-10843 (was: YARN-9698) > Document Queue and App Ordering Policy for CS >

[jira] [Updated] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-7621: --- Parent Issue: YARN-10843 (was: YARN-9698) > Support submitting apps with queue path for

[jira] [Updated] (YARN-9709) When we expanding queue list the scheduler page will not show any applications

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9709: --- Parent Issue: YARN-10843 (was: YARN-9698) > When we expanding queue list the scheduler page will not

[jira] [Updated] (YARN-9700) Docs about how to migrate from FS to CS config

2021-07-06 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9700: --- Parent Issue: YARN-10843 (was: YARN-9698) > Docs about how to migrate from FS to CS config >

[jira] [Created] (YARN-10843) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler - part II

2021-07-06 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10843: --- Summary: [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler - part II Key: YARN-10843 URL: https://issues.apache.org/jira/browse/YARN-10843

[jira] [Commented] (YARN-10780) Optimise retrieval of configured node labels in CS queues

2021-06-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17369025#comment-17369025 ] Peter Bacsko commented on YARN-10780: - +1 Thanks [~gandras], latest patch LGTM. Committed to trunk.

[jira] [Commented] (YARN-10780) Optimise retrieval of configured node labels in CS queues

2021-06-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367259#comment-17367259 ] Peter Bacsko commented on YARN-10780: - [~gandras] looks good, could you take care of the checkstyle

[jira] [Updated] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10796: Attachment: YARN-10796-003.patch > Capacity Scheduler: dynamic queue cannot scale out properly if

[jira] [Comment Edited] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355804#comment-17355804 ] Peter Bacsko edited comment on YARN-10796 at 6/2/21, 3:32 PM: -- [~gandras] 

[jira] [Commented] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355804#comment-17355804 ] Peter Bacsko commented on YARN-10796: - [~gandras] this is a valid concern. Question is, do we accept

[jira] [Comment Edited] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355804#comment-17355804 ] Peter Bacsko edited comment on YARN-10796 at 6/2/21, 3:28 PM: -- [~gandras] 

[jira] [Commented] (YARN-10780) Optimise retrieval of configured node labels in CS queues

2021-06-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355796#comment-17355796 ] Peter Bacsko commented on YARN-10780: - Ok, I went through the patch. I'm not saying that I have 100%

[jira] [Commented] (YARN-10780) Optimise retrieval of configured node labels in CS queues

2021-06-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355775#comment-17355775 ] Peter Bacsko commented on YARN-10780: - There are a lot of NPE at {{serviceStop()}}, [~gandras] could

[jira] [Commented] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355771#comment-17355771 ] Peter Bacsko commented on YARN-10796: - Thanks [~bteke], this makes sense. > Capacity Scheduler:

[jira] [Commented] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355720#comment-17355720 ] Peter Bacsko commented on YARN-10796: - [~bteke], [~gandras], [~snemeth] could you review this please?

[jira] [Updated] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-01 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10796: Attachment: YARN-10796-002.patch > Capacity Scheduler: dynamic queue cannot scale out properly if

[jira] [Updated] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-01 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10796: Issue Type: Bug (was: Task) > Capacity Scheduler: dynamic queue cannot scale out properly if its

[jira] [Updated] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-06-01 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10796: Attachment: YARN-10796-001.patch > Capacity Scheduler: dynamic queue cannot scale out properly if

[jira] [Updated] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

2021-05-31 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10796: Summary: Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0% (was:

[jira] [Updated] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if it's capacity is 0%

2021-05-31 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10796: Description: If we have a dynamic queue (AutoCreatedLeafQueue) with capacity = 0%, then it cannot

[jira] [Created] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if it's capacity is 0%

2021-05-31 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10796: --- Summary: Capacity Scheduler: dynamic queue cannot scale out properly if it's capacity is 0% Key: YARN-10796 URL: https://issues.apache.org/jira/browse/YARN-10796

[jira] [Commented] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

2021-05-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349248#comment-17349248 ] Peter Bacsko commented on YARN-10771: - Just one thing: {{import

[jira] [Commented] (YARN-9606) Set sslfactory for AuthenticatedURL() while creating LogsCLI#webServiceClient

2021-05-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349177#comment-17349177 ] Peter Bacsko commented on YARN-9606: [~BilwaST] I can't apply this patch to branch-3.3, even using

[jira] [Commented] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349104#comment-17349104 ] Peter Bacsko commented on YARN-10779: - [~snemeth] please review this. > Add option to disable

[jira] [Reopened] (YARN-9606) Set sslfactory for AuthenticatedURL() while creating LogsCLI#webServiceClient

2021-05-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reopened YARN-9606: > Set sslfactory for AuthenticatedURL() while creating LogsCLI#webServiceClient >

[jira] [Commented] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-21 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349064#comment-17349064 ] Peter Bacsko commented on YARN-10779: - [~gandras] this is a site property, not a CS property. CS

[jira] [Updated] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10779: Attachment: YARN-10779-003.patch > Add option to disable lowercase conversion in

[jira] [Updated] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10779: Attachment: YARN-10779-002.patch > Add option to disable lowercase conversion in

[jira] [Updated] (YARN-10505) Extend the maximum-capacity property to support Fair Scheduler migration

2021-05-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10505: Description: The property root.users.maximum-capacity could mean the following things: * Parent

[jira] [Commented] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348213#comment-17348213 ] Peter Bacsko commented on YARN-10779: - TODO: new property needs a "." character after the prefix

[jira] [Commented] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348202#comment-17348202 ] Peter Bacsko commented on YARN-10779: - Ok, uploaded patch v1, I forgot to update

[jira] [Updated] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10779: Attachment: YARN-10779-001.patch > Add option to disable lowercase conversion in

[jira] [Comment Edited] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348147#comment-17348147 ] Peter Bacsko edited comment on YARN-10779 at 5/20/21, 8:34 AM: --- "It is a

[jira] [Comment Edited] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348147#comment-17348147 ] Peter Bacsko edited comment on YARN-10779 at 5/20/21, 8:33 AM: --- "It is a

[jira] [Commented] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348147#comment-17348147 ] Peter Bacsko commented on YARN-10779: - "It is a possibility that Node A sends this PB message to Node

[jira] [Commented] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348090#comment-17348090 ] Peter Bacsko commented on YARN-10779: - [~gandras] these classes are locally instantiated adapter

[jira] [Commented] (YARN-10725) Backport YARN-10120 to branch-3.3

2021-05-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347659#comment-17347659 ] Peter Bacsko commented on YARN-10725: - Ok, +1 committed to branch-3.3. > Backport YARN-10120 to

[jira] [Updated] (YARN-10725) Backport YARN-10120 to branch-3.3

2021-05-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10725: Fix Version/s: 3.3.1 > Backport YARN-10120 to branch-3.3 > - > >

[jira] [Commented] (YARN-10725) Backport YARN-10120 to branch-3.3

2021-05-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347632#comment-17347632 ] Peter Bacsko commented on YARN-10725: - No, I'll fix during commit. Just one more thing: this is a

[jira] [Commented] (YARN-10725) Backport YARN-10120 to branch-3.3

2021-05-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347625#comment-17347625 ] Peter Bacsko commented on YARN-10725: - [~BilwaST] so you're saying that v5 is good to go? I don't

[jira] [Commented] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347617#comment-17347617 ] Peter Bacsko commented on YARN-10779: - [~BilwaST] [~jhung] you recently made modifications around

[jira] [Commented] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347481#comment-17347481 ] Peter Bacsko commented on YARN-10779: - Uploaded a POC without tests. > Add option to disable

[jira] [Updated] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10779: Summary: Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and

[jira] [Updated] (YARN-10779) Add option to disable lowecase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10779: Attachment: YARN-10779-POC.patch > Add option to disable lowecase conversion in

[jira] [Created] (YARN-10779) Add option to disable lowecase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

2021-05-19 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10779: --- Summary: Add option to disable lowecase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl Key: YARN-10779 URL:

[jira] [Commented] (YARN-10258) Add metrics for 'ApplicationsRunning' in NodeManager

2021-05-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347419#comment-17347419 ] Peter Bacsko commented on YARN-10258: - Backported to branch-3.3. > Add metrics for

[jira] [Updated] (YARN-10258) Add metrics for 'ApplicationsRunning' in NodeManager

2021-05-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10258: Fix Version/s: 3.3.1 > Add metrics for 'ApplicationsRunning' in NodeManager >

[jira] [Updated] (YARN-10258) Add metrics for 'ApplicationsRunning' in NodeManager

2021-05-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10258: Attachment: YARN-10258-branch-3.3.001.patch > Add metrics for 'ApplicationsRunning' in NodeManager

[jira] [Reopened] (YARN-10258) Add metrics for 'ApplicationsRunning' in NodeManager

2021-05-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reopened YARN-10258: - > Add metrics for 'ApplicationsRunning' in NodeManager >

[jira] [Commented] (YARN-10258) Add metrics for 'ApplicationsRunning' in NodeManager

2021-05-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346396#comment-17346396 ] Peter Bacsko commented on YARN-10258: - +1 Thanks for the patch [~gb.ana...@gmail.com] and

[jira] [Commented] (YARN-10258) Add metrics for 'ApplicationsRunning' in NodeManager

2021-05-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346154#comment-17346154 ] Peter Bacsko commented on YARN-10258: - [~BilwaST] yes, I'll check this out. > Add metrics for

[jira] [Commented] (YARN-10763) Add the number of containers assigned per second metrics to ClusterMetrics

2021-05-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346098#comment-17346098 ] Peter Bacsko commented on YARN-10763: - +1 Thanks [~chaosju] for the patch and [~zhuqi] for the

[jira] [Updated] (YARN-10763) Add the number of containers assigned per second metrics to ClusterMetrics

2021-05-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10763: Summary: Add the number of containers assigned per second metrics to ClusterMetrics (was: add

[jira] [Commented] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler

2021-05-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344626#comment-17344626 ] Peter Bacsko commented on YARN-9698: The number of subtasks under this JIRA just keeps growing. The

[jira] [Commented] (YARN-10759) Encapsulate queue config modes

2021-05-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344573#comment-17344573 ] Peter Bacsko commented on YARN-10759: - Thanks [~gandras] for the patch. I just have one to note. I

[jira] [Comment Edited] (YARN-10759) Encapsulate queue config modes

2021-05-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344573#comment-17344573 ] Peter Bacsko edited comment on YARN-10759 at 5/14/21, 12:54 PM: Thanks

[jira] [Commented] (YARN-10763) add the speed of containers assigned metrics to ClusterMetrics

2021-05-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344518#comment-17344518 ] Peter Bacsko commented on YARN-10763: - Thanks [~chaosju] just a final update, very minor things: 1.

[jira] [Comment Edited] (YARN-10571) Refactor dynamic queue handling logic

2021-05-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343250#comment-17343250 ] Peter Bacsko edited comment on YARN-10571 at 5/12/21, 1:36 PM: --- Thanks

[jira] [Commented] (YARN-10571) Refactor dynamic queue handling logic

2021-05-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343250#comment-17343250 ] Peter Bacsko commented on YARN-10571: - Thanks [~gandras], committed to trunk. > Refactor dynamic

[jira] [Commented] (YARN-10571) Refactor dynamic queue handling logic

2021-05-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343227#comment-17343227 ] Peter Bacsko commented on YARN-10571: - +1 LGTM > Refactor dynamic queue handling logic >

[jira] [Commented] (YARN-10763) add the speed of containers assigned metrics to ClusterMetrics

2021-05-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343152#comment-17343152 ] Peter Bacsko commented on YARN-10763: - Some further comments: 1. {{private volatile AtomicLong

[jira] [Commented] (YARN-10763) add the speed of containers assigned metrics to ClusterMetrics

2021-05-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343139#comment-17343139 ] Peter Bacsko commented on YARN-10763: - [~chaosju] I added you to the list of contributors so you can

[jira] [Assigned] (YARN-10763) add the speed of containers assigned metrics to ClusterMetrics

2021-05-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-10763: --- Assignee: chaosju > add the speed of containers assigned metrics to ClusterMetrics >

[jira] [Updated] (YARN-9615) Add dispatcher metrics to RM

2021-05-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9615: --- Fix Version/s: 3.3.1 > Add dispatcher metrics to RM > > >

[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

2021-05-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342768#comment-17342768 ] Peter Bacsko commented on YARN-9615: Committed to branch-3.3. > Add dispatcher metrics to RM >

[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

2021-05-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342764#comment-17342764 ] Peter Bacsko commented on YARN-9615: OK, the raw type stuff can be ignored, this is the same on trunk,

[jira] [Commented] (YARN-10505) Extend the maximum-capacity property to support Fair Scheduler migration

2021-05-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342641#comment-17342641 ] Peter Bacsko commented on YARN-10505: - I would change the naming a bit. "Relative Percentage" ->

[jira] [Comment Edited] (YARN-10505) Extend the maximum-capacity property to support Fair Scheduler migration

2021-05-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342641#comment-17342641 ] Peter Bacsko edited comment on YARN-10505 at 5/11/21, 3:14 PM: --- I would

[jira] [Commented] (YARN-10642) Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

2021-05-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342555#comment-17342555 ] Peter Bacsko commented on YARN-10642: - Committed to branch-3.1 too. Closing. > Race condition:

[jira] [Updated] (YARN-10642) Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

2021-05-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10642: Attachment: YARN-10642-branch-3.1.001.patch > Race condition: AsyncDispatcher can get stuck by the

[jira] [Reopened] (YARN-10642) Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

2021-05-11 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reopened YARN-10642: - > Race condition: AsyncDispatcher can get stuck by the changes introduced in > YARN-8995 >

  1   2   3   4   5   6   7   8   9   10   >