[jira] [Updated] (YARN-9900) Revert Invalid Config and Refresh Support in SchedulerConfig Format

[ https://issues.apache.org/jira/browse/YARN-9900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9900: Attachment: YARN-9900-003.patch > Revert Invalid Config and Refresh Support in SchedulerConfig

[jira] [Commented] (YARN-9900) Revert Invalid Config and Refresh Support in SchedulerConfig Format

[ https://issues.apache.org/jira/browse/YARN-9900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952486#comment-16952486 ] Sunil G commented on YARN-9900: --- {code:java} 2585try { 2586

[jira] [Commented] (YARN-8842) Expose metrics for custom resource types in QueueMetrics

[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952342#comment-16952342 ] Eric Payne commented on YARN-8842: -- I backported to branch-3.2 and 3.1, but putting it into branch-2

[jira] [Issue Comment Deleted] (YARN-9889) [UI] Add Application Tag column to RM All Applications table

[ https://issues.apache.org/jira/browse/YARN-9889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-9889: - Comment: was deleted (was: Thanks [~kmarton] , thanks for working on this. To me there's no strong

[jira] [Commented] (YARN-9886) Queue mapping based on userid passed through application tag

[ https://issues.apache.org/jira/browse/YARN-9886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952267#comment-16952267 ] Wangda Tan commented on YARN-9886: -- [~kmarton] , thanks for working on this. To me there's no strong

[jira] [Commented] (YARN-9889) [UI] Add Application Tag column to RM All Applications table

[ https://issues.apache.org/jira/browse/YARN-9889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952265#comment-16952265 ] Wangda Tan commented on YARN-9889: -- Thanks [~kmarton] , thanks for working on this. To me there's no

[jira] [Commented] (YARN-7739) DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation

[ https://issues.apache.org/jira/browse/YARN-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952254#comment-16952254 ] Eric Payne commented on YARN-7739: -- I would like to backport this to branch-2 unless there are

[jira] [Commented] (YARN-8737) Race condition in ParentQueue when reinitializing and sorting child queues in the meanwhile

[ https://issues.apache.org/jira/browse/YARN-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952192#comment-16952192 ] Hadoop QA commented on YARN-8737: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4858) start-yarn and stop-yarn scripts to support timeline and sharedcachemanager

[ https://issues.apache.org/jira/browse/YARN-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952112#comment-16952112 ] Hadoop QA commented on YARN-4858: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9671) Improve Locality Scheduling when cluster is busy

[ https://issues.apache.org/jira/browse/YARN-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9671: Target Version/s: 3.3.0, 2.10.1 (was: 2.10.0, 3.3.0) > Improve Locality Scheduling when cluster is

[jira] [Updated] (YARN-9736) Recursively configure app ordering policies

[ https://issues.apache.org/jira/browse/YARN-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9736: Target Version/s: 2.10.1 (was: 2.10.0) > Recursively configure app ordering policies >

[jira] [Updated] (YARN-4858) start-yarn and stop-yarn scripts to support timeline and sharedcachemanager

[ https://issues.apache.org/jira/browse/YARN-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-4858: Target Version/s: 2.10.1 (was: 2.10.0) > start-yarn and stop-yarn scripts to support timeline and

[jira] [Updated] (YARN-8118) Better utilize gracefully decommissioning node managers

[ https://issues.apache.org/jira/browse/YARN-8118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8118: Target Version/s: 3.1.0, 2.10.1 (was: 3.1.0, 2.10.0) > Better utilize gracefully decommissioning

[jira] [Updated] (YARN-9615) Add dispatcher metrics to RM

[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9615: Target Version/s: 2.10.1 (was: 2.10.0) > Add dispatcher metrics to RM >

[jira] [Updated] (YARN-9807) ContainerAllocator re-creates RMContainer instance when allocate for ReservedContainer

[ https://issues.apache.org/jira/browse/YARN-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9807: Target Version/s: 3.3.0, 2.9.3, 2.10.1 (was: 2.10.0, 3.3.0, 2.9.3) > ContainerAllocator re-creates

[jira] [Updated] (YARN-9751) Separate queue and app ordering policy capacity scheduler configs

[ https://issues.apache.org/jira/browse/YARN-9751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9751: Target Version/s: 2.10.1 (was: 2.10.0) > Separate queue and app ordering policy capacity scheduler

[jira] [Updated] (YARN-9770) Create a queue ordering policy which picks child queues with equal probability

[ https://issues.apache.org/jira/browse/YARN-9770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9770: Target Version/s: 2.10.1 (was: 2.10.0) > Create a queue ordering policy which picks child queues

[jira] [Updated] (YARN-9869) Create scheduling policy to auto-adjust queue elasticity based on cluster demand

[ https://issues.apache.org/jira/browse/YARN-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9869: Target Version/s: 2.10.1 (was: 2.10.0) > Create scheduling policy to auto-adjust queue elasticity

[jira] [Updated] (YARN-8750) Refactor TestQueueMetrics

[ https://issues.apache.org/jira/browse/YARN-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-8750: - Fix Version/s: 3.1.4 3.2.2 2.10.0 > Refactor TestQueueMetrics >

[jira] [Commented] (YARN-8737) Race condition in ParentQueue when reinitializing and sorting child queues in the meanwhile

[ https://issues.apache.org/jira/browse/YARN-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952049#comment-16952049 ] Tao Yang commented on YARN-8737: Thanks [~cheersyang] for the review. Submitted already. > Race condition

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952036#comment-16952036 ] Hudson commented on YARN-9840: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17535 (See

[jira] [Commented] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

[ https://issues.apache.org/jira/browse/YARN-9841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952024#comment-16952024 ] Peter Bacsko commented on YARN-9841: It still applies cleanly - [~snemeth] could you review & commit

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952022#comment-16952022 ] Szilard Nemeth commented on YARN-9840: -- Latest patch looks good! Thanks [~maniraj...@gmail.com] for

[jira] [Commented] (YARN-8842) Expose metrics for custom resource types in QueueMetrics

[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952016#comment-16952016 ] Eric Payne commented on YARN-8842: -- I'd like to backport this to branch-2 if there are no objections. >

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952017#comment-16952017 ] Peter Bacsko commented on YARN-9840: Test failure seems unrelated. > Capacity scheduler: add support

[jira] [Commented] (YARN-8750) Refactor TestQueueMetrics

[ https://issues.apache.org/jira/browse/YARN-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952013#comment-16952013 ] Eric Payne commented on YARN-8750: -- I'd like to backport this to branch-2 if there are no objections. >

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951993#comment-16951993 ] Hadoop QA commented on YARN-9840: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8737) Race condition in ParentQueue when reinitializing and sorting child queues in the meanwhile

[ https://issues.apache.org/jira/browse/YARN-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951984#comment-16951984 ] Weiwei Yang commented on YARN-8737: --- Hi [~Tao Yang] Change LGTM, could you pls submit the patch? >

[jira] [Commented] (YARN-9889) [UI] Add Application Tag column to RM All Applications table

[ https://issues.apache.org/jira/browse/YARN-9889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951946#comment-16951946 ] Hadoop QA commented on YARN-9889: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9905) yarn-service is failed to setup application log if app-log-dir is not default-fs

[ https://issues.apache.org/jira/browse/YARN-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951912#comment-16951912 ] Hadoop QA commented on YARN-9905: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-9905) yarn-service is failed to setup application log if app-log-dir is not default-fs

kyungwan nam created YARN-9905: -- Summary: yarn-service is failed to setup application log if app-log-dir is not default-fs Key: YARN-9905 URL: https://issues.apache.org/jira/browse/YARN-9905 Project:

[jira] [Updated] (YARN-9903) Support reservations continue looking for Node Labels

[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9903: --- Description: YARN-1769 brought in reservations continue looking feature which improves the several

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951883#comment-16951883 ] Peter Bacsko commented on YARN-9840: I've taken the liberty of updating patch v3 with some docs

[jira] [Updated] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9840: --- Attachment: YARN-9840-004.patch > Capacity scheduler: add support for Secondary Group rule mapping >

[jira] [Updated] (YARN-9904) Investigate how resource allocation configuration could be more consistent in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-9904: - Parent: YARN-9698 Issue Type: Sub-task (was: Bug) > Investigate how resource allocation

[jira] [Created] (YARN-9904) Investigate how resource allocation configuration could be more consistent in CapacityScheduler

Gergely Pollak created YARN-9904: Summary: Investigate how resource allocation configuration could be more consistent in CapacityScheduler Key: YARN-9904 URL: https://issues.apache.org/jira/browse/YARN-9904

[jira] [Updated] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9899: --- Description: YARN-9699 laid down the groundworks of a converter from FS to CS config. During the

[jira] [Commented] (YARN-8453) Additional Unit tests to verify queue limit and max-limit with multiple resource types

[ https://issues.apache.org/jira/browse/YARN-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951866#comment-16951866 ] Adam Antal commented on YARN-8453: -- Thanks [~snemeth]! > Additional Unit tests to verify queue limit

[jira] [Commented] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951849#comment-16951849 ] Szilard Nemeth commented on YARN-9899: -- 1. Sure, sounds good! 2. I think we can live with this as

[jira] [Updated] (YARN-9889) [UI] Add Application Tag column to RM All Applications table

[ https://issues.apache.org/jira/browse/YARN-9889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kinga Marton updated YARN-9889: --- Attachment: YARN-9889.001.patch > [UI] Add Application Tag column to RM All Applications table >

[jira] [Updated] (YARN-9889) [UI] Add Application Tag column to RM All Applications table

[ https://issues.apache.org/jira/browse/YARN-9889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kinga Marton updated YARN-9889: --- Attachment: AllApplications_with_ApplicationTag.png > [UI] Add Application Tag column to RM All

[jira] [Commented] (YARN-8453) Additional Unit tests to verify queue limit and max-limit with multiple resource types

[ https://issues.apache.org/jira/browse/YARN-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951847#comment-16951847 ] Szilard Nemeth commented on YARN-8453: -- Hi [~adam.antal]! Thanks for your contribution! Thanks

[jira] [Commented] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951841#comment-16951841 ] Peter Bacsko commented on YARN-9899: # Framework uploader has been built into the {{mapred}} command.

[jira] [Created] (YARN-9903) Support reservations continue looking for Node Labels

Tarun Parimi created YARN-9903: -- Summary: Support reservations continue looking for Node Labels Key: YARN-9903 URL: https://issues.apache.org/jira/browse/YARN-9903 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-9902) In NodeManagerRest, the datatype of nodeInfo's property id should be "string"

[ https://issues.apache.org/jira/browse/YARN-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951782#comment-16951782 ] jenny commented on YARN-9902: - I need review, Thanks in advance:) [~sunilg] [~wangda] [~giovanni.fumarola] 

[jira] [Commented] (YARN-9902) In NodeManagerRest, the datatype of nodeInfo's property id should be "string"

[ https://issues.apache.org/jira/browse/YARN-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951764#comment-16951764 ] Hadoop QA commented on YARN-9902: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9290) Invalid SchedulingRequest not rejected in Scheduler PlacementConstraintsHandler

[ https://issues.apache.org/jira/browse/YARN-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951754#comment-16951754 ] Prabhu Joseph commented on YARN-9290: - Thanks [~pbacsko] for reviewing. [~snemeth] Can you review

[jira] [Commented] (YARN-8453) Additional Unit tests to verify queue limit and max-limit with multiple resource types

[ https://issues.apache.org/jira/browse/YARN-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951728#comment-16951728 ] Szilard Nemeth commented on YARN-8453: -- Hi [~adam.antal]! Unit test failures are reported as:

[jira] [Comment Edited] (YARN-8453) Additional Unit tests to verify queue limit and max-limit with multiple resource types

[ https://issues.apache.org/jira/browse/YARN-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951728#comment-16951728 ] Szilard Nemeth edited comment on YARN-8453 at 10/15/19 8:45 AM: Hi

[jira] [Updated] (YARN-9128) Use SerializationUtils from apache commons to serialize / deserialize ResourceMappings

[ https://issues.apache.org/jira/browse/YARN-9128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Siegl updated YARN-9128: --- Attachment: YARN-9128.branch-3.2.001.patch > Use SerializationUtils from apache commons to serialize

[jira] [Commented] (YARN-9537) Add configuration to disable AM preemption

[ https://issues.apache.org/jira/browse/YARN-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951706#comment-16951706 ] Szilard Nemeth commented on YARN-9537: -- Hi [~cane]! Please check the unit test failures, from the

[jira] [Commented] (YARN-9902) In NodeManagerRest, the datatype of nodeInfo's property id should be "string"

[ https://issues.apache.org/jira/browse/YARN-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951705#comment-16951705 ] jenny commented on YARN-9902: - Attached patch. > In NodeManagerRest, the datatype of nodeInfo's property id

[jira] [Updated] (YARN-9902) In NodeManagerRest, the datatype of nodeInfo's property id should be "string"

[ https://issues.apache.org/jira/browse/YARN-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jenny updated YARN-9902: Attachment: why-change_nodeinfo-code.png NodeManagerRest.html#NodeManager_Information_API.png > In

[jira] [Commented] (YARN-9899) Migration tool that help to generate CS config based on FS config [Phase 2]

[ https://issues.apache.org/jira/browse/YARN-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951703#comment-16951703 ] Szilard Nemeth commented on YARN-9899: -- Hi [~pbacsko]! 1. Sounds like a plan. Do we have other

[jira] [Created] (YARN-9902) In NodeManagerRest, the datatype of nodeInfo's property id should be "string"

jenny created YARN-9902: --- Summary: In NodeManagerRest, the datatype of nodeInfo's property id should be "string" Key: YARN-9902 URL: https://issues.apache.org/jira/browse/YARN-9902 Project: Hadoop YARN

[jira] [Commented] (YARN-5748) Backport YARN-5718 to branch-2

[ https://issues.apache.org/jira/browse/YARN-5748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951664#comment-16951664 ] Hadoop QA commented on YARN-5748: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||