[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990202#comment-16990202 ] Eric Payne commented on YARN-10009: --- [~leftnoteasy], thanks for looking at this. bq. is the failure

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990258#comment-16990258 ] Hadoop QA commented on YARN-10009: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-9956) Improve connection error message for YARN ApiServerClient

[ https://issues.apache.org/jira/browse/YARN-9956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989523#comment-16989523 ] Hadoop QA commented on YARN-9956: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989548#comment-16989548 ] Adam Antal commented on YARN-5106: -- Well as a clean look at this issue, without backporting YARN-8967 it

[jira] [Updated] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9607: - Attachment: YARN-9607.branch-3.2.001.patch > Auto-configuring rollover-size of IFile format for

[jira] [Updated] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9607: - Attachment: (was: YARN-9607.branch-3.2.001.patch) > Auto-configuring rollover-size of IFile format

[jira] [Commented] (YARN-8148) Update decimal values for queue capacities shown on queue status CLI

[ https://issues.apache.org/jira/browse/YARN-8148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989560#comment-16989560 ] Hadoop QA commented on YARN-8148: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989566#comment-16989566 ] Adam Antal commented on YARN-9607: -- Yeah, I don't know why 3.2 was put to the target versions. Since this

[jira] [Updated] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9607: - Target Version/s: (was: 3.2.2) > Auto-configuring rollover-size of IFile format for non-appendable

[jira] [Updated] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9607: - Fix Version/s: 3.3.0 > Auto-configuring rollover-size of IFile format for non-appendable filesystems >

[jira] [Resolved] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal resolved YARN-9607. -- Resolution: Fixed > Auto-configuring rollover-size of IFile format for non-appendable filesystems >

[jira] [Commented] (YARN-9788) Queue Management API does not support parallel updates

[ https://issues.apache.org/jira/browse/YARN-9788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989611#comment-16989611 ] Hadoop QA commented on YARN-9788: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10014) Refactor boolean flag based approach in SchedConfCLI#run

[ https://issues.apache.org/jira/browse/YARN-10014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989627#comment-16989627 ] Oleg Bonar commented on YARN-10014: --- Hi [~prabhujoseph]! May I take this one to get started with

[jira] [Commented] (YARN-10014) Refactor boolean flag based approach in SchedConfCLI#run

[ https://issues.apache.org/jira/browse/YARN-10014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989639#comment-16989639 ] Prabhu Joseph commented on YARN-10014: -- Yes Sure [~oleg_bonar], we are free to pick unassigned ones.

[jira] [Commented] (YARN-10014) Refactor boolean flag based approach in SchedConfCLI#run

[ https://issues.apache.org/jira/browse/YARN-10014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989649#comment-16989649 ] Oleg Bonar commented on YARN-10014: --- Ok. I'm working on this issue. > Refactor boolean flag based

[jira] [Commented] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989655#comment-16989655 ] Wilfred Spiegelenburg commented on YARN-5106: - I did not look at back porting it to any

[jira] [Commented] (YARN-9956) Improve connection error message for YARN ApiServerClient

[ https://issues.apache.org/jira/browse/YARN-9956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989661#comment-16989661 ] Prabhu Joseph commented on YARN-9956: - [~eyang] The testcase failure is due to this patch. Have missed

[jira] [Comment Edited] (YARN-9956) Improve connection error message for YARN ApiServerClient

[ https://issues.apache.org/jira/browse/YARN-9956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989661#comment-16989661 ] Prabhu Joseph edited comment on YARN-9956 at 12/6/19 11:39 AM: --- [~eyang] The

[jira] [Commented] (YARN-9970) Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping

[ https://issues.apache.org/jira/browse/YARN-9970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989696#comment-16989696 ] Peter Bacsko commented on YARN-9970: +1 (non-binding). Checkstyle complains about the method being too

[jira] [Commented] (YARN-9925) CapacitySchedulerQueueManager allows unsupported Queue hierarchy

[ https://issues.apache.org/jira/browse/YARN-9925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989700#comment-16989700 ] Peter Bacsko commented on YARN-9925: +1 (non-binding). > CapacitySchedulerQueueManager allows

[jira] [Commented] (YARN-4029) Update LogAggregationStatus to store on finish

[ https://issues.apache.org/jira/browse/YARN-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989703#comment-16989703 ] Peter Bacsko commented on YARN-4029: [~adam.antal] there are a bunch unit test failures. Can you

[jira] [Commented] (YARN-9920) YarnAuthorizationProvider AccessRequest gets Null RemoteAddress from FairScheduler

[ https://issues.apache.org/jira/browse/YARN-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989720#comment-16989720 ] Peter Bacsko commented on YARN-9920: [~prabhujoseph] could you pls re-upload the patch? There are some

[jira] [Updated] (YARN-9868) Validate %primary_group queue in CS queue manager

[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9868: --- Attachment: YARN-9868-003.patch > Validate %primary_group queue in CS queue manager >

[jira] [Commented] (YARN-9868) Validate %primary_group queue in CS queue manager

[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989725#comment-16989725 ] Peter Bacsko commented on YARN-9868: Re-uploaded v3 again to see the checkstyle warning (Jenkins build

[jira] [Commented] (YARN-9868) Validate %primary_group queue in CS queue manager

[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989727#comment-16989727 ] Hadoop QA commented on YARN-9868: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9920) YarnAuthorizationProvider AccessRequest gets Null RemoteAddress from FairScheduler

[ https://issues.apache.org/jira/browse/YARN-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9920: Attachment: YARN-9920-006.patch > YarnAuthorizationProvider AccessRequest gets Null RemoteAddress

[jira] [Commented] (YARN-9920) YarnAuthorizationProvider AccessRequest gets Null RemoteAddress from FairScheduler

[ https://issues.apache.org/jira/browse/YARN-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989777#comment-16989777 ] Prabhu Joseph commented on YARN-9920: - [~pbacsko] Yes have reuploaded the patch. >

[jira] [Updated] (YARN-9868) Validate %primary_group queue in CS queue manager

[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9868: --- Attachment: YARN-9868-004.patch > Validate %primary_group queue in CS queue manager >

[jira] [Commented] (YARN-9868) Validate %primary_group queue in CS queue manager

[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989781#comment-16989781 ] Peter Bacsko commented on YARN-9868: Did a rebase, hopefully it's gonna work. > Validate

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989920#comment-16989920 ] Manikandan R commented on YARN-6492: {quote}Otherwise metrics for default partition will be updated

[jira] [Commented] (YARN-9866) u:user2:%primary_group is not working as expected

[ https://issues.apache.org/jira/browse/YARN-9866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989922#comment-16989922 ] Manikandan R commented on YARN-9866: Rebasing.. > u:user2:%primary_group is not working as expected >

[jira] [Updated] (YARN-9866) u:user2:%primary_group is not working as expected

[ https://issues.apache.org/jira/browse/YARN-9866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-9866: --- Attachment: YARN-9866.004.patch > u:user2:%primary_group is not working as expected >

[jira] [Commented] (YARN-7769) FS QueueManager should not create default queue at init

[ https://issues.apache.org/jira/browse/YARN-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989929#comment-16989929 ] Adam Antal commented on YARN-7769: -- I see no update on this recently. Do you have a WIP patch

[jira] [Commented] (YARN-10012) Guaranteed and max capacity queue metrics for custom resources

[ https://issues.apache.org/jira/browse/YARN-10012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989930#comment-16989930 ] Manikandan R commented on YARN-10012: - Thanks [~jhung] for detailed review. Addressed all comments in

[jira] [Updated] (YARN-10012) Guaranteed and max capacity queue metrics for custom resources

[ https://issues.apache.org/jira/browse/YARN-10012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-10012: Attachment: YARN-10012.002.patch > Guaranteed and max capacity queue metrics for custom resources

[jira] [Commented] (YARN-9868) Validate %primary_group queue in CS queue manager

[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989944#comment-16989944 ] Hadoop QA commented on YARN-9868: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9920) YarnAuthorizationProvider AccessRequest gets Null RemoteAddress from FairScheduler

[ https://issues.apache.org/jira/browse/YARN-9920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989946#comment-16989946 ] Hadoop QA commented on YARN-9920: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9892) Capacity scheduler: support DRF ordering policy on queue level

[ https://issues.apache.org/jira/browse/YARN-9892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989948#comment-16989948 ] Manikandan R commented on YARN-9892: Approach: 1. Create a new DominantResourceFairnessPolicy class

[jira] [Updated] (YARN-9525) IFile format is not working against s3a remote folder

[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9525: - Attachment: YARN-9525.006.patch > IFile format is not working against s3a remote folder >

[jira] [Commented] (YARN-10014) Refactor boolean flag based approach in SchedConfCLI#run

[ https://issues.apache.org/jira/browse/YARN-10014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989955#comment-16989955 ] Oleg Bonar commented on YARN-10014: --- [~prabhujoseph], looks like we must preserve the ability to pass

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989956#comment-16989956 ] Adam Antal commented on YARN-9525: -- Rebased to trunk, incorporating YARN-9607. Current UTs covering the

[jira] [Created] (YARN-10015) Correct SLS README sample command

Aihua Xu created YARN-10015: --- Summary: Correct SLS README sample command Key: YARN-10015 URL: https://issues.apache.org/jira/browse/YARN-10015 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-10015) Correct SLS README sample command

[ https://issues.apache.org/jira/browse/YARN-10015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated YARN-10015: Attachment: YARN-10015.patch > Correct SLS README sample command > - > >

[jira] [Commented] (YARN-10015) Correct SLS README sample command

[ https://issues.apache.org/jira/browse/YARN-10015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990007#comment-16990007 ] Aihua Xu commented on YARN-10015: - It's a simple fix. Just replace it with the normal dash. > Correct

[jira] [Updated] (YARN-10015) Correct the sample command in SLS README file

[ https://issues.apache.org/jira/browse/YARN-10015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated YARN-10015: Summary: Correct the sample command in SLS README file (was: Correct SLS README sample command) >

[jira] [Created] (YARN-10016) NPE is thrown when accessing SLS web portal

Aihua Xu created YARN-10016: --- Summary: NPE is thrown when accessing SLS web portal Key: YARN-10016 URL: https://issues.apache.org/jira/browse/YARN-10016 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990020#comment-16990020 ] Hadoop QA commented on YARN-9525: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10009: -- Attachment: YARN-10009.003.patch > In Capacity Scheduler, DRC can treat minimum user limit percent as

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990024#comment-16990024 ] Eric Payne commented on YARN-10009: --- Upmerged and attached patch version 003. > In Capacity Scheduler,

[jira] [Updated] (YARN-9868) Validate %primary_group queue in CS queue manager

[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-9868: --- Attachment: YARN-9868.005.patch > Validate %primary_group queue in CS queue manager >

[jira] [Commented] (YARN-9868) Validate %primary_group queue in CS queue manager

[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990030#comment-16990030 ] Manikandan R commented on YARN-9868: Fixed junit issue. Attached .005.patch > Validate %primary_group

[jira] [Commented] (YARN-10015) Correct the sample command in SLS README file

[ https://issues.apache.org/jira/browse/YARN-10015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990046#comment-16990046 ] Hadoop QA commented on YARN-10015: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10012) Guaranteed and max capacity queue metrics for custom resources

[ https://issues.apache.org/jira/browse/YARN-10012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990063#comment-16990063 ] Jonathan Hung commented on YARN-10012: -- Thanks. [^YARN-10012.002.patch] LGTM pending jenkins. >

[jira] [Commented] (YARN-9866) u:user2:%primary_group is not working as expected

[ https://issues.apache.org/jira/browse/YARN-9866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990081#comment-16990081 ] Hadoop QA commented on YARN-9866: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9561) Add C changes for the new RuncContainerRuntime

[ https://issues.apache.org/jira/browse/YARN-9561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990089#comment-16990089 ] Hudson commented on YARN-9561: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17734 (See

[jira] [Commented] (YARN-10012) Guaranteed and max capacity queue metrics for custom resources

[ https://issues.apache.org/jira/browse/YARN-10012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990088#comment-16990088 ] Hadoop QA commented on YARN-10012: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-10015) Correct the sample command in SLS README file

[ https://issues.apache.org/jira/browse/YARN-10015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated YARN-10015: Parent: YARN-5065 Issue Type: Sub-task (was: Bug) > Correct the sample command in SLS README file

[jira] [Updated] (YARN-10016) NPE is thrown when accessing SLS web portal

[ https://issues.apache.org/jira/browse/YARN-10016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated YARN-10016: Parent: YARN-5065 Issue Type: Sub-task (was: Bug) > NPE is thrown when accessing SLS web portal >

[jira] [Commented] (YARN-10012) Guaranteed and max capacity queue metrics for custom resources

[ https://issues.apache.org/jira/browse/YARN-10012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990109#comment-16990109 ] Jonathan Hung commented on YARN-10012: -- [~maniraj...@gmail.com], I tried backporting this to

[jira] [Commented] (YARN-9868) Validate %primary_group queue in CS queue manager

[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990157#comment-16990157 ] Hadoop QA commented on YARN-9868: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990159#comment-16990159 ] Hadoop QA commented on YARN-10009: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990169#comment-16990169 ] Wangda Tan commented on YARN-10009: --- [~epayne], is the failure related? Thanks > In Capacity

[jira] [Updated] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10009: -- Attachment: YARN-10009.branch-2.10.003.patch > In Capacity Scheduler, DRC can treat minimum user limit