[jira] [Commented] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427654#comment-15427654 ] Hadoop QA commented on YARN-4837: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4307) Display blacklisted nodes for AM container in the RM web UI

[ https://issues.apache.org/jira/browse/YARN-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427624#comment-15427624 ] Naganarasimha G R commented on YARN-4307: - [~vinodkv], Oops did not see your comment properly just

[jira] [Commented] (YARN-4307) Display blacklisted nodes for AM container in the RM web UI

[ https://issues.apache.org/jira/browse/YARN-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427584#comment-15427584 ] Hadoop QA commented on YARN-4307: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Reopened] (YARN-4307) Display blacklisted nodes for AM container in the RM web UI

[ https://issues.apache.org/jira/browse/YARN-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reopened YARN-4307: - Reopening the issue to apply patch for 2.8... > Display blacklisted nodes for AM container in

[jira] [Commented] (YARN-3388) Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit

[ https://issues.apache.org/jira/browse/YARN-3388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427549#comment-15427549 ] Hadoop QA commented on YARN-3388: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3673) Create a FailoverProxy for Federation services

[ https://issues.apache.org/jira/browse/YARN-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427536#comment-15427536 ] Jian He commented on YARN-3673: --- - If FederationRMFailoverProxyProvider is used for standalone RM, we only

[jira] [Commented] (YARN-5533) Jmx AM Used metrics for queue wrong when app submited to partition

[ https://issues.apache.org/jira/browse/YARN-5533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427501#comment-15427501 ] Hadoop QA commented on YARN-5533: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5533) Jmx AM Used metrics for queue wrong when app submited to partition

[ https://issues.apache.org/jira/browse/YARN-5533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-5533: --- Attachment: YARN-5533.0002.patch Attaching patch after updating testcase > Jmx AM Used

[jira] [Commented] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427400#comment-15427400 ] Hadoop QA commented on YARN-4837: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1547) Prevent DoS of ApplicationMasterProtocol by putting in limits

[ https://issues.apache.org/jira/browse/YARN-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427327#comment-15427327 ] Hadoop QA commented on YARN-1547: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1529) Add Localization overhead metrics to NM

[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427301#comment-15427301 ] Jason Lowe commented on YARN-1529: -- bq. One comment that I have is we are adding a new API, albeit a small

[jira] [Commented] (YARN-4685) AM blacklisting result in application to get hanged

[ https://issues.apache.org/jira/browse/YARN-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427298#comment-15427298 ] Wangda Tan commented on YARN-4685: -- [~rohithsharma], Discussed with [~vinodkv] about this, one solution

[jira] [Commented] (YARN-5202) Dynamic Overcommit of Node Resources - POC

[ https://issues.apache.org/jira/browse/YARN-5202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427275#comment-15427275 ] Ha Son Hai commented on YARN-5202: -- Hi [~nroberts]! Would you mind if I ask for a little bit more on the

[jira] [Updated] (YARN-1547) Prevent DoS of ApplicationMasterProtocol by putting in limits

[ https://issues.apache.org/jira/browse/YARN-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-1547: --- Attachment: YARN-1547.v1.patch > Prevent DoS of ApplicationMasterProtocol by

[jira] [Comment Edited] (YARN-1529) Add Localization overhead metrics to NM

[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427222#comment-15427222 ] Chris Trezzo edited comment on YARN-1529 at 8/18/16 9:52 PM: - Thanks [~jlowe]

[jira] [Commented] (YARN-1529) Add Localization overhead metrics to NM

[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427222#comment-15427222 ] Chris Trezzo commented on YARN-1529: Thanks [~jlowe] for the rebased patch! I agree that it would be

[jira] [Updated] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4837: -- Attachment: YARN-4837-branch-2.8.txt Uploading a 2.8 patch - fixing conflicts,

[jira] [Updated] (YARN-4307) Display blacklisted nodes for AM container in the RM web UI

[ https://issues.apache.org/jira/browse/YARN-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4307: -- Attachment: YARN-4307-branch-2.8.txt Uploading a patch that I just pushed in for

[jira] [Updated] (YARN-4307) Display blacklisted nodes for AM container in the RM web UI

[ https://issues.apache.org/jira/browse/YARN-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4307: -- Fix Version/s: (was: 2.9.0) 2.8.0 > Display blacklisted

[jira] [Updated] (YARN-3446) FairScheduler headroom calculation should exclude nodes in the blacklist

[ https://issues.apache.org/jira/browse/YARN-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3446: -- Fix Version/s: (was: 2.9.0) 2.8.0 > FairScheduler

[jira] [Updated] (YARN-3446) FairScheduler headroom calculation should exclude nodes in the blacklist

[ https://issues.apache.org/jira/browse/YARN-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3446: -- Attachment: YARN-3446-branch-2.8.txt Uploading a patch that I just pushed in for

[jira] [Updated] (YARN-5049) Extend NMStateStore to save queued container information

[ https://issues.apache.org/jira/browse/YARN-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-5049: - Hadoop Flags: Incompatible change Sorry for getting here late, as I just ran into this by accident. This

[jira] [Commented] (YARN-3673) Create a FailoverProxy for Federation services

[ https://issues.apache.org/jira/browse/YARN-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426990#comment-15426990 ] Subru Krishnan commented on YARN-3673: -- Thanks [~jianhe] for reviewing the patch and your detailed

[jira] [Commented] (YARN-5520) [Capacity Scheduler] Change the logic for when to trigger user/group mappings to queues

[ https://issues.apache.org/jira/browse/YARN-5520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426845#comment-15426845 ] Min Shen commented on YARN-5520: [~Ying Zhang], Your proposal does add more flexibility to queue mappings.

[jira] [Commented] (YARN-5524) Yarn live log aggregation does not throw if command line arg is wrong

[ https://issues.apache.org/jira/browse/YARN-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426839#comment-15426839 ] Xuan Gong commented on YARN-5524: - [~vrushalic] Instead of doing {code} String unknownOptions =

[jira] [Commented] (YARN-5524) Yarn live log aggregation does not throw if command line arg is wrong

[ https://issues.apache.org/jira/browse/YARN-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426832#comment-15426832 ] Naganarasimha G R commented on YARN-5524: - [~vrushalic], IMO i felt it should be

[jira] [Updated] (YARN-2499) Respect labels in preemption policy of fair scheduler

[ https://issues.apache.org/jira/browse/YARN-2499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2499: Assignee: (was: Naganarasimha G R) > Respect labels in preemption policy of fair

[jira] [Updated] (YARN-3388) Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit

[ https://issues.apache.org/jira/browse/YARN-3388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated YARN-3388: - Attachment: YARN-3388-v7.patch Thanks [~leftnoteasy] for the comments. I took both suggestions in

[jira] [Commented] (YARN-5445) Log aggregation configured to different namenode can fail fast

[ https://issues.apache.org/jira/browse/YARN-5445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426700#comment-15426700 ] Daniel Templeton commented on YARN-5445: Moving {{DFS_CLIENT_FAILOVER_MAX_ATTEMPTS_KEY}} to

[jira] [Commented] (YARN-5535) Remove RMDelegationToken make resourcemanager recovery very slow

[ https://issues.apache.org/jira/browse/YARN-5535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426631#comment-15426631 ] tangshangwen commented on YARN-5535: I'm sorry, it is after recovery , and i found even queue size

[jira] [Commented] (YARN-5430) Return container's ip and host from NM ContainerStatus call

[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426597#comment-15426597 ] Billie Rinaldi commented on YARN-5430: -- I have started trying this out with a patch I am working on

[jira] [Commented] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426567#comment-15426567 ] Junping Du commented on YARN-4676: -- Forget to mention, thanks [~rkanter], [~vvasudev] and [~mingma] for

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426566#comment-15426566 ] Daniel Templeton commented on YARN-5534: A good use case for this is mounting in the Hadoop

[jira] [Updated] (YARN-5534) Allow whitelisted volume mounts

[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5534: --- Summary: Allow whitelisted volume mounts (was: Prevent arbitrary volume mounts ) > Allow

[jira] [Commented] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426556#comment-15426556 ] Hudson commented on YARN-4676: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10300 (See

[jira] [Commented] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426559#comment-15426559 ] Junping Du commented on YARN-4676: -- +1. I have commit the latest patch (024) to trunk and branch-2. Thanks

[jira] [Created] (YARN-5536) Multiple format support (JSON, etc.) for exclude node file in NM graceful decommission with timeout

Junping Du created YARN-5536: Summary: Multiple format support (JSON, etc.) for exclude node file in NM graceful decommission with timeout Key: YARN-5536 URL: https://issues.apache.org/jira/browse/YARN-5536

[jira] [Commented] (YARN-5535) Remove RMDelegationToken make resourcemanager recovery very slow

[ https://issues.apache.org/jira/browse/YARN-5535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426330#comment-15426330 ] Naganarasimha G R commented on YARN-5535: - Hi [~tangshangwen], Is this removal of RM delegation

[jira] [Commented] (YARN-3649) Allow configurable prefix for hbase table names (like prod, exp, test etc)

[ https://issues.apache.org/jira/browse/YARN-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426288#comment-15426288 ] Varun Saxena commented on YARN-3649: In my personal opinion, default values should be such that they

[jira] [Commented] (YARN-5526) DrainDispacher#ServiceStop blocked if setDrainEventsOnStop invoked

[ https://issues.apache.org/jira/browse/YARN-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426170#comment-15426170 ] sandflee commented on YARN-5526: thanks [~varun_saxena] for suggestion and review ! >

[jira] [Resolved] (YARN-5508) Exception should be recorded as caught rather than thrown

[ https://issues.apache.org/jira/browse/YARN-5508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R resolved YARN-5508. - Resolution: Duplicate YARN-5507 supercedes this issue > Exception should be recorded as

[jira] [Updated] (YARN-5508) Exception should be recorded as caught rather than thrown

[ https://issues.apache.org/jira/browse/YARN-5508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-5508: Labels: easyfix easytest trivial (was: easyfix easytest) > Exception should be recorded as

[jira] [Commented] (YARN-4995) FairScheduler: Display per-queue demand on the scheduler page

[ https://issues.apache.org/jira/browse/YARN-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426123#comment-15426123 ] stefanlee commented on YARN-4995: - [~xupeng] thanks your jira, i have a question,the demand resource you

[jira] [Commented] (YARN-5535) Remove RMDelegationToken make resourcemanager recovery very slow

[ https://issues.apache.org/jira/browse/YARN-5535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426107#comment-15426107 ] tangshangwen commented on YARN-5535: Thanks [~sunilg] for the comments. I think Removing

[jira] [Commented] (YARN-5535) Remove RMDelegationToken make resourcemanager recovery very slow

[ https://issues.apache.org/jira/browse/YARN-5535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426084#comment-15426084 ] Sunil G commented on YARN-5535: --- YARN-4041 has made token recovery asynchronous during recovery. Its been

[jira] [Updated] (YARN-5535) Remove RMDelegationToken make resourcemanager recovery very slow

[ https://issues.apache.org/jira/browse/YARN-5535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tangshangwen updated YARN-5535: --- Description: In our cluster, I found that when restart RM, RM recovery is very slow， this is my log

[jira] [Updated] (YARN-5535) Remove RMDelegationToken make resourcemanager recovery very slow

[ https://issues.apache.org/jira/browse/YARN-5535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tangshangwen updated YARN-5535: --- Description: In our cluster, I found that when restart RM, RM recovery is very slow， this is my log

[jira] [Created] (YARN-5535) Remove RMDelegationToken make resourcemanager recovery very slow

tangshangwen created YARN-5535: -- Summary: Remove RMDelegationToken make resourcemanager recovery very slow Key: YARN-5535 URL: https://issues.apache.org/jira/browse/YARN-5535 Project: Hadoop YARN

[jira] [Comment Edited] (YARN-5526) DrainDispacher#ServiceStop blocked if setDrainEventsOnStop invoked

[ https://issues.apache.org/jira/browse/YARN-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425996#comment-15425996 ] Varun Saxena edited comment on YARN-5526 at 8/18/16 7:01 AM: - Committed to

[jira] [Commented] (YARN-5526) DrainDispacher#ServiceStop blocked if setDrainEventsOnStop invoked

[ https://issues.apache.org/jira/browse/YARN-5526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425996#comment-15425996 ] Varun Saxena commented on YARN-5526: Committed to trunk, branch-2. Thanks >

[jira] [Commented] (YARN-5308) FairScheduler: Move continuous scheduling related tests to TestContinuousScheduling

[ https://issues.apache.org/jira/browse/YARN-5308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425974#comment-15425974 ] Kai Sasaki commented on YARN-5308: -- [~varun_saxena] Sure, I'll do that. > FairScheduler: Move continuous

[jira] [Commented] (YARN-3673) Create a FailoverProxy for Federation services

[ https://issues.apache.org/jira/browse/YARN-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425967#comment-15425967 ] Jian He commented on YARN-3673: --- Test: IIUC, I don't actually see FederationRMFailoverProxyProvider

[jira] [Commented] (YARN-3673) Create a FailoverProxy for Federation services

[ https://issues.apache.org/jira/browse/YARN-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425963#comment-15425963 ] Jian He commented on YARN-3673: --- - I think for this patch the FEDERATION_FAILOVER_ENABLED and

[jira] [Created] (YARN-5534) Prevent arbitrary volume mounts

luhuichun created YARN-5534: --- Summary: Prevent arbitrary volume mounts Key: YARN-5534 URL: https://issues.apache.org/jira/browse/YARN-5534 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5308) FairScheduler: Move continuous scheduling related tests to TestContinuousScheduling

[ https://issues.apache.org/jira/browse/YARN-5308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425953#comment-15425953 ] Varun Saxena commented on YARN-5308: [~lewuathe], the patch doesnt apply cleanly. Can you rebase it ?