[jira] [Commented] (YARN-5292) Support for PAUSED container state

2016-11-21 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685939#comment-15685939 ] Subru Krishnan commented on YARN-5292: -- Thanks [~hrsharma] for the design doc and patch. I looked at

[jira] [Commented] (YARN-5905) Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685499#comment-15685499 ] Hadoop QA commented on YARN-5905: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5676) Add a HashBasedRouterPolicy, and small policies and test refactoring.

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685487#comment-15685487 ] Hadoop QA commented on YARN-5676: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5872) Add AlwayReject policies for router and amrmproxy.

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685422#comment-15685422 ] Hadoop QA commented on YARN-5872: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5917) [YARN-3368] Make navigation link active when selecting child components in "Applications" and "Nodes"

2016-11-21 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated YARN-5917: - Summary: [YARN-3368] Make navigation link active when selecting child components in "Applications" and

[jira] [Updated] (YARN-5161) [YARN-3368] Add Apache Hadoop logo in YarnUI home page

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5161: -- Fix Version/s: 3.0.0-alpha2 > [YARN-3368] Add Apache Hadoop logo in YarnUI home page >

[jira] [Updated] (YARN-4668) Reuse objectMapper instance in Yarn

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4668: -- Fix Version/s: 3.0.0-alpha2 > Reuse objectMapper instance in Yarn > ---

[jira] [Updated] (YARN-5503) [YARN-3368] Add missing hidden files in webapp folder for deployment

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5503: -- Fix Version/s: 3.0.0-alpha2 > [YARN-3368] Add missing hidden files in webapp folder for deployment >

[jira] [Updated] (YARN-5047) Refactor nodeUpdate across schedulers

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5047: -- Fix Version/s: 3.0.0-alpha2 > Refactor nodeUpdate across schedulers >

[jira] [Updated] (YARN-4218) Metric for resource*time that was preempted

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4218: -- Fix Version/s: 3.0.0-alpha2 > Metric for resource*time that was preempted >

[jira] [Updated] (YARN-4033) In FairScheduler, parent queues should also display queue status

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4033: -- Fix Version/s: 3.0.0-alpha2 > In FairScheduler, parent queues should also display queue status >

[jira] [Updated] (YARN-3432) Cluster metrics have wrong Total Memory when there is reserved memory on CS

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-3432: -- Fix Version/s: 3.0.0-alpha2 > Cluster metrics have wrong Total Memory when there is reserved memory on

[jira] [Updated] (YARN-4911) Bad placement policy in FairScheduler causes the RM to crash

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4911: -- Fix Version/s: 3.0.0-alpha2 > Bad placement policy in FairScheduler causes the RM to crash >

[jira] [Updated] (YARN-5793) Trim configuration values in DockerLinuxContainerRuntime

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5793: -- Fix Version/s: 3.0.0-alpha2 > Trim configuration values in DockerLinuxContainerRuntime >

[jira] [Updated] (YARN-5552) Add Builder methods for common yarn API records

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5552: -- Fix Version/s: 3.0.0-alpha2 > Add Builder methods for common yarn API records >

[jira] [Updated] (YARN-5772) Replace old Hadoop logo with new one

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5772: -- Fix Version/s: 3.0.0-alpha2 > Replace old Hadoop logo with new one >

[jira] [Updated] (YARN-4456) Clean up Lint warnings in nodemanager

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4456: -- Fix Version/s: 3.0.0-alpha2 > Clean up Lint warnings in nodemanager >

[jira] [Commented] (YARN-5713) Update jackson from 1.9.13 to 2.x in hadoop-yarn

2016-11-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685380#comment-15685380 ] Hudson commented on YARN-5713: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10870 (See

[jira] [Updated] (YARN-4396) Log the trace information on FSAppAttempt#assignContainer

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4396: -- Fix Version/s: 3.0.0-alpha2 > Log the trace information on FSAppAttempt#assignContainer >

[jira] [Updated] (YARN-4998) Minor cleanup to UGI use in AdminService

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4998: -- Fix Version/s: 3.0.0-alpha2 2.9.0 > Minor cleanup to UGI use in AdminService >

[jira] [Updated] (YARN-4907) Make all MockRM#waitForState consistent.

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4907: -- Fix Version/s: 3.0.0-alpha2 > Make all MockRM#waitForState consistent. >

[jira] [Updated] (YARN-4765) Split TestHBaseTimelineStorage into multiple test classes

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4765: -- Fix Version/s: 3.0.0-alpha2 > Split TestHBaseTimelineStorage into multiple test classes >

[jira] [Updated] (YARN-2995) Enhance UI to show cluster resource utilization of various container Execution types

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-2995: -- Fix Version/s: 3.0.0-alpha2 > Enhance UI to show cluster resource utilization of various container >

[jira] [Updated] (YARN-2009) CapacityScheduler: Add intra-queue preemption for app priority support

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-2009: -- Fix Version/s: 3.0.0-alpha2 > CapacityScheduler: Add intra-queue preemption for app priority support >

[jira] [Updated] (YARN-5754) Null check missing for earliest in FifoPolicy

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5754: -- Fix Version/s: 3.0.0-alpha2 > Null check missing for earliest in FifoPolicy >

[jira] [Updated] (YARN-5583) [YARN-3368] Fix wrong paths in .gitignore

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5583: -- Fix Version/s: 3.0.0-alpha2 > [YARN-3368] Fix wrong paths in .gitignore >

[jira] [Updated] (YARN-5504) [YARN-3368] Fix YARN UI build pom.xml

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5504: -- Fix Version/s: 3.0.0-alpha2 > [YARN-3368] Fix YARN UI build pom.xml >

[jira] [Updated] (YARN-5872) Add AlwayReject policies for router and amrmproxy.

2016-11-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5872: --- Attachment: YARN-5872-YARN-2915.02.patch Adapting after YARN-5676 refactoring. > Add AlwayReject

[jira] [Commented] (YARN-5713) Update jackson from 1.9.13 to 2.x in hadoop-yarn

2016-11-21 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685336#comment-15685336 ] Akira Ajisaka commented on YARN-5713: - bq. I'll sync it up with this code and then, if you can review

[jira] [Updated] (YARN-5676) Add a HashBasedRouterPolicy, and small policies and test refactoring.

2016-11-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5676: --- Attachment: YARN-5676-YARN-2915.06.patch > Add a HashBasedRouterPolicy, and small policies and test

[jira] [Commented] (YARN-5676) Add a HashBasedRouterPolicy, and small policies and test refactoring.

2016-11-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685310#comment-15685310 ] Carlo Curino commented on YARN-5676: yep, good catch... fixed in latest version. > Add a

[jira] [Commented] (YARN-5676) Add a HashBasedRouterPolicy, and small policies and test refactoring.

2016-11-21 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685304#comment-15685304 ] Subru Krishnan commented on YARN-5676: -- Thanks [~curino] for the cleanup. I see that there are couple

[jira] [Updated] (YARN-5345) [YARN-3368] Cluster overview page improvements

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5345: -- Fix Version/s: 3.0.0-alpha2 > [YARN-3368] Cluster overview page improvements >

[jira] [Updated] (YARN-5347) [YARN-3368] Applications page improvements

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5347: -- Fix Version/s: 3.0.0-alpha2 > [YARN-3368] Applications page improvements >

[jira] [Updated] (YARN-5322) [YARN-3368] Add a node heat chart map

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5322: -- Fix Version/s: 3.0.0-alpha2 > [YARN-3368] Add a node heat chart map >

[jira] [Updated] (YARN-5346) [YARN-3368] Queues page improvements

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5346: -- Fix Version/s: 3.0.0-alpha2 > [YARN-3368] Queues page improvements >

[jira] [Updated] (YARN-5348) [YARN-3368] Node details page improvements

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5348: -- Fix Version/s: 3.0.0-alpha2 > [YARN-3368] Node details page improvements >

[jira] [Updated] (YARN-5321) [YARN-3368] Add resource usage for application by node managers

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5321: -- Fix Version/s: 3.0.0-alpha2 > [YARN-3368] Add resource usage for application by node managers >

[jira] [Updated] (YARN-5320) [YARN-3368] Add resource usage by applications and queues to cluster overview page.

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5320: -- Fix Version/s: 3.0.0-alpha1 > [YARN-3368] Add resource usage by applications and queues to cluster

[jira] [Commented] (YARN-5761) Separate QueueManager from Scheduler

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685281#comment-15685281 ] Hadoop QA commented on YARN-5761: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5676) Add a HashBasedRouterPolicy, and small policies and test refactoring.

2016-11-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5676: --- Summary: Add a HashBasedRouterPolicy, and small policies and test refactoring. (was: Add a

[jira] [Commented] (YARN-5676) Add a HashBasedRouterPolicy, that routes jobs based on queue name hash.

2016-11-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685266#comment-15685266 ] Carlo Curino commented on YARN-5676: [~subru] thanks for the review, I fixed what you asked, and per

[jira] [Updated] (YARN-5676) Add a HashBasedRouterPolicy, that routes jobs based on queue name hash.

2016-11-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5676: --- Attachment: YARN-5676-YARN-2915.05.patch > Add a HashBasedRouterPolicy, that routes jobs based on

[jira] [Updated] (YARN-5905) Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP

2016-11-21 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5905: - Attachment: (was: YARN-5905-v1.patch) > Update the RM webapp host that is reported as part of

[jira] [Commented] (YARN-5923) Unable to access logs for a running application if YARN_ACL_ENABLE is enabled

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685236#comment-15685236 ] Hadoop QA commented on YARN-5923: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5774) MR Job stuck in ACCEPTED status without any progress in Fair Scheduler if set yarn.scheduler.minimum-allocation-mb to 0.

2016-11-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5774: --- Attachment: YARN-5774.006.patch Uploaded patch 006 for the style issues and the test failure is unrelated. >

[jira] [Updated] (YARN-5923) Unable to access logs for a running application if YARN_ACL_ENABLE is enabled

2016-11-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5923: Attachment: YARN-5923.1.patch > Unable to access logs for a running application if YARN_ACL_ENABLE is

[jira] [Commented] (YARN-5923) Unable to access logs for a running application if YARN_ACL_ENABLE is enabled

2016-11-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685181#comment-15685181 ] Xuan Gong commented on YARN-5923: - In NM WebService, we always use dr.who as default user name which won't

[jira] [Commented] (YARN-5923) Unable to access logs for a running application if YARN_ACL_ENABLE is enabled

2016-11-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685169#comment-15685169 ] Xuan Gong commented on YARN-5923: - Steps to reproduce: add {code} yarn.acl.enable true

[jira] [Updated] (YARN-5923) Unable to access logs for a running application if YARN_ACL_ENABLE is enabled

2016-11-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5923: Description: 2016-11-07 23:20:41,423 WARN webapp.GenericExceptionHandler

[jira] [Updated] (YARN-5923) Unable to access logs for a running application if YARN_ACL_ENABLE is enabled

2016-11-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5923: Issue Type: Sub-task (was: Bug) Parent: YARN-4904 > Unable to access logs for a running application

[jira] [Commented] (YARN-5890) FairScheduler should log information about AM-resource-usage and max-AM-share for queues

2016-11-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685160#comment-15685160 ] Yufei Gu commented on YARN-5890: The unit test failure is unrelated. > FairScheduler should log

[jira] [Created] (YARN-5923) Unable to access logs for a running application if YARN_ACL_ENABLE is enabled

2016-11-21 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-5923: --- Summary: Unable to access logs for a running application if YARN_ACL_ENABLE is enabled Key: YARN-5923 URL: https://issues.apache.org/jira/browse/YARN-5923 Project: Hadoop YARN

[jira] [Updated] (YARN-5922) Remove direct references of HBaseTimelineWriter/Reader in core ATS classes

2016-11-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5922: - Attachment: yarn5922.001.yarn5355.patch > Remove direct references of HBaseTimelineWriter/Reader in core

[jira] [Updated] (YARN-5922) Remove direct references of HBaseTimelineWriter/Reader in core ATS classes

2016-11-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5922: - Attachment: (was: yarn5922.001.yarn5355.patch) > Remove direct references of

[jira] [Updated] (YARN-5922) Remove direct references of HBaseTimelineWriter/Reader in core ATS classes

2016-11-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5922: - Attachment: yarn5922.001.trunk.patch yarn5922.001.yarn5355.patch > Remove direct

[jira] [Commented] (YARN-5901) Fix race condition in TestGetGroups beforeclass setup()

2016-11-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685141#comment-15685141 ] Yufei Gu commented on YARN-5901: Thanks [~haibochen] for the patch. The patch looks great. One nit: can we

[jira] [Updated] (YARN-5761) Separate QueueManager from Scheduler

2016-11-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5761: Attachment: YARN-5761.7.patch rebase the patch > Separate QueueManager from Scheduler >

[jira] [Commented] (YARN-5890) FairScheduler should log information about AM-resource-usage and max-AM-share for queues

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685126#comment-15685126 ] Hadoop QA commented on YARN-5890: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5676) Add a HashBasedRouterPolicy, that routes jobs based on queue name hash.

2016-11-21 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685106#comment-15685106 ] Subru Krishnan commented on YARN-5676: -- Thanks [~curino] for the patch. It mostly LGTM, couple of

[jira] [Commented] (YARN-5774) MR Job stuck in ACCEPTED status without any progress in Fair Scheduler if set yarn.scheduler.minimum-allocation-mb to 0.

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685115#comment-15685115 ] Hadoop QA commented on YARN-5774: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5918) Opportunistic scheduling allocate request failure when NM lost

2016-11-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685102#comment-15685102 ] Arun Suresh commented on YARN-5918: --- Thanks for raising this [~bibinchundatt] and for chiming in

[jira] [Updated] (YARN-4822) Refactor existing Preemption Policy of CS for easier adding new approach to select preemption candidates

2016-11-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4822: - Fix Version/s: 2.8.0 Thanks [~leftnoteasy]. I also backported this to branch-2.8 > Refactor existing

[jira] [Created] (YARN-5922) Remove direct references of HBaseTimelineWriter/Reader in core ATS classes

2016-11-21 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5922: Summary: Remove direct references of HBaseTimelineWriter/Reader in core ATS classes Key: YARN-5922 URL: https://issues.apache.org/jira/browse/YARN-5922 Project: Hadoop YARN

[jira] [Updated] (YARN-5667) Move HBase backend code in ATS v2 into its separate module

2016-11-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5667: - Issue Type: Task (was: Sub-task) Parent: (was: YARN-5355) > Move HBase backend code in ATS v2

[jira] [Commented] (YARN-4206) Add life time value in Application report and CLI

2016-11-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685049#comment-15685049 ] Jian He commented on YARN-4206: --- minor comment on the logging {code} sysout.println("Updating timeout of an

[jira] [Comment Edited] (YARN-5890) FairScheduler should log information about AM-resource-usage and max-AM-share for queues

2016-11-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684977#comment-15684977 ] Yufei Gu edited comment on YARN-5890 at 11/21/16 10:48 PM: --- Thanks

[jira] [Updated] (YARN-5890) FairScheduler should log information about AM-resource-usage and max-AM-share for queues

2016-11-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5890: --- Attachment: YARN-5890.002.patch Thanks [~miklos.szeg...@cloudera.com] for the review. I've uploaded the new

[jira] [Updated] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-11-21 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5739: Attachment: YARN-5739-YARN-5355.003.patch Version 003 patch that addresses more review comments. Specifically: 1.

[jira] [Commented] (YARN-5292) Support for PAUSED container state

2016-11-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684963#comment-15684963 ] Jian He commented on YARN-5292: --- bq. Since if I understand correctly, for yarn native services, there is a

[jira] [Commented] (YARN-5676) Add a HashBasedRouterPolicy, that routes jobs based on queue name hash.

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684933#comment-15684933 ] Hadoop QA commented on YARN-5676: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5911) DrainDispatcher does not drain all events on stop even if setDrainEventsOnStop is true

2016-11-21 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684917#comment-15684917 ] sandflee commented on YARN-5911: sorry, not noticed it was removed in the patch, patch LGTM >

[jira] [Updated] (YARN-4148) When killing app, RM releases app's resource before they are released by NM

2016-11-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-4148: - Attachment: YARN-4148.002.patch Sorry for the delay. I rebased the patch on trunk and added a unit test.

[jira] [Commented] (YARN-5774) MR Job stuck in ACCEPTED status without any progress in Fair Scheduler if set yarn.scheduler.minimum-allocation-mb to 0.

2016-11-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684884#comment-15684884 ] Yufei Gu commented on YARN-5774: Thanks [~templedf] for the review. I've uploaded the new patch for your

[jira] [Updated] (YARN-5774) MR Job stuck in ACCEPTED status without any progress in Fair Scheduler if set yarn.scheduler.minimum-allocation-mb to 0.

2016-11-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5774: --- Attachment: YARN-5774.005.patch > MR Job stuck in ACCEPTED status without any progress in Fair Scheduler if

[jira] [Commented] (YARN-5280) Allow YARN containers to run with Java Security Manager

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684857#comment-15684857 ] Hadoop QA commented on YARN-5280: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5676) Add a HashBasedRouterPolicy, that routes jobs based on queue name hash.

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684854#comment-15684854 ] Hadoop QA commented on YARN-5676: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-5921) Incorrect synchronization in RMContextImpl#setHAServiceState/getHAServiceState

2016-11-21 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-5921: -- Summary: Incorrect synchronization in RMContextImpl#setHAServiceState/getHAServiceState Key: YARN-5921 URL: https://issues.apache.org/jira/browse/YARN-5921 Project:

[jira] [Commented] (YARN-5920) TestRMHA.testTransitionedToStandbyShouldNotHang is flaky

2016-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684833#comment-15684833 ] Hadoop QA commented on YARN-5920: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-11-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684826#comment-15684826 ] Jian He commented on YARN-5694: --- bq. (Currently, it's only started with manual failover, which doesn't make

[jira] [Comment Edited] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-11-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684826#comment-15684826 ] Jian He edited comment on YARN-5694 at 11/21/16 9:45 PM: - bq. (Currently, it's only

[jira] [Assigned] (YARN-5184) Fix up incompatible changes introduced on ContainerStatus and NodeReport

2016-11-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned YARN-5184: Assignee: Junping Du (was: Sangjin Lee) > Fix up incompatible changes introduced on

[jira] [Updated] (YARN-5676) Add a HashBasedRouterPolicy, that routes jobs based on queue name hash.

2016-11-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5676: --- Attachment: YARN-5676-YARN-2915.04.patch > Add a HashBasedRouterPolicy, that routes jobs based on

[jira] [Commented] (YARN-5920) TestRMHA.testTransitionedToStandbyShouldNotHang is flaky

2016-11-21 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684696#comment-15684696 ] Varun Saxena commented on YARN-5920: This test is failing due to a deadlock. When RM transitions to

[jira] [Updated] (YARN-5280) Allow YARN containers to run with Java Security Manager

2016-11-21 Thread Greg Phillips (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Phillips updated YARN-5280: Attachment: YARN-5280.005.patch > Allow YARN containers to run with Java Security Manager >

[jira] [Updated] (YARN-4091) Add REST API to retrieve scheduler activity

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-4091: -- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > Add REST API to retrieve

[jira] [Updated] (YARN-5049) Extend NMStateStore to save queued container information

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5049: -- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > Extend NMStateStore to save

[jira] [Updated] (YARN-5121) fix some container-executor portability issues

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5121: -- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > fix some container-executor

[jira] [Updated] (YARN-5431) TimeLineReader daemon start should allow to pass its own reader opts

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5431: -- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > TimeLineReader daemon start

[jira] [Updated] (YARN-5456) container-executor support for FreeBSD, NetBSD, and others if conf path is absolute

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5456: -- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > container-executor support for

[jira] [Updated] (YARN-5457) Refactor DistributedScheduling framework to pull out common functionality

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5457: -- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > Refactor DistributedScheduling

[jira] [Updated] (YARN-5920) TestRMHA.testTransitionedToStandbyShouldNotHang is flaky

2016-11-21 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5920: --- Summary: TestRMHA.testTransitionedToStandbyShouldNotHang is flaky (was:

[jira] [Updated] (YARN-5495) Remove import wildcard in CapacityScheduler

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5495: -- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 > Remove import wildcard in

[jira] [Updated] (YARN-5550) TestYarnCLI#testGetContainers should format according to CONTAINER_PATTERN

2016-11-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5550: -- Fix Version/s: (was: 3.0.0-alpha2) 3.0.0-alpha1 Looks like this was actually

[jira] [Updated] (YARN-5280) Allow YARN containers to run with Java Security Manager

2016-11-21 Thread Greg Phillips (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Phillips updated YARN-5280: Attachment: (was: YARN-5280.005.patch) > Allow YARN containers to run with Java Security Manager

[jira] [Commented] (YARN-5890) FairScheduler should log information about AM-resource-usage and max-AM-share for queues

2016-11-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684672#comment-15684672 ] Miklos Szegedi commented on YARN-5890: -- Thank you for the patch [~yufeigu]! On the comment: {code}If

[jira] [Comment Edited] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-11-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684278#comment-15684278 ] Daniel Templeton edited comment on YARN-5694 at 11/21/16 8:26 PM: -- This

[jira] [Updated] (YARN-5920) TestRMHA.testTransitionedToStandbyShouldNotHang is flaky

2016-11-21 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5920: --- Attachment: YARN-5920.01.patch > TestRMHA.testTransitionedToStandbyShouldNotHang is flaky >

[jira] [Commented] (YARN-5362) TestRMRestart#testFinishedAppRemovalAfterRMRestart can fail

2016-11-21 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684630#comment-15684630 ] Varun Saxena commented on YARN-5362: This will be fixed by YARN-5548 >

[jira] [Commented] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-11-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684625#comment-15684625 ] Daniel Templeton commented on YARN-5694: Test failure is YARN-5362. I should probably add some

  1   2   >