[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273267#comment-15273267 ] Wangda Tan commented on YARN-5039: -- It seems some nodes are in decommissioning state from the

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273289#comment-15273289 ] Hadoop QA commented on YARN-3362: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273218#comment-15273218 ] Sangjin Lee commented on YARN-5045: --- This is basically a *diamond dependency problem*. Timeline service

[jira] [Updated] (YARN-5048) DelegationTokenRenewer#skipTokenRenewal may throw NPE

2016-05-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5048: -- Attachment: YARN-5048.1.patch > DelegationTokenRenewer#skipTokenRenewal may throw NPE >

[jira] [Updated] (YARN-5039) Applications ACCEPTED but not starting

2016-05-05 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford updated YARN-5039: - Attachment: queue-config.log Attached the queue config section of RM logs from startup, looks like

[jira] [Commented] (YARN-5044) Add peak memory usage counter for each task

2016-05-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273195#comment-15273195 ] Yufei Gu commented on YARN-5044: [~vvasudev], thanks for pointing out. But I cannot find these metrics on

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273240#comment-15273240 ] Jason Lowe commented on YARN-5039: -- Can you also double-check that the startup messages in the RM log show

[jira] [Updated] (YARN-5046) [Umbrella] Refactor scheduler code

2016-05-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5046: - Description: At this point in time, there are several places where code common to the schedulers can be

[jira] [Commented] (YARN-4994) Use MiniYARNCluster with try-with-resources in tests

2016-05-05 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272772#comment-15272772 ] Andras Bokor commented on YARN-4994: Hi [~jzhuge], In the last two days I tried many different

[jira] [Commented] (YARN-5001) Aggregated Logs root directory is created with wrong group if nonexistent

2016-05-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272908#comment-15272908 ] Haibo Chen commented on YARN-5001: -- The fix will explicitly set the group of /tmp/logs to the group that

[jira] [Created] (YARN-5044) Add peak memory usage counter for each task

2016-05-05 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-5044: -- Summary: Add peak memory usage counter for each task Key: YARN-5044 URL: https://issues.apache.org/jira/browse/YARN-5044 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-5034) Failing tests after using try-with-resources

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272620#comment-15272620 ] Hadoop QA commented on YARN-5034: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5044) Add peak memory usage counter for each task

2016-05-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5044: --- Description: Each task has counters PHYSICAL_MEMORY_BYTES and VIRTUAL_MEMORY_BYTES, which are snapshots of

[jira] [Updated] (YARN-2143) Merge common killContainer logic of Fair/Capacity scheduler into AbstractYarnScheduler

2016-05-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-2143: - Issue Type: Sub-task (was: Task) Parent: YARN-5046 > Merge common killContainer logic of

[jira] [Commented] (YARN-3933) Race condition when calling AbstractYarnScheduler.completedContainer.

2016-05-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272636#comment-15272636 ] Sunil G commented on YARN-3933: --- HI [~guoshiwei] Could you pls update new patch with the suggested update. >

[jira] [Updated] (YARN-3776) FairScheduler code refactoring to separate out the code paths for assigning a reserved container and a non-reserved container

2016-05-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3776: - Issue Type: Sub-task (was: Improvement) Parent: YARN-5046 > FairScheduler code refactoring to

[jira] [Updated] (YARN-5030) Revisit o.a.h.y.s.rm.scheduler.ResourceUsage

2016-05-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5030: - Issue Type: Sub-task (was: Improvement) Parent: YARN-5046 > Revisit

[jira] [Assigned] (YARN-5030) Revisit o.a.h.y.s.rm.scheduler.ResourceUsage

2016-05-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang reassigned YARN-5030: Assignee: Ray Chiang > Revisit o.a.h.y.s.rm.scheduler.ResourceUsage >

[jira] [Assigned] (YARN-2143) Merge common killContainer logic of Fair/Capacity scheduler into AbstractYarnScheduler

2016-05-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang reassigned YARN-2143: Assignee: Ray Chiang > Merge common killContainer logic of Fair/Capacity scheduler into >

[jira] [Commented] (YARN-4984) LogAggregationService shouldn't swallow exception in handling createAppDir() which cause thread leak.

2016-05-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272682#comment-15272682 ] Junping Du commented on YARN-4984: -- Thanks [~leftnoteasy] to review and commit! > LogAggregationService

[jira] [Updated] (YARN-5001) Aggregated Logs root directory is created with wrong group if nonexistent

2016-05-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5001: - Description: The directory /tmp/logs, where the aggregated logs go, is supposed to be read by JHS. But if

[jira] [Assigned] (YARN-5040) CPU Isolation with CGroups triggers kernel panics on Centos 7.1/7.2 when yarn.nodemanager.resource.percentage-physical-cpu-limit < 100

2016-05-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reassigned YARN-5040: --- Assignee: Varun Vasudev > CPU Isolation with CGroups triggers kernel panics on Centos 7.1/7.2

[jira] [Commented] (YARN-5040) CPU Isolation with CGroups triggers kernel panics on Centos 7.1/7.2 when yarn.nodemanager.resource.percentage-physical-cpu-limit < 100

2016-05-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272587#comment-15272587 ] Varun Vasudev commented on YARN-5040: - I think I can reproduce this on a VM. Assigning it to myself. >

[jira] [Created] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-05 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5045: - Summary: hbase unit tests fail due to dependency issues Key: YARN-5045 URL: https://issues.apache.org/jira/browse/YARN-5045 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

2016-05-05 Thread Daniel Zhi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272901#comment-15272901 ] Daniel Zhi commented on YARN-4676: -- To clarify before I make code changes: 1. HostsFileReader currently

[jira] [Updated] (YARN-4809) De-duplicate container completion across schedulers

2016-05-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4809: - Issue Type: Sub-task (was: Improvement) Parent: YARN-5046 > De-duplicate container completion

[jira] [Updated] (YARN-4963) capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable

2016-05-05 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated YARN-4963: - Attachment: YARN-4963.002.patch Address checkstyle comment. > capacity scheduler: Make number

[jira] [Created] (YARN-5046) [Umbrella] Refactor scheduler code

2016-05-05 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-5046: Summary: [Umbrella] Refactor scheduler code Key: YARN-5046 URL: https://issues.apache.org/jira/browse/YARN-5046 Project: Hadoop YARN Issue Type: Task

[jira] [Commented] (YARN-5002) getApplicationReport call may raise NPE

2016-05-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272780#comment-15272780 ] Wangda Tan commented on YARN-5002: -- [~kasha], We totally agree that enforce same ACL for running and

[jira] [Commented] (YARN-4994) Use MiniYARNCluster with try-with-resources in tests

2016-05-05 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272781#comment-15272781 ] Andras Bokor commented on YARN-4994: Meanwhile, I have an idea, will get back to you. > Use

[jira] [Updated] (YARN-5044) Add peak memory usage counter for each task

2016-05-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5044: --- Description: Need the same Each task has counters PHYSICAL_MEMORY_BYTES and VIRTUAL_MEMORY_BYTES, which are

[jira] [Created] (YARN-5047) Refactor nodeUpdate() from FairScheduler and CapacityScheduler

2016-05-05 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-5047: Summary: Refactor nodeUpdate() from FairScheduler and CapacityScheduler Key: YARN-5047 URL: https://issues.apache.org/jira/browse/YARN-5047 Project: Hadoop YARN

[jira] [Commented] (YARN-5044) Add peak memory usage counter for each task

2016-05-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272664#comment-15272664 ] Varun Vasudev commented on YARN-5044: - [~yufeigu] - is this work for every container? Have you looked

[jira] [Commented] (YARN-5024) TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure

2016-05-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272706#comment-15272706 ] Yufei Gu commented on YARN-5024: Hi [~bibinchundatt], to reproduce these flakiness, should remove the

[jira] [Commented] (YARN-5024) TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure

2016-05-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272737#comment-15272737 ] Yufei Gu commented on YARN-5024: Sorry, not quite follow you. Could you please elaborate it? >

[jira] [Commented] (YARN-5029) RM needs to send update event with YarnApplicationState as Running to ATS/AHS

2016-05-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272832#comment-15272832 ] Junping Du commented on YARN-5029: -- Thanks [~xgong] for reporting the issue and putting up a patch. The

[jira] [Updated] (YARN-5019) [YARN-3368] Change urls in new YARN ui from camel casing to hyphens

2016-05-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5019: -- Attachment: YARN-5019-YARN-3368.1.patch Attaching an initial version of the patch. > [YARN-3368] Change urls in

[jira] [Updated] (YARN-5034) Failing tests after using try-with-resources

2016-05-05 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated YARN-5034: --- Attachment: YARN-5034.13.patch 13: Comment change > Failing tests after using try-with-resources >

[jira] [Updated] (YARN-5001) Aggregated Logs root directory is created with wrong group if nonexistent

2016-05-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5001: - Description: The directory /tmp/logs, where the aggregated logs go, is supposed to be read by JHS. But if

[jira] [Commented] (YARN-4926) Change nodelabel rest API invalid reponse status to 400

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272076#comment-15272076 ] Hadoop QA commented on YARN-4926: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4595) Add support for configurable read-only mounts when launching Docker containers

2016-05-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272046#comment-15272046 ] Hudson commented on YARN-4595: -- FAILURE: Integrated in Hadoop-trunk-Commit #9721 (See

[jira] [Updated] (YARN-5034) Failing tests after using try-with-resources

2016-05-05 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated YARN-5034: --- Attachment: YARN-5034.10.patch 10: Refactor testHedgingRequestProxyProvider > Failing tests after

[jira] [Commented] (YARN-5023) TestAMRestart#testShouldNotCountFailureToMaxAttemptRetry random failure

2016-05-05 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272139#comment-15272139 ] sandflee commented on YARN-5023: I write a script to auto test and reproduce it, file YARN-5043, may it

[jira] [Created] (YARN-5043) TestAMRestart.testRMAppAttemptFailuresValidityInterval random fail

2016-05-05 Thread sandflee (JIRA)
sandflee created YARN-5043: -- Summary: TestAMRestart.testRMAppAttemptFailuresValidityInterval random fail Key: YARN-5043 URL: https://issues.apache.org/jira/browse/YARN-5043 Project: Hadoop YARN

[jira] [Updated] (YARN-5043) TestAMRestart.testRMAppAttemptFailuresValidityInterval random fail

2016-05-05 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee updated YARN-5043: --- Attachment: TestAMRestart-output.txt > TestAMRestart.testRMAppAttemptFailuresValidityInterval random fail >

[jira] [Updated] (YARN-5041) application master log can not be available when clicking jobhistory's am logs link

2016-05-05 Thread chenyukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chenyukang updated YARN-5041: - Description: In history server webapp, application master logs link is wrong. it shows "No logs available

[jira] [Commented] (YARN-4947) Test timeout is happening for TestRMWebServicesNodes

2016-05-05 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271982#comment-15271982 ] Bibin A Chundatt commented on YARN-4947: TestRMWebServicesApps has some test failures in latest

[jira] [Updated] (YARN-4595) Add support for configurable read-only mounts when launching Docker containers

2016-05-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4595: Summary: Add support for configurable read-only mounts when launching Docker containers (was: Add

[jira] [Created] (YARN-5042) Mount /sys/fs/cgroup into Docker containers as read only mount

2016-05-05 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-5042: --- Summary: Mount /sys/fs/cgroup into Docker containers as read only mount Key: YARN-5042 URL: https://issues.apache.org/jira/browse/YARN-5042 Project: Hadoop YARN

[jira] [Commented] (YARN-5034) Failing tests after using try-with-resources

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272008#comment-15272008 ] Hadoop QA commented on YARN-5034: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4926) Change nodelabel rest API invalid reponse status to 400

2016-05-05 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4926: --- Attachment: 0002-YARN-4926.patch Attaching updated patch > Change nodelabel rest API invalid

[jira] [Commented] (YARN-5034) Failing tests after using try-with-resources

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272249#comment-15272249 ] Hadoop QA commented on YARN-5034: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5038) [YARN-3368] Application and Container pages shows wrong values when RM is stopped

2016-05-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5038: -- Summary: [YARN-3368] Application and Container pages shows wrong values when RM is stopped (was: [YARN-3368]

[jira] [Updated] (YARN-5034) Failing tests after using try-with-resources

2016-05-05 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated YARN-5034: --- Attachment: YARN-5034.11.patch 11: 1st again > Failing tests after using try-with-resources >

[jira] [Updated] (YARN-5034) Failing tests after using try-with-resources

2016-05-05 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated YARN-5034: --- Attachment: YARN-5034.12.patch Change stop to close in

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

2016-05-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272455#comment-15272455 ] Hudson commented on YARN-4311: -- FAILURE: Integrated in Hadoop-trunk-Commit #9722 (See

[jira] [Updated] (YARN-5000) [YARN-3368] App attempt page is not loading when timeline server is not started

2016-05-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5000: -- Attachment: YARN-5000-YARN-3368.4.patch Uploading a cleaner patch after changing LICENSE.txt and some error

[jira] [Commented] (YARN-5034) Failing tests after using try-with-resources

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272329#comment-15272329 ] Hadoop QA commented on YARN-5034: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272333#comment-15272333 ] Jason Lowe commented on YARN-5039: -- Yes, if the problem is indeed the same as that reported in YARN-4610

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

2016-05-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272341#comment-15272341 ] Jason Lowe commented on YARN-4311: -- +1 lgtm. Committing this. > Removing nodes from include and exclude

[jira] [Commented] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

2016-05-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272550#comment-15272550 ] Varun Vasudev commented on YARN-4676: - Thanks for the patch [~danzhi]. My apologies for coming in late

[jira] [Commented] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

2016-05-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272554#comment-15272554 ] Varun Vasudev commented on YARN-4676: - [~rkanter], [~kasha], [~djp] - instead of storing the timeouts

[jira] [Comment Edited] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

2016-05-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272554#comment-15272554 ] Varun Vasudev edited comment on YARN-4676 at 5/5/16 4:03 PM: - [~rkanter],

[jira] [Updated] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2016-05-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3362: - Attachment: YARN-3362-branch-2.7.003.patch [~Naganarasimha]], uploading YARN-3362-branch-2.7.003.patch

[jira] [Updated] (YARN-2888) Corrective mechanisms for rebalancing NM container queues

2016-05-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2888: -- Attachment: YARN-2888.005.patch > Corrective mechanisms for rebalancing NM container queues >

[jira] [Commented] (YARN-4963) capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273116#comment-15273116 ] Hadoop QA commented on YARN-4963: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4766) NM should not aggregate logs older than the retention policy

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273156#comment-15273156 ] Hadoop QA commented on YARN-4766: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5034) Failing tests after using try-with-resources

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273066#comment-15273066 ] Hadoop QA commented on YARN-5034: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4994) Use MiniYARNCluster with try-with-resources in tests

2016-05-05 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273076#comment-15273076 ] Andras Bokor commented on YARN-4994: It seems the test failures are not related. I thought Hadoop QA

[jira] [Commented] (YARN-2888) Corrective mechanisms for rebalancing NM container queues

2016-05-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273104#comment-15273104 ] Arun Suresh commented on YARN-2888: --- Thanks for the review [~kkaranasos]. I agree with most of your

[jira] [Commented] (YARN-4896) ProportionalPreemptionPolicy needs to handle AMResourcePercentage per partition

2016-05-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272928#comment-15272928 ] Sunil G commented on YARN-4896: --- Hi [~leftnoteasy], could you pls take a look on this patch. >

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-05-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273108#comment-15273108 ] Wangda Tan commented on YARN-4390: -- Thanks [~jianhe]/[~sunilg]/[~eepayne] for reviewing the patch! > Do

[jira] [Updated] (YARN-4766) NM should not aggregate logs older than the retention policy

2016-05-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4766: - Attachment: yarn4766.004.patch rebased the patch on the latest trunk, fixed the compilation issue > NM

[jira] [Created] (YARN-5048) DelegationTokenRenewer#skipTokenRenewal may throw NPE

2016-05-05 Thread Jian He (JIRA)
Jian He created YARN-5048: - Summary: DelegationTokenRenewer#skipTokenRenewal may throw NPE Key: YARN-5048 URL: https://issues.apache.org/jira/browse/YARN-5048 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5019) [YARN-3368] Change urls in new YARN ui from camel casing to hyphens

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272967#comment-15272967 ] Hadoop QA commented on YARN-5019: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-05-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273017#comment-15273017 ] Hudson commented on YARN-4390: -- FAILURE: Integrated in Hadoop-trunk-Commit #9724 (See

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-05 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273098#comment-15273098 ] Miles Crawford commented on YARN-5039: -- Nope, I set reservations-continue-look-all-nodes to false, and

[jira] [Commented] (YARN-5046) [Umbrella] Refactor scheduler code

2016-05-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273324#comment-15273324 ] Ray Chiang commented on YARN-5046: -- [~leftnoteasy] or [~jianhe], let me know if you think if it makes

[jira] [Commented] (YARN-5048) DelegationTokenRenewer#skipTokenRenewal may throw NPE

2016-05-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273367#comment-15273367 ] Jian He commented on YARN-5048: --- Hi Yongjun bq. what circumstance that RM does not have the token kind

[jira] [Commented] (YARN-5048) DelegationTokenRenewer#skipTokenRenewal may throw NPE

2016-05-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273372#comment-15273372 ] Yongjun Zhang commented on YARN-5048: - Thanks for the explanation [~jianhe]. I'm +1 on your patch. >

[jira] [Commented] (YARN-4515) [YARN-3368] Support hosting web UI framework inside YARN RM

2016-05-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273374#comment-15273374 ] Wangda Tan commented on YARN-4515: -- BTW: do I need to apply other patches to try this? > [YARN-3368]

[jira] [Commented] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273501#comment-15273501 ] Hadoop QA commented on YARN-5050: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5048) DelegationTokenRenewer#skipTokenRenewal may throw NPE

2016-05-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273347#comment-15273347 ] Yongjun Zhang commented on YARN-5048: - HI [~jianhe], Thanks for catching the issue and the patch! The

[jira] [Commented] (YARN-5048) DelegationTokenRenewer#skipTokenRenewal may throw NPE

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273344#comment-15273344 ] Hadoop QA commented on YARN-5048: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-5048) DelegationTokenRenewer#skipTokenRenewal may throw NPE

2016-05-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273372#comment-15273372 ] Yongjun Zhang edited comment on YARN-5048 at 5/6/16 12:20 AM: -- Thanks for the

[jira] [Commented] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273383#comment-15273383 ] Sangjin Lee commented on YARN-5045: --- One point about not including non-test source in the separated

[jira] [Created] (YARN-5049) Extend NMStateStore to save queued container information

2016-05-05 Thread Konstantinos Karanasos (JIRA)
Konstantinos Karanasos created YARN-5049: Summary: Extend NMStateStore to save queued container information Key: YARN-5049 URL: https://issues.apache.org/jira/browse/YARN-5049 Project: Hadoop

[jira] [Updated] (YARN-5029) RM needs to send update event with YarnApplicationState as Running to ATS/AHS

2016-05-05 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5029: Attachment: YARN-5029.2.patch > RM needs to send update event with YarnApplicationState as Running to

[jira] [Updated] (YARN-5000) [YARN-3368] App attempt page is not loading when timeline server is not started

2016-05-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5000: - Attachment: screenshot-1.png > [YARN-3368] App attempt page is not loading when timeline server is not >

[jira] [Commented] (YARN-5000) [YARN-3368] App attempt page is not loading when timeline server is not started

2016-05-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273408#comment-15273408 ] Wangda Tan commented on YARN-5000: -- [~sunilg], Tested the patch, haven't done deep tests, some comments

[jira] [Updated] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5050: Attachment: YARN-5050-YARN-2928.001.patch Patch 001 to clean up the code and make sure all UTs pass. > Code

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273366#comment-15273366 ] Wangda Tan commented on YARN-5039: -- + [~djp] since this may be related to node grace decommissioning. >

[jira] [Commented] (YARN-4515) [YARN-3368] Support hosting web UI framework inside YARN RM

2016-05-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273373#comment-15273373 ] Wangda Tan commented on YARN-4515: -- Some issues when I tried to run with the patch: What I have done: - I

[jira] [Updated] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5045: -- Attachment: YARN-5045-YARN-2928.poc.patch Posted the POC patch. With this, I have a clean build in terms

[jira] [Created] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-05 Thread Li Lu (JIRA)
Li Lu created YARN-5050: --- Summary: Code cleanup for TestDistributedShell Key: YARN-5050 URL: https://issues.apache.org/jira/browse/YARN-5050 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5029) RM needs to send update event with YarnApplicationState as Running to ATS/AHS

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273459#comment-15273459 ] Hadoop QA commented on YARN-5029: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-05 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273361#comment-15273361 ] Miles Crawford commented on YARN-5039: -- So we could be shooting ourselves in the foot by scaling our

[jira] [Commented] (YARN-5029) RM needs to send update event with YarnApplicationState as Running to ATS/AHS

2016-05-05 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273335#comment-15273335 ] Xuan Gong commented on YARN-5029: - Thanks for the review. Junping. Uploaded a new patch to fix checkstyle

[jira] [Commented] (YARN-2888) Corrective mechanisms for rebalancing NM container queues

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273351#comment-15273351 ] Hadoop QA commented on YARN-2888: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4515) [YARN-3368] Support hosting web UI framework inside YARN RM

2016-05-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273390#comment-15273390 ] Wangda Tan commented on YARN-4515: -- My bad, it is caused by one Chrome plugin I installed:

  1   2   >