[jira] [Commented] (YARN-5048) DelegationTokenRenewer#skipTokenRenewal may throw NPE

2016-05-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273690#comment-15273690 ] Jian He commented on YARN-5048: --- nice catch ! uploaded a patch to fix this. > DelegationTok

[jira] [Updated] (YARN-5048) DelegationTokenRenewer#skipTokenRenewal may throw NPE

2016-05-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5048: -- Attachment: YARN-5048.2.patch > DelegationTokenRenewer#skipTokenRenewal may throw NPE >

[jira] [Updated] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5045: -- Attachment: YARN-5045-YARN-2928.01.patch Posted patch v.1. This should be ready for review. > hbase unit

[jira] [Commented] (YARN-5048) DelegationTokenRenewer#skipTokenRenewal may throw NPE

2016-05-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273680#comment-15273680 ] Yongjun Zhang commented on YARN-5048: - Thanks [~jianhe]. Noticed one little thing, we

[jira] [Commented] (YARN-2429) LCE should blacklist based upon group

2016-05-05 Thread Vikram (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273681#comment-15273681 ] Vikram commented on YARN-2429: -- I am new here looking for simple bugs to work on. If this bug

[jira] [Commented] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273678#comment-15273678 ] Hadoop QA commented on YARN-5050: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273647#comment-15273647 ] Li Lu commented on YARN-5050: - Cannot reproduce the test failure locally. The test is only for

[jira] [Commented] (YARN-4807) MockAM#waitForState sleep duration is too long

2016-05-05 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273639#comment-15273639 ] Rohith Sharma K S commented on YARN-4807: - [~sunilg] I tried back porting this JIRA

[jira] [Commented] (YARN-4947) Test timeout is happening for TestRMWebServicesNodes

2016-05-05 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273625#comment-15273625 ] Rohith Sharma K S commented on YARN-4947: - Labeled as 2.8-candidate > Test timeout

[jira] [Updated] (YARN-4947) Test timeout is happening for TestRMWebServicesNodes

2016-05-05 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4947: Labels: 2.8-candidate (was: ) > Test timeout is happening for TestRMWebServicesNodes > -

[jira] [Commented] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273585#comment-15273585 ] Hadoop QA commented on YARN-5045: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5048) DelegationTokenRenewer#skipTokenRenewal may throw NPE

2016-05-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273574#comment-15273574 ] Jian He commented on YARN-5048: --- Those tests are not related. I've run them locally. thanks

[jira] [Commented] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273501#comment-15273501 ] Hadoop QA commented on YARN-5050: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5029) RM needs to send update event with YarnApplicationState as Running to ATS/AHS

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273459#comment-15273459 ] Hadoop QA commented on YARN-5029: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5050: Attachment: YARN-5050-YARN-2928.001.patch Patch 001 to clean up the code and make sure all UTs pass. > Code cleanup

[jira] [Created] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-05 Thread Li Lu (JIRA)
Li Lu created YARN-5050: --- Summary: Code cleanup for TestDistributedShell Key: YARN-5050 URL: https://issues.apache.org/jira/browse/YARN-5050 Project: Hadoop YARN Issue Type: Sub-task Report

[jira] [Commented] (YARN-5000) [YARN-3368] App attempt page is not loading when timeline server is not started

2016-05-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273408#comment-15273408 ] Wangda Tan commented on YARN-5000: -- [~sunilg], Tested the patch, haven't done deep tests,

[jira] [Updated] (YARN-5000) [YARN-3368] App attempt page is not loading when timeline server is not started

2016-05-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5000: - Attachment: screenshot-1.png > [YARN-3368] App attempt page is not loading when timeline server is not > s

[jira] [Updated] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5045: -- Attachment: YARN-5045-YARN-2928.poc.patch Posted the POC patch. With this, I have a clean build in terms

[jira] [Commented] (YARN-4515) [YARN-3368] Support hosting web UI framework inside YARN RM

2016-05-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273390#comment-15273390 ] Wangda Tan commented on YARN-4515: -- My bad, it is caused by one Chrome plugin I installed:

[jira] [Commented] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273383#comment-15273383 ] Sangjin Lee commented on YARN-5045: --- One point about not including non-test source in the

[jira] [Created] (YARN-5049) Extend NMStateStore to save queued container information

2016-05-05 Thread Konstantinos Karanasos (JIRA)
Konstantinos Karanasos created YARN-5049: Summary: Extend NMStateStore to save queued container information Key: YARN-5049 URL: https://issues.apache.org/jira/browse/YARN-5049 Project: Hadoop Y

[jira] [Comment Edited] (YARN-5048) DelegationTokenRenewer#skipTokenRenewal may throw NPE

2016-05-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273372#comment-15273372 ] Yongjun Zhang edited comment on YARN-5048 at 5/6/16 12:20 AM: --

[jira] [Commented] (YARN-4515) [YARN-3368] Support hosting web UI framework inside YARN RM

2016-05-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273374#comment-15273374 ] Wangda Tan commented on YARN-4515: -- BTW: do I need to apply other patches to try this? >

[jira] [Commented] (YARN-5048) DelegationTokenRenewer#skipTokenRenewal may throw NPE

2016-05-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273372#comment-15273372 ] Yongjun Zhang commented on YARN-5048: - Thanks for the explanation [~jianhe]. I'm +1 on

[jira] [Commented] (YARN-4515) [YARN-3368] Support hosting web UI framework inside YARN RM

2016-05-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273373#comment-15273373 ] Wangda Tan commented on YARN-4515: -- Some issues when I tried to run with the patch: What

[jira] [Commented] (YARN-5048) DelegationTokenRenewer#skipTokenRenewal may throw NPE

2016-05-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273367#comment-15273367 ] Jian He commented on YARN-5048: --- Hi Yongjun bq. what circumstance that RM does not have the

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273366#comment-15273366 ] Wangda Tan commented on YARN-5039: -- + [~djp] since this may be related to node grace decom

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-05 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273361#comment-15273361 ] Miles Crawford commented on YARN-5039: -- So we could be shooting ourselves in the foot

[jira] [Commented] (YARN-2888) Corrective mechanisms for rebalancing NM container queues

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273351#comment-15273351 ] Hadoop QA commented on YARN-2888: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5048) DelegationTokenRenewer#skipTokenRenewal may throw NPE

2016-05-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273347#comment-15273347 ] Yongjun Zhang commented on YARN-5048: - HI [~jianhe], Thanks for catching the issue and

[jira] [Commented] (YARN-5048) DelegationTokenRenewer#skipTokenRenewal may throw NPE

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273344#comment-15273344 ] Hadoop QA commented on YARN-5048: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5029) RM needs to send update event with YarnApplicationState as Running to ATS/AHS

2016-05-05 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273335#comment-15273335 ] Xuan Gong commented on YARN-5029: - Thanks for the review. Junping. Uploaded a new patch to

[jira] [Updated] (YARN-5029) RM needs to send update event with YarnApplicationState as Running to ATS/AHS

2016-05-05 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5029: Attachment: YARN-5029.2.patch > RM needs to send update event with YarnApplicationState as Running to ATS/AHS

[jira] [Commented] (YARN-5046) [Umbrella] Refactor scheduler code

2016-05-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273324#comment-15273324 ] Ray Chiang commented on YARN-5046: -- [~leftnoteasy] or [~jianhe], let me know if you think

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273289#comment-15273289 ] Hadoop QA commented on YARN-3362: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273267#comment-15273267 ] Wangda Tan commented on YARN-5039: -- It seems some nodes are in decommissioning state from

[jira] [Updated] (YARN-5039) Applications ACCEPTED but not starting

2016-05-05 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford updated YARN-5039: - Attachment: queue-config.log Attached the queue config section of RM logs from startup, looks like

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273240#comment-15273240 ] Jason Lowe commented on YARN-5039: -- Can you also double-check that the startup messages in

[jira] [Commented] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273218#comment-15273218 ] Sangjin Lee commented on YARN-5045: --- This is basically a *diamond dependency problem*. Ti

[jira] [Commented] (YARN-5044) Add peak memory usage counter for each task

2016-05-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273195#comment-15273195 ] Yufei Gu commented on YARN-5044: [~vvasudev], thanks for pointing out. But I cannot find th

[jira] [Commented] (YARN-4766) NM should not aggregate logs older than the retention policy

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273156#comment-15273156 ] Hadoop QA commented on YARN-4766: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4963) capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273116#comment-15273116 ] Hadoop QA commented on YARN-4963: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-05-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273108#comment-15273108 ] Wangda Tan commented on YARN-4390: -- Thanks [~jianhe]/[~sunilg]/[~eepayne] for reviewing th

[jira] [Commented] (YARN-2888) Corrective mechanisms for rebalancing NM container queues

2016-05-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273104#comment-15273104 ] Arun Suresh commented on YARN-2888: --- Thanks for the review [~kkaranasos]. I agree with m

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-05 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273098#comment-15273098 ] Miles Crawford commented on YARN-5039: -- Nope, I set reservations-continue-look-all-nod

[jira] [Updated] (YARN-5048) DelegationTokenRenewer#skipTokenRenewal may throw NPE

2016-05-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5048: -- Attachment: YARN-5048.1.patch > DelegationTokenRenewer#skipTokenRenewal may throw NPE >

[jira] [Created] (YARN-5048) DelegationTokenRenewer#skipTokenRenewal may throw NPE

2016-05-05 Thread Jian He (JIRA)
Jian He created YARN-5048: - Summary: DelegationTokenRenewer#skipTokenRenewal may throw NPE Key: YARN-5048 URL: https://issues.apache.org/jira/browse/YARN-5048 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-4994) Use MiniYARNCluster with try-with-resources in tests

2016-05-05 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273076#comment-15273076 ] Andras Bokor commented on YARN-4994: It seems the test failures are not related. I thou

[jira] [Commented] (YARN-5034) Failing tests after using try-with-resources

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273066#comment-15273066 ] Hadoop QA commented on YARN-5034: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-2888) Corrective mechanisms for rebalancing NM container queues

2016-05-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2888: -- Attachment: YARN-2888.005.patch > Corrective mechanisms for rebalancing NM container queues > ---

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-05-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273017#comment-15273017 ] Hudson commented on YARN-4390: -- FAILURE: Integrated in Hadoop-trunk-Commit #9724 (See [https:

[jira] [Updated] (YARN-4766) NM should not aggregate logs older than the retention policy

2016-05-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4766: - Attachment: yarn4766.004.patch rebased the patch on the latest trunk, fixed the compilation issue > NM sho

[jira] [Updated] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2016-05-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3362: - Attachment: YARN-3362-branch-2.7.003.patch [~Naganarasimha]], uploading YARN-3362-branch-2.7.003.patch Mos

[jira] [Commented] (YARN-5019) [YARN-3368] Change urls in new YARN ui from camel casing to hyphens

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272967#comment-15272967 ] Hadoop QA commented on YARN-5019: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4896) ProportionalPreemptionPolicy needs to handle AMResourcePercentage per partition

2016-05-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272928#comment-15272928 ] Sunil G commented on YARN-4896: --- Hi [~leftnoteasy], could you pls take a look on this patch.

[jira] [Commented] (YARN-5001) Aggregated Logs root directory is created with wrong group if nonexistent

2016-05-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272908#comment-15272908 ] Haibo Chen commented on YARN-5001: -- The fix will explicitly set the group of /tmp/logs to

[jira] [Updated] (YARN-4963) capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable

2016-05-05 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated YARN-4963: - Attachment: YARN-4963.002.patch Address checkstyle comment. > capacity scheduler: Make number of

[jira] [Commented] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

2016-05-05 Thread Daniel Zhi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272901#comment-15272901 ] Daniel Zhi commented on YARN-4676: -- To clarify before I make code changes: 1. HostsFileRe

[jira] [Updated] (YARN-5019) [YARN-3368] Change urls in new YARN ui from camel casing to hyphens

2016-05-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5019: -- Attachment: YARN-5019-YARN-3368.1.patch Attaching an initial version of the patch. > [YARN-3368] Change urls in

[jira] [Updated] (YARN-5001) Aggregated Logs root directory is created with wrong group if nonexistent

2016-05-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5001: - Description: The directory /tmp/logs, where the aggregated logs go, is supposed to be read by JHS. But if i

[jira] [Updated] (YARN-5001) Aggregated Logs root directory is created with wrong group if nonexistent

2016-05-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5001: - Description: The directory /tmp/logs, where the aggregated logs go, is supposed to be read by JHS. But if i

[jira] [Commented] (YARN-5029) RM needs to send update event with YarnApplicationState as Running to ATS/AHS

2016-05-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272832#comment-15272832 ] Junping Du commented on YARN-5029: -- Thanks [~xgong] for reporting the issue and putting up

[jira] [Updated] (YARN-5034) Failing tests after using try-with-resources

2016-05-05 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated YARN-5034: --- Attachment: YARN-5034.13.patch 13: Comment change > Failing tests after using try-with-resources > ---

[jira] [Commented] (YARN-4994) Use MiniYARNCluster with try-with-resources in tests

2016-05-05 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272781#comment-15272781 ] Andras Bokor commented on YARN-4994: Meanwhile, I have an idea, will get back to you.

[jira] [Commented] (YARN-5002) getApplicationReport call may raise NPE

2016-05-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272780#comment-15272780 ] Wangda Tan commented on YARN-5002: -- [~kasha], We totally agree that enforce same ACL for

[jira] [Commented] (YARN-4994) Use MiniYARNCluster with try-with-resources in tests

2016-05-05 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272772#comment-15272772 ] Andras Bokor commented on YARN-4994: Hi [~jzhuge], In the last two days I tried many d

[jira] [Commented] (YARN-5024) TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure

2016-05-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272737#comment-15272737 ] Yufei Gu commented on YARN-5024: Sorry, not quite follow you. Could you please elaborate it

[jira] [Commented] (YARN-5024) TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure

2016-05-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272706#comment-15272706 ] Yufei Gu commented on YARN-5024: Hi [~bibinchundatt], to reproduce these flakiness, should

[jira] [Commented] (YARN-4984) LogAggregationService shouldn't swallow exception in handling createAppDir() which cause thread leak.

2016-05-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272682#comment-15272682 ] Junping Du commented on YARN-4984: -- Thanks [~leftnoteasy] to review and commit! > LogAggr

[jira] [Commented] (YARN-5044) Add peak memory usage counter for each task

2016-05-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272664#comment-15272664 ] Varun Vasudev commented on YARN-5044: - [~yufeigu] - is this work for every container? H

[jira] [Assigned] (YARN-2143) Merge common killContainer logic of Fair/Capacity scheduler into AbstractYarnScheduler

2016-05-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang reassigned YARN-2143: Assignee: Ray Chiang > Merge common killContainer logic of Fair/Capacity scheduler into > AbstractY

[jira] [Assigned] (YARN-5030) Revisit o.a.h.y.s.rm.scheduler.ResourceUsage

2016-05-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang reassigned YARN-5030: Assignee: Ray Chiang > Revisit o.a.h.y.s.rm.scheduler.ResourceUsage > --

[jira] [Created] (YARN-5047) Refactor nodeUpdate() from FairScheduler and CapacityScheduler

2016-05-05 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-5047: Summary: Refactor nodeUpdate() from FairScheduler and CapacityScheduler Key: YARN-5047 URL: https://issues.apache.org/jira/browse/YARN-5047 Project: Hadoop YARN Iss

[jira] [Updated] (YARN-5046) [Umbrella] Refactor scheduler code

2016-05-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5046: - Description: At this point in time, there are several places where code common to the schedulers can be mo

[jira] [Updated] (YARN-4809) De-duplicate container completion across schedulers

2016-05-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4809: - Issue Type: Sub-task (was: Improvement) Parent: YARN-5046 > De-duplicate container completion acro

[jira] [Updated] (YARN-5030) Revisit o.a.h.y.s.rm.scheduler.ResourceUsage

2016-05-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5030: - Issue Type: Sub-task (was: Improvement) Parent: YARN-5046 > Revisit o.a.h.y.s.rm.scheduler.Resourc

[jira] [Updated] (YARN-3776) FairScheduler code refactoring to separate out the code paths for assigning a reserved container and a non-reserved container

2016-05-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3776: - Issue Type: Sub-task (was: Improvement) Parent: YARN-5046 > FairScheduler code refactoring to sepa

[jira] [Commented] (YARN-3933) Race condition when calling AbstractYarnScheduler.completedContainer.

2016-05-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272636#comment-15272636 ] Sunil G commented on YARN-3933: --- HI [~guoshiwei] Could you pls update new patch with the sugg

[jira] [Updated] (YARN-2143) Merge common killContainer logic of Fair/Capacity scheduler into AbstractYarnScheduler

2016-05-05 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-2143: - Issue Type: Sub-task (was: Task) Parent: YARN-5046 > Merge common killContainer logic of Fair/Capa

[jira] [Created] (YARN-5046) [Umbrella] Refactor scheduler code

2016-05-05 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-5046: Summary: [Umbrella] Refactor scheduler code Key: YARN-5046 URL: https://issues.apache.org/jira/browse/YARN-5046 Project: Hadoop YARN Issue Type: Task Compo

[jira] [Created] (YARN-5045) hbase unit tests fail due to dependency issues

2016-05-05 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5045: - Summary: hbase unit tests fail due to dependency issues Key: YARN-5045 URL: https://issues.apache.org/jira/browse/YARN-5045 Project: Hadoop YARN Issue Type: Sub-ta

[jira] [Updated] (YARN-5044) Add peak memory usage counter for each task

2016-05-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5044: --- Description: Each task has counters PHYSICAL_MEMORY_BYTES and VIRTUAL_MEMORY_BYTES, which are snapshots of mem

[jira] [Commented] (YARN-5034) Failing tests after using try-with-resources

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272620#comment-15272620 ] Hadoop QA commented on YARN-5034: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5044) Add peak memory usage counter for each task

2016-05-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5044: --- Description: Need the same Each task has counters PHYSICAL_MEMORY_BYTES and VIRTUAL_MEMORY_BYTES, which are

[jira] [Created] (YARN-5044) Add peak memory usage counter for each task

2016-05-05 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-5044: -- Summary: Add peak memory usage counter for each task Key: YARN-5044 URL: https://issues.apache.org/jira/browse/YARN-5044 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-5040) CPU Isolation with CGroups triggers kernel panics on Centos 7.1/7.2 when yarn.nodemanager.resource.percentage-physical-cpu-limit < 100

2016-05-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272587#comment-15272587 ] Varun Vasudev commented on YARN-5040: - I think I can reproduce this on a VM. Assigning

[jira] [Assigned] (YARN-5040) CPU Isolation with CGroups triggers kernel panics on Centos 7.1/7.2 when yarn.nodemanager.resource.percentage-physical-cpu-limit < 100

2016-05-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reassigned YARN-5040: --- Assignee: Varun Vasudev > CPU Isolation with CGroups triggers kernel panics on Centos 7.1/7.2

[jira] [Comment Edited] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

2016-05-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272554#comment-15272554 ] Varun Vasudev edited comment on YARN-4676 at 5/5/16 4:03 PM: - [

[jira] [Commented] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

2016-05-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272554#comment-15272554 ] Varun Vasudev commented on YARN-4676: - [~rkanter], [~kasha], [~djp] - instead of storin

[jira] [Commented] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

2016-05-05 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272550#comment-15272550 ] Varun Vasudev commented on YARN-4676: - Thanks for the patch [~danzhi]. My apologies for

[jira] [Commented] (YARN-5000) [YARN-3368] App attempt page is not loading when timeline server is not started

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272526#comment-15272526 ] Hadoop QA commented on YARN-5000: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-05-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272503#comment-15272503 ] Eric Payne commented on YARN-4390: -- Sorry, [~leftnoteasy], for the delay. +1. LGTM (+) >

[jira] [Updated] (YARN-5000) [YARN-3368] App attempt page is not loading when timeline server is not started

2016-05-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5000: -- Attachment: YARN-5000-YARN-3368.4.patch Uploading a cleaner patch after changing LICENSE.txt and some error messa

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

2016-05-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272455#comment-15272455 ] Hudson commented on YARN-4311: -- FAILURE: Integrated in Hadoop-trunk-Commit #9722 (See [https:

[jira] [Updated] (YARN-5034) Failing tests after using try-with-resources

2016-05-05 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated YARN-5034: --- Attachment: YARN-5034.12.patch Change stop to close in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-cli

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

2016-05-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272341#comment-15272341 ] Jason Lowe commented on YARN-4311: -- +1 lgtm. Committing this. > Removing nodes from inc

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272333#comment-15272333 ] Jason Lowe commented on YARN-5039: -- Yes, if the problem is indeed the same as that reporte

[jira] [Commented] (YARN-5034) Failing tests after using try-with-resources

2016-05-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272329#comment-15272329 ] Hadoop QA commented on YARN-5034: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (YARN-5034) Failing tests after using try-with-resources

2016-05-05 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated YARN-5034: --- Attachment: YARN-5034.11.patch 11: 1st again > Failing tests after using try-with-resources >

  1   2   >