[jira] [Commented] (YARN-2811) Fair Scheduler is violating max memory settings in 2.4

2014-11-06 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199980#comment-14199980 ] Sandy Ryza commented on YARN-2811: -- Thanks for uncovering this [~l201514]. I think that

[jira] [Commented] (YARN-2818) Remove the logic to inject entity owner as the primary filter

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199981#comment-14199981 ] Hadoop QA commented on YARN-2818: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-06 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Attachment: YARN-2753.006.patch Fix potential issues and code clean up for *NodeLabelsManager

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-06 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1427#comment-1427 ] zhihai xu commented on YARN-2753: - Hi [~leftnoteasy], thanks for the thorough review. item

[jira] [Commented] (YARN-2808) yarn client tool can not list app_attempt's container info correctly

2014-11-06 Thread George Wong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1429#comment-1429 ] George Wong commented on YARN-2808: --- [~Naganarasimha], could you link this jira to

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200048#comment-14200048 ] Hadoop QA commented on YARN-2753: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2808) yarn client tool can not list app_attempt's container info correctly

2014-11-06 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200081#comment-14200081 ] Naganarasimha G R commented on YARN-2808: - Hi [~GWong] Earlier idea was the

[jira] [Commented] (YARN-2805) RM2 in HA setup tries to login using the RM1's kerberos principal

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200116#comment-14200116 ] Hudson commented on YARN-2805: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #735 (See

[jira] [Commented] (YARN-2812) TestApplicationHistoryServer is likely to fail on less powerful machine

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200118#comment-14200118 ] Hudson commented on YARN-2812: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #735 (See

[jira] [Commented] (YARN-2579) Deadlock when EmbeddedElectorService and FatalEventDispatcher try to transition RM to StandBy at the same time

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200117#comment-14200117 ] Hudson commented on YARN-2579: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #735 (See

[jira] [Commented] (YARN-2813) NPE from MemoryTimelineStore.getDomains

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200119#comment-14200119 ] Hudson commented on YARN-2813: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #735 (See

[jira] [Commented] (YARN-2767) RM web services - add test case to ensure the http static user cannot kill or submit apps in secure mode

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200125#comment-14200125 ] Hudson commented on YARN-2767: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #735 (See

[jira] [Commented] (YARN-2579) Deadlock when EmbeddedElectorService and FatalEventDispatcher try to transition RM to StandBy at the same time

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200195#comment-14200195 ] Hudson commented on YARN-2579: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1925 (See

[jira] [Commented] (YARN-2813) NPE from MemoryTimelineStore.getDomains

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200199#comment-14200199 ] Hudson commented on YARN-2813: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1925 (See

[jira] [Commented] (YARN-2805) RM2 in HA setup tries to login using the RM1's kerberos principal

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200196#comment-14200196 ] Hudson commented on YARN-2805: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1925 (See

[jira] [Commented] (YARN-2812) TestApplicationHistoryServer is likely to fail on less powerful machine

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200198#comment-14200198 ] Hudson commented on YARN-2812: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1925 (See

[jira] [Commented] (YARN-2816) NM fail to start with NPE during container recovery

2014-11-06 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200241#comment-14200241 ] Jason Lowe commented on YARN-2816: -- This seems like a dubious use case. If something

[jira] [Updated] (YARN-2647) Add yarn queue CLI to get queue infos

2014-11-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2647: -- Attachment: 0008-YARN-2647.patch Hi [~gp.leftnoteasy] Thank you. I have updated patch as per the comments.

[jira] [Commented] (YARN-2813) NPE from MemoryTimelineStore.getDomains

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200294#comment-14200294 ] Hudson commented on YARN-2813: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1949 (See

[jira] [Commented] (YARN-2767) RM web services - add test case to ensure the http static user cannot kill or submit apps in secure mode

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200300#comment-14200300 ] Hudson commented on YARN-2767: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1949 (See

[jira] [Commented] (YARN-2579) Deadlock when EmbeddedElectorService and FatalEventDispatcher try to transition RM to StandBy at the same time

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200292#comment-14200292 ] Hudson commented on YARN-2579: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1949 (See

[jira] [Commented] (YARN-2805) RM2 in HA setup tries to login using the RM1's kerberos principal

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200291#comment-14200291 ] Hudson commented on YARN-2805: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1949 (See

[jira] [Commented] (YARN-2812) TestApplicationHistoryServer is likely to fail on less powerful machine

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200293#comment-14200293 ] Hudson commented on YARN-2812: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1949 (See

[jira] [Updated] (YARN-2780) Log aggregated resource allocation in rm-appsummary.log

2014-11-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2780: - Attachment: YARN-2780.v2.201411061601.txt [~knoguchi], I am attaching a new patch that applies cleanly to

[jira] [Commented] (YARN-2139) Add support for disk IO isolation/scheduling for containers

2014-11-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200385#comment-14200385 ] Karthik Kambatla commented on YARN-2139: Thanks for chiming in, Arun. This JIRA

[jira] [Comment Edited] (YARN-2139) Add support for disk IO isolation/scheduling for containers

2014-11-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200385#comment-14200385 ] Karthik Kambatla edited comment on YARN-2139 at 11/6/14 4:27 PM:

[jira] [Updated] (YARN-2818) Remove the logic to inject entity owner as the primary filter

2014-11-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2818: -- Attachment: YARN-2818.2.patch Remove one more unnecessary method. Remove the logic to inject entity

[jira] [Commented] (YARN-2818) Remove the logic to inject entity owner as the primary filter

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200511#comment-14200511 ] Hadoop QA commented on YARN-2818: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2780) Log aggregated resource allocation in rm-appsummary.log

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200517#comment-14200517 ] Hadoop QA commented on YARN-2780: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2647) Add yarn queue CLI to get queue infos

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200560#comment-14200560 ] Hadoop QA commented on YARN-2647: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-2819) NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6

2014-11-06 Thread Gopal V (JIRA)
Gopal V created YARN-2819: - Summary: NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6 Key: YARN-2819 URL: https://issues.apache.org/jira/browse/YARN-2819 Project: Hadoop YARN Issue Type:

[jira] [Assigned] (YARN-2819) NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6

2014-11-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-2819: - Assignee: Zhijie Shen NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6

[jira] [Commented] (YARN-2811) Fair Scheduler is violating max memory settings in 2.4

2014-11-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200648#comment-14200648 ] Siqi Li commented on YARN-2811: --- [~sandyr] Thanks for your review. I was think about the same

[jira] [Updated] (YARN-2819) NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6

2014-11-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2819: -- Priority: Critical (was: Major) NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6

[jira] [Created] (YARN-2820) Improve FileSystemRMStateStore update failure exception handling to not shutdown RM.

2014-11-06 Thread zhihai xu (JIRA)
zhihai xu created YARN-2820: --- Summary: Improve FileSystemRMStateStore update failure exception handling to not shutdown RM. Key: YARN-2820 URL: https://issues.apache.org/jira/browse/YARN-2820 Project:

[jira] [Commented] (YARN-2678) Recommended improvements to Yarn Registry

2014-11-06 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200721#comment-14200721 ] Sanjay Radia commented on YARN-2678: Don't have time to review the code, but the

[jira] [Reopened] (YARN-2791) Add Disk as a resource for scheduling

2014-11-06 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuliya Feldman reopened YARN-2791: -- Assignee: Yuliya Feldman I think this JIRA should be reopened, since

[jira] [Commented] (YARN-2678) Recommended improvements to Yarn Registry

2014-11-06 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200728#comment-14200728 ] Gour Saha commented on YARN-2678: - + 1 (non binding) We already consumed the changes in

[jira] [Commented] (YARN-2791) Add Disk as a resource for scheduling

2014-11-06 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200739#comment-14200739 ] Wei Yan commented on YARN-2791: --- Hi, [~yufeldman], this jira is same to YARN-2139. Add Disk

[jira] [Commented] (YARN-2818) Remove the logic to inject entity owner as the primary filter

2014-11-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200770#comment-14200770 ] Vinod Kumar Vavilapalli commented on YARN-2818: --- Makes sense given - We now

[jira] [Commented] (YARN-2818) Remove the logic to inject entity owner as the primary filter

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200787#comment-14200787 ] Hudson commented on YARN-2818: -- SUCCESS: Integrated in Hadoop-trunk-Commit #6468 (See

[jira] [Commented] (YARN-2817) Disk drive as a resource in YARN

2014-11-06 Thread Swapnil Daingade (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200818#comment-14200818 ] Swapnil Daingade commented on YARN-2817: Hi Arun, this is what we were proposing in

[jira] [Commented] (YARN-2791) Add Disk as a resource for scheduling

2014-11-06 Thread Aditya Kishore (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200823#comment-14200823 ] Aditya Kishore commented on YARN-2791: -- I think the summary of this JIRA may seem as

[jira] [Commented] (YARN-2791) Add Disk as a resource for scheduling

2014-11-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200829#comment-14200829 ] Karthik Kambatla commented on YARN-2791: [~adityakishore] - from reading the

[jira] [Commented] (YARN-2811) Fair Scheduler is violating max memory settings in 2.4

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200832#comment-14200832 ] Hadoop QA commented on YARN-2811: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2791) Add Disk as a resource for scheduling

2014-11-06 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200849#comment-14200849 ] Yuliya Feldman commented on YARN-2791: -- [~kasha] I agree that consolidating both and

[jira] [Commented] (YARN-2768) optimize FSAppAttempt.updateDemand by avoid clone of Resource which takes 85% of computing time of update thread

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200861#comment-14200861 ] Hudson commented on YARN-2768: -- SUCCESS: Integrated in Hadoop-trunk-Commit #6469 (See

[jira] [Created] (YARN-2821) Distributed shell app master becomes unresponsive sometimes

2014-11-06 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-2821: --- Summary: Distributed shell app master becomes unresponsive sometimes Key: YARN-2821 URL: https://issues.apache.org/jira/browse/YARN-2821 Project: Hadoop YARN

[jira] [Commented] (YARN-2791) Add Disk as a resource for scheduling

2014-11-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200900#comment-14200900 ] Karthik Kambatla commented on YARN-2791: bq. how

[jira] [Updated] (YARN-2821) Distributed shell app master becomes unresponsive sometimes

2014-11-06 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2821: Attachment: apache-yarn-2821.0.patch Uploaded patch with fix. Distributed shell app master becomes

[jira] [Commented] (YARN-2791) Add Disk as a resource for scheduling

2014-11-06 Thread Swapnil Daingade (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200961#comment-14200961 ] Swapnil Daingade commented on YARN-2791: Karthik Kambatla - I'll go through the

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200973#comment-14200973 ] Wangda Tan commented on YARN-2753: -- +1 for latest patch, thanks for update! [~zxu] Fix

[jira] [Created] (YARN-2822) NPE when RM tries to transfer state from previous attempt on recovery

2014-11-06 Thread Jian He (JIRA)
Jian He created YARN-2822: - Summary: NPE when RM tries to transfer state from previous attempt on recovery Key: YARN-2822 URL: https://issues.apache.org/jira/browse/YARN-2822 Project: Hadoop YARN

[jira] [Commented] (YARN-2822) NPE when RM tries to transfer state from previous attempt on recovery

2014-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200977#comment-14200977 ] Jian He commented on YARN-2822: --- The problem is on recovery, if the previous attempt already

[jira] [Created] (YARN-2823) NullPointerException in RM HA enabled 3-node cluster

2014-11-06 Thread Gour Saha (JIRA)
Gour Saha created YARN-2823: --- Summary: NullPointerException in RM HA enabled 3-node cluster Key: YARN-2823 URL: https://issues.apache.org/jira/browse/YARN-2823 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-2823) NullPointerException in RM HA enabled 3-node cluster

2014-11-06 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-2823: Affects Version/s: 2.6.0 NullPointerException in RM HA enabled 3-node cluster

[jira] [Updated] (YARN-2823) NullPointerException in RM HA enabled 3-node cluster

2014-11-06 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-2823: Component/s: resourcemanager NullPointerException in RM HA enabled 3-node cluster

[jira] [Updated] (YARN-2823) NullPointerException in RM HA enabled 3-node cluster

2014-11-06 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-2823: Attachment: logs_with_NPE_in_RM.zip NullPointerException in RM HA enabled 3-node cluster

[jira] [Commented] (YARN-2821) Distributed shell app master becomes unresponsive sometimes

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200997#comment-14200997 ] Hadoop QA commented on YARN-2821: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (YARN-2824) Capacity of labels should be zero by default

2014-11-06 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-2824: Summary: Capacity of labels should be zero by default Key: YARN-2824 URL: https://issues.apache.org/jira/browse/YARN-2824 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-2816) NM fail to start with NPE during container recovery

2014-11-06 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201020#comment-14201020 ] zhihai xu commented on YARN-2816: - Hi [~jlowe], thanks for the review, Based on your

[jira] [Updated] (YARN-2816) NM fail to start with NPE during container recovery

2014-11-06 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2816: Attachment: leveldb_records.txt NM fail to start with NPE during container recovery

[jira] [Updated] (YARN-2816) NM fail to start with NPE during container recovery

2014-11-06 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2816: Priority: Major (was: Critical) NM fail to start with NPE during container recovery

[jira] [Updated] (YARN-2822) NPE when RM tries to transfer state from previous attempt on recovery

2014-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2822: -- Attachment: YARN-2822.1.patch Upload a patch to add the previously finished attempt to scheduler NPE when RM

[jira] [Commented] (YARN-2816) NM fail to start with NPE during container recovery

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201025#comment-14201025 ] Hadoop QA commented on YARN-2816: - {color:red}-1 overall{color}. Here are the results of

[jira] [Assigned] (YARN-2823) NullPointerException in RM HA enabled 3-node cluster

2014-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-2823: - Assignee: Jian He NullPointerException in RM HA enabled 3-node cluster

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-06 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201038#comment-14201038 ] zhihai xu commented on YARN-2753: - Hi [~xgong], Could you help review and commit the

[jira] [Commented] (YARN-2823) NullPointerException in RM HA enabled 3-node cluster

2014-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201040#comment-14201040 ] Jian He commented on YARN-2823: --- The problem is on recovery, if the previous attempt already

[jira] [Commented] (YARN-2823) NullPointerException in RM HA enabled 3-node cluster

2014-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201041#comment-14201041 ] Jian He commented on YARN-2823: --- Upload a patch to add the previously finished attempt to

[jira] [Updated] (YARN-2823) NullPointerException in RM HA enabled 3-node cluster

2014-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2823: -- Attachment: YARN-2823.1.patch NullPointerException in RM HA enabled 3-node cluster

[jira] [Commented] (YARN-2791) Add Disk as a resource for scheduling

2014-11-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201101#comment-14201101 ] Karthik Kambatla commented on YARN-2791: [~adityakishore] - unfortunately,

[jira] [Commented] (YARN-2791) Add Disk as a resource for scheduling

2014-11-06 Thread Aditya Kishore (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201113#comment-14201113 ] Aditya Kishore commented on YARN-2791: -- Great! I think this JIRA should be added as a

[jira] [Updated] (YARN-2139) Add support for disk IO isolation/scheduling for containers

2014-11-06 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2139: -- Attachment: YARN-2139-prototype.patch I submit a prototype of the code implementation, to illustrate the basic

[jira] [Commented] (YARN-2139) Add support for disk IO isolation/scheduling for containers

2014-11-06 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201160#comment-14201160 ] Wei Yan commented on YARN-2139: --- This prototype patch is posted to garner feedback. The

[jira] [Commented] (YARN-2056) Disable preemption at Queue level

2014-11-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201166#comment-14201166 ] Eric Payne commented on YARN-2056: -- [~leftnoteasy], I'm sorry, but there is one more thing

[jira] [Commented] (YARN-2822) NPE when RM tries to transfer state from previous attempt on recovery

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201175#comment-14201175 ] Hadoop QA commented on YARN-2822: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2821) Distributed shell app master becomes unresponsive sometimes

2014-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201183#comment-14201183 ] Jian He commented on YARN-2821: --- thanks Varun ! the patch should solve the problem to release

[jira] [Commented] (YARN-2823) NullPointerException in RM HA enabled 3-node cluster

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201193#comment-14201193 ] Hadoop QA commented on YARN-2823: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2824) Capacity of labels should be zero by default

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2824: - Attachment: YARN-2824-1.patch Attached patch and added/updated tests Capacity of labels should be zero

[jira] [Commented] (YARN-2647) Add yarn queue CLI to get queue infos

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201226#comment-14201226 ] Wangda Tan commented on YARN-2647: -- Hi [~sunilg], bq. However I feel we can avoid having

[jira] [Updated] (YARN-2791) Add Disk as a resource for scheduling

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2791: - Assignee: Yuliya Feldman (was: Wangda Tan) Add Disk as a resource for scheduling

[jira] [Updated] (YARN-2803) MR distributed cache not working correctly on Windows after NodeManager privileged account changes.

2014-11-06 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2803: -- Attachment: YARN-2803.0.patch Patch to revert behavior for jar creation location, which resolves this

[jira] [Created] (YARN-2825) Container leak on NM

2014-11-06 Thread Jian He (JIRA)
Jian He created YARN-2825: - Summary: Container leak on NM Key: YARN-2825 URL: https://issues.apache.org/jira/browse/YARN-2825 Project: Hadoop YARN Issue Type: Bug Reporter: Jian He

[jira] [Commented] (YARN-2824) Capacity of labels should be zero by default

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201351#comment-14201351 ] Hadoop QA commented on YARN-2824: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2744) Under some scenario, it is possible to end up with capacity scheduler configuration that uses labels that no longer exist

2014-11-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201370#comment-14201370 ] Vinod Kumar Vavilapalli commented on YARN-2744: --- Makes sense, looks good. +1.

[jira] [Commented] (YARN-2803) MR distributed cache not working correctly on Windows after NodeManager privileged account changes.

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201373#comment-14201373 ] Hadoop QA commented on YARN-2803: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2803) MR distributed cache not working correctly on Windows after NodeManager privileged account changes.

2014-11-06 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201377#comment-14201377 ] Craig Welch commented on YARN-2803: --- The fix is to cause existing unit tests which fail

[jira] [Commented] (YARN-2744) Under some scenario, it is possible to end up with capacity scheduler configuration that uses labels that no longer exist

2014-11-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201382#comment-14201382 ] Hudson commented on YARN-2744: -- FAILURE: Integrated in Hadoop-trunk-Commit #6472 (See

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201384#comment-14201384 ] Vinod Kumar Vavilapalli commented on YARN-2753: --- Let me look.. Fix

[jira] [Commented] (YARN-2744) Under some scenario, it is possible to end up with capacity scheduler configuration that uses labels that no longer exist

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201385#comment-14201385 ] Wangda Tan commented on YARN-2744: -- Thanks for Vinod's review and commit! Under some

[jira] [Updated] (YARN-2505) Support get/add/remove/change labels in RM REST API

2014-11-06 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2505: -- Attachment: YARN-2505.18.patch And, uploaded the wrong one. This should be the right one. Support

[jira] [Commented] (YARN-2505) Support get/add/remove/change labels in RM REST API

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201402#comment-14201402 ] Wangda Tan commented on YARN-2505: -- Hi [~cwelch], Latest patch LGTM, +1. Thanks!

[jira] [Commented] (YARN-2808) yarn client tool can not list app_attempt's container info correctly

2014-11-06 Thread George Wong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201409#comment-14201409 ] George Wong commented on YARN-2808: --- That's great. Looking forward to the new container

[jira] [Commented] (YARN-2824) Capacity of labels should be zero by default

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201413#comment-14201413 ] Wangda Tan commented on YARN-2824: -- Attached new patch suppressing findbug warnings

[jira] [Updated] (YARN-2824) Capacity of labels should be zero by default

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2824: - Attachment: YARN-2824-2.patch Capacity of labels should be zero by default

[jira] [Updated] (YARN-2632) Document NM Restart feature

2014-11-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2632: - Attachment: YARN-2632-v3.patch Document NM Restart feature ---

[jira] [Commented] (YARN-2632) Document NM Restart feature

2014-11-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201415#comment-14201415 ] Junping Du commented on YARN-2632: -- Thanks [~vvasudev] for review and comments! bq. I

[jira] [Updated] (YARN-2825) Container leak on NM

2014-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2825: -- Attachment: YARN-2825.1.patch Upload a patch to check if the container is at completed state before removing it

[jira] [Assigned] (YARN-2826) User-Group mappings not updated by RM when a user is removed from a group.

2014-11-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-2826: Assignee: Wangda Tan User-Group mappings not updated by RM when a user is removed from a group.

[jira] [Commented] (YARN-2505) Support get/add/remove/change labels in RM REST API

2014-11-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201488#comment-14201488 ] Hadoop QA commented on YARN-2505: - {color:green}+1 overall{color}. Here are the results of

  1   2   >