[jira] [Commented] (YARN-851) Share NMTokens using NMTokenCache (api-based) instead of memory based approach which is used currently.

[ https://issues.apache.org/jira/browse/YARN-851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690188#comment-13690188 ] Hudson commented on YARN-851: - Integrated in Hadoop-Yarn-trunk #247 (See

[jira] [Commented] (YARN-861) TestContainerManager is failing

[ https://issues.apache.org/jira/browse/YARN-861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690189#comment-13690189 ] Hudson commented on YARN-861: - Integrated in Hadoop-Yarn-trunk #247 (See

[jira] [Commented] (YARN-478) fix coverage org.apache.hadoop.yarn.webapp.log

[ https://issues.apache.org/jira/browse/YARN-478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690234#comment-13690234 ] Hudson commented on YARN-478: - Integrated in Hadoop-Hdfs-0.23-Build #645 (See

[jira] [Commented] (YARN-478) fix coverage org.apache.hadoop.yarn.webapp.log

[ https://issues.apache.org/jira/browse/YARN-478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690252#comment-13690252 ] Hudson commented on YARN-478: - Integrated in Hadoop-Hdfs-trunk #1437 (See

[jira] [Commented] (YARN-861) TestContainerManager is failing

[ https://issues.apache.org/jira/browse/YARN-861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690250#comment-13690250 ] Hudson commented on YARN-861: - Integrated in Hadoop-Hdfs-trunk #1437 (See

[jira] [Commented] (YARN-851) Share NMTokens using NMTokenCache (api-based) instead of memory based approach which is used currently.

[ https://issues.apache.org/jira/browse/YARN-851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690249#comment-13690249 ] Hudson commented on YARN-851: - Integrated in Hadoop-Hdfs-trunk #1437 (See

[jira] [Commented] (YARN-851) Share NMTokens using NMTokenCache (api-based) instead of memory based approach which is used currently.

[ https://issues.apache.org/jira/browse/YARN-851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690301#comment-13690301 ] Hudson commented on YARN-851: - Integrated in Hadoop-Mapreduce-trunk #1464 (See

[jira] [Commented] (YARN-478) fix coverage org.apache.hadoop.yarn.webapp.log

[ https://issues.apache.org/jira/browse/YARN-478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690304#comment-13690304 ] Hudson commented on YARN-478: - Integrated in Hadoop-Mapreduce-trunk #1464 (See

[jira] [Commented] (YARN-861) TestContainerManager is failing

[ https://issues.apache.org/jira/browse/YARN-861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690302#comment-13690302 ] Hudson commented on YARN-861: - Integrated in Hadoop-Mapreduce-trunk #1464 (See

[jira] [Commented] (YARN-866) Add test for class ResourceWeights

[ https://issues.apache.org/jira/browse/YARN-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690439#comment-13690439 ] Alejandro Abdelnur commented on YARN-866: - +1 Add test for class

[jira] [Commented] (YARN-866) Add test for class ResourceWeights

[ https://issues.apache.org/jira/browse/YARN-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690455#comment-13690455 ] Hudson commented on YARN-866: - Integrated in Hadoop-trunk-Commit #3996 (See

[jira] [Updated] (YARN-864) YARN NM leaking containers with CGroups

[ https://issues.apache.org/jira/browse/YARN-864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Riccomini updated YARN-864: - Attachment: rm-log Attaching RM logs. They show that the NM was marked as lost. 09:36:05,614

[jira] [Commented] (YARN-864) YARN NM leaking containers with CGroups

[ https://issues.apache.org/jira/browse/YARN-864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690461#comment-13690461 ] Chris Riccomini commented on YARN-864: -- Hey Vinod, So here's what I know: 1. The RM

[jira] [Commented] (YARN-864) YARN NM leaking containers with CGroups

[ https://issues.apache.org/jira/browse/YARN-864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690506#comment-13690506 ] Jian He commented on YARN-864: -- This might be related to YARN-688. YARN NM

[jira] [Commented] (YARN-864) YARN NM leaking containers with CGroups

[ https://issues.apache.org/jira/browse/YARN-864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690523#comment-13690523 ] Chris Riccomini commented on YARN-864: -- Hey Jian, Interesting. Do you have a re-based

[jira] [Commented] (YARN-827) Need to make Resource arithmetic methods public

[ https://issues.apache.org/jira/browse/YARN-827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690533#comment-13690533 ] Bikas Saha commented on YARN-827: - +1. Straightforward refactor. Need to

[jira] [Resolved] (YARN-242) Fix allocation issues in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-242. -- Resolution: Invalid I guess things have changed. Please open specific issues

[jira] [Updated] (YARN-827) Need to make Resource arithmetic methods accessible

[ https://issues.apache.org/jira/browse/YARN-827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-827: Summary: Need to make Resource arithmetic methods accessible (was: Need to make Resource arithmetic methods

[jira] [Commented] (YARN-827) Need to make Resource arithmetic methods accessible

[ https://issues.apache.org/jira/browse/YARN-827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690576#comment-13690576 ] Hudson commented on YARN-827: - Integrated in Hadoop-trunk-Commit #3997 (See

[jira] [Updated] (YARN-688) Containers not cleaned up when NM received SHUTDOWN event from NodeStatusUpdater

[ https://issues.apache.org/jira/browse/YARN-688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-688: - Attachment: YARN-688-2.0.5-alpha.patch patch for 2.0.5-alpha for YARN-864 Containers not cleaned

[jira] [Commented] (YARN-688) Containers not cleaned up when NM received SHUTDOWN event from NodeStatusUpdater

[ https://issues.apache.org/jira/browse/YARN-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690591#comment-13690591 ] Hadoop QA commented on YARN-688: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-864) YARN NM leaking containers with CGroups

[ https://issues.apache.org/jira/browse/YARN-864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690602#comment-13690602 ] Jian He commented on YARN-864: -- Hi Chris Uploaded two patches there one for 2.0.5-alpha and one

[jira] [Created] (YARN-871) Failed to run MR example against latest trunk

Zhijie Shen created YARN-871: Summary: Failed to run MR example against latest trunk Key: YARN-871 URL: https://issues.apache.org/jira/browse/YARN-871 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-871) Failed to run MR example against latest trunk

[ https://issues.apache.org/jira/browse/YARN-871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-871: - Attachment: yarn-zshen-resourcemanager-ZShens-MacBook-Pro.local.log Attach the RM log for diagnostic

[jira] [Created] (YARN-872) BlockDecompressorStream#decompress will throw EOFException instead of return -1 when EOF

Zhijie Shen created YARN-872: Summary: BlockDecompressorStream#decompress will throw EOFException instead of return -1 when EOF Key: YARN-872 URL: https://issues.apache.org/jira/browse/YARN-872 Project:

[jira] [Commented] (YARN-736) Add a multi-resource fair sharing metric

[ https://issues.apache.org/jira/browse/YARN-736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690697#comment-13690697 ] Alejandro Abdelnur commented on YARN-736: - looks good, a couple of things though: *

[jira] [Assigned] (YARN-814) Difficult to diagnose a failed container launch when error due to invalid environment variable

[ https://issues.apache.org/jira/browse/YARN-814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-814: Assignee: Jian He Difficult to diagnose a failed container launch when error due to invalid

[jira] [Updated] (YARN-869) ResourceManagerAdministrationProtocol should neither be public(yet) nor in yarn.api

[ https://issues.apache.org/jira/browse/YARN-869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-869: - Attachment: YARN-869-20130621.1.txt Patch fixing this: - Moved

[jira] [Commented] (YARN-864) YARN NM leaking containers with CGroups

[ https://issues.apache.org/jira/browse/YARN-864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690784#comment-13690784 ] Chris Riccomini commented on YARN-864: -- Hey Jian, I'm testing YARN 2.0.5-alpha with

[jira] [Updated] (YARN-870) Node manager is no longer required to store ContainerToken as it is required only during startContainer call.

[ https://issues.apache.org/jira/browse/YARN-870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-870: - Issue Type: Sub-task (was: Bug) Parent: YARN-47 Node manager is no

[jira] [Resolved] (YARN-870) Node manager is no longer required to store ContainerToken as it is required only during startContainer call.

[ https://issues.apache.org/jira/browse/YARN-870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi resolved YARN-870. Resolution: Duplicate Fixing this will also fix YARN-62. attaching patch there as it is

[jira] [Updated] (YARN-873) YARNClient.getApplicationReport(unknownAppId) returns an empty application report

[ https://issues.apache.org/jira/browse/YARN-873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-873: Affects Version/s: 2.1.0-beta YARNClient.getApplicationReport(unknownAppId) returns an empty

[jira] [Commented] (YARN-62) AM should not be able to abuse container tokens for repetitive container launches

[ https://issues.apache.org/jira/browse/YARN-62?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690805#comment-13690805 ] Omkar Vinit Joshi commented on YARN-62: --- Right now on NM we start container only when

[jira] [Commented] (YARN-62) AM should not be able to abuse container tokens for repetitive container launches

[ https://issues.apache.org/jira/browse/YARN-62?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690799#comment-13690799 ] Omkar Vinit Joshi commented on YARN-62: --- Fixing this as a part of YARN-870. attaching

[jira] [Assigned] (YARN-62) AM should not be able to abuse container tokens for repetitive container launches

[ https://issues.apache.org/jira/browse/YARN-62?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi reassigned YARN-62: - Assignee: Omkar Vinit Joshi (was: Vinod Kumar Vavilapalli) AM should not be able to

[jira] [Updated] (YARN-502) RM crash with NPE on NODE_REMOVED event with FairScheduler

[ https://issues.apache.org/jira/browse/YARN-502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-502: - Summary: RM crash with NPE on NODE_REMOVED event with FairScheduler (was: RM

[jira] [Commented] (YARN-869) ResourceManagerAdministrationProtocol should neither be public(yet) nor in yarn.api

[ https://issues.apache.org/jira/browse/YARN-869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690832#comment-13690832 ] Hadoop QA commented on YARN-869: {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-873) YARNClient.getApplicationReport(unknownAppId) returns an empty application report

Bikas Saha created YARN-873: --- Summary: YARNClient.getApplicationReport(unknownAppId) returns an empty application report Key: YARN-873 URL: https://issues.apache.org/jira/browse/YARN-873 Project: Hadoop

[jira] [Updated] (YARN-873) YARNClient.getApplicationReport(unknownAppId) returns a null report

[ https://issues.apache.org/jira/browse/YARN-873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-873: Summary: YARNClient.getApplicationReport(unknownAppId) returns a null report (was:

[jira] [Commented] (YARN-827) Need to make Resource arithmetic methods accessible

[ https://issues.apache.org/jira/browse/YARN-827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690844#comment-13690844 ] Sandy Ryza commented on YARN-827: - In trunk (at least) it looks like the original classes in

[jira] [Commented] (YARN-736) Add a multi-resource fair sharing metric

[ https://issues.apache.org/jira/browse/YARN-736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690859#comment-13690859 ] Sandy Ryza commented on YARN-736: - Uploaded a patch that addresses Alejandro's comments

[jira] [Updated] (YARN-736) Add a multi-resource fair sharing metric

[ https://issues.apache.org/jira/browse/YARN-736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-736: Attachment: YARN-736-4.patch Add a multi-resource fair sharing metric

[jira] [Commented] (YARN-827) Need to make Resource arithmetic methods accessible

[ https://issues.apache.org/jira/browse/YARN-827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690871#comment-13690871 ] Hudson commented on YARN-827: - Integrated in Hadoop-trunk-Commit #4001 (See

[jira] [Resolved] (YARN-827) Need to make Resource arithmetic methods accessible

[ https://issues.apache.org/jira/browse/YARN-827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-827. - Resolution: Fixed Need to make Resource arithmetic methods accessible

[jira] [Commented] (YARN-736) Add a multi-resource fair sharing metric

[ https://issues.apache.org/jira/browse/YARN-736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690887#comment-13690887 ] Hadoop QA commented on YARN-736: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-827) Need to make Resource arithmetic methods accessible

[ https://issues.apache.org/jira/browse/YARN-827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690885#comment-13690885 ] Sandy Ryza commented on YARN-827: - Thanks Bikas! Marking this as resolved again.

[jira] [Created] (YARN-874) Tracking YARN/MR test failures after HADOOP-9421

Vinod Kumar Vavilapalli created YARN-874: Summary: Tracking YARN/MR test failures after HADOOP-9421 Key: YARN-874 URL: https://issues.apache.org/jira/browse/YARN-874 Project: Hadoop YARN

[jira] [Commented] (YARN-736) Add a multi-resource fair sharing metric

[ https://issues.apache.org/jira/browse/YARN-736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690898#comment-13690898 ] Sandy Ryza commented on YARN-736: - The test failure appears unrelated. I get also get it

[jira] [Updated] (YARN-62) AM should not be able to abuse container tokens for repetitive container launches

[ https://issues.apache.org/jira/browse/YARN-62?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-62: -- Attachment: YARN-62-20130621.patch AM should not be able to abuse container tokens

[jira] [Commented] (YARN-874) Tracking YARN/MR test failures after HADOOP-9421

[ https://issues.apache.org/jira/browse/YARN-874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690904#comment-13690904 ] Zhijie Shen commented on YARN-874: -- Ran MR example on latest trunk, and saw. Not sure it is

[jira] [Commented] (YARN-827) Need to make Resource arithmetic methods accessible

[ https://issues.apache.org/jira/browse/YARN-827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690926#comment-13690926 ] Bikas Saha commented on YARN-827: - Thanks! Need to make Resource

[jira] [Commented] (YARN-864) YARN NM leaking containers with CGroups

[ https://issues.apache.org/jira/browse/YARN-864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690935#comment-13690935 ] Omkar Vinit Joshi commented on YARN-864: Also it would be very useful if you can

[jira] [Commented] (YARN-62) AM should not be able to abuse container tokens for repetitive container launches

the latest attachment http://issues.apache.org/jira/secure/attachment/12589198/YARN-62-20130621.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 1 new

[jira] [Commented] (YARN-814) Difficult to diagnose a failed container launch when error due to invalid environment variable

[ https://issues.apache.org/jira/browse/YARN-814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13690966#comment-13690966 ] Jian He commented on YARN-814: -- After investigation shExec.getOutput() is returning empty

[jira] [Updated] (YARN-62) AM should not be able to abuse container tokens for repetitive container launches

: 0.23.3, 2.0.0-alpha Reporter: Vinod Kumar Vavilapalli Assignee: Omkar Vinit Joshi Attachments: YARN-62-20130621.1.patch, YARN-62-20130621.patch Clone of YARN-51. ApplicationMaster should not be able to store container tokens and use the same set of tokens

[jira] [Updated] (YARN-814) Difficult to diagnose a failed container launch when error due to invalid environment variable

[ https://issues.apache.org/jira/browse/YARN-814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-814: - Attachment: YARN-814.patch upload a patch Difficult to diagnose a failed container launch when

[jira] [Updated] (YARN-701) ApplicationTokens should be used irrespective of kerberos

[ https://issues.apache.org/jira/browse/YARN-701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-701: --- Priority: Blocker (was: Major) ApplicationTokens should be used irrespective of kerberos

[jira] [Updated] (YARN-701) ApplicationTokens should be used irrespective of kerberos

[ https://issues.apache.org/jira/browse/YARN-701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-701: --- Affects Version/s: 2.1.0-beta ApplicationTokens should be used irrespective of kerberos

[jira] [Updated] (YARN-874) Tracking YARN/MR test failures after HADOOP-9421

[ https://issues.apache.org/jira/browse/YARN-874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-874: - Attachment: YARN-874.txt Here's a patch with common changes from [~daryn].

[jira] [Commented] (YARN-874) Tracking YARN/MR test failures after HADOOP-9421

[ https://issues.apache.org/jira/browse/YARN-874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13691020#comment-13691020 ] Hadoop QA commented on YARN-874: {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-874) Tracking YARN/MR test failures after HADOOP-9421

[ https://issues.apache.org/jira/browse/YARN-874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-874: - Attachment: YARN-874.1.txt Addressing one more test issue that is independently

[jira] [Updated] (YARN-874) Tracking YARN/MR test failures after HADOOP-9421 and YARN-827

[ https://issues.apache.org/jira/browse/YARN-874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-874: - Summary: Tracking YARN/MR test failures after HADOOP-9421 and YARN-827 (was: