[jira] [Created] (YARN-2793) YARN service containers to support different memory limit policies

2014-11-01 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-2793: Summary: YARN service containers to support different memory limit policies Key: YARN-2793 URL: https://issues.apache.org/jira/browse/YARN-2793 Project: Hadoop YARN

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193099#comment-14193099 ] Hudson commented on YARN-1492: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #730 (See

[jira] [Commented] (YARN-2707) Potential null dereference in FSDownload

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193106#comment-14193106 ] Hudson commented on YARN-2707: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #730 (See

[jira] [Commented] (YARN-2701) Potential race condition in startLocalizer when using LinuxContainerExecutor

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193110#comment-14193110 ] Hudson commented on YARN-2701: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #730 (See

[jira] [Commented] (YARN-2770) Timeline delegation tokens need to be automatically renewed by the RM

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193108#comment-14193108 ] Hudson commented on YARN-2770: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #730 (See

[jira] [Commented] (YARN-2698) Move getClusterNodeLabels and getNodeToLabels to YarnClient instead of AdminService

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193113#comment-14193113 ] Hudson commented on YARN-2698: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #730 (See

[jira] [Commented] (YARN-2711) TestDefaultContainerExecutor#testContainerLaunchError fails on Windows

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193109#comment-14193109 ] Hudson commented on YARN-2711: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #730 (See

[jira] [Commented] (YARN-2789) Re-instate the NodeReport.newInstance API modified in YARN-2698

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193111#comment-14193111 ] Hudson commented on YARN-2789: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #730 (See

[jira] [Commented] (YARN-2186) Node Manager uploader service for cache manager

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193107#comment-14193107 ] Hudson commented on YARN-2186: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #730 (See

[jira] [Commented] (YARN-2778) YARN node CLI should display labels on returned node reports

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193112#comment-14193112 ] Hudson commented on YARN-2778: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #730 (See

[jira] [Commented] (YARN-2792) Have a public Test-only API for creating important records that ecosystem projects can depend on

2014-11-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193126#comment-14193126 ] Steve Loughran commented on YARN-2792: -- +1 for this, I've had to do some mock things

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193185#comment-14193185 ] Hudson commented on YARN-1492: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1919 (See

[jira] [Commented] (YARN-2789) Re-instate the NodeReport.newInstance API modified in YARN-2698

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193197#comment-14193197 ] Hudson commented on YARN-2789: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1919 (See

[jira] [Commented] (YARN-2698) Move getClusterNodeLabels and getNodeToLabels to YarnClient instead of AdminService

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193199#comment-14193199 ] Hudson commented on YARN-2698: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1919 (See

[jira] [Commented] (YARN-2711) TestDefaultContainerExecutor#testContainerLaunchError fails on Windows

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193195#comment-14193195 ] Hudson commented on YARN-2711: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1919 (See

[jira] [Commented] (YARN-2186) Node Manager uploader service for cache manager

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193193#comment-14193193 ] Hudson commented on YARN-2186: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1919 (See

[jira] [Commented] (YARN-2770) Timeline delegation tokens need to be automatically renewed by the RM

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193194#comment-14193194 ] Hudson commented on YARN-2770: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1919 (See

[jira] [Commented] (YARN-2701) Potential race condition in startLocalizer when using LinuxContainerExecutor

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193196#comment-14193196 ] Hudson commented on YARN-2701: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1919 (See

[jira] [Commented] (YARN-2707) Potential null dereference in FSDownload

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193192#comment-14193192 ] Hudson commented on YARN-2707: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1919 (See

[jira] [Commented] (YARN-2778) YARN node CLI should display labels on returned node reports

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193198#comment-14193198 ] Hudson commented on YARN-2778: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1919 (See

[jira] [Commented] (YARN-2789) Re-instate the NodeReport.newInstance API modified in YARN-2698

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193229#comment-14193229 ] Hudson commented on YARN-2789: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1944 (See

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193217#comment-14193217 ] Hudson commented on YARN-1492: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1944 (See

[jira] [Commented] (YARN-2711) TestDefaultContainerExecutor#testContainerLaunchError fails on Windows

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193227#comment-14193227 ] Hudson commented on YARN-2711: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1944 (See

[jira] [Commented] (YARN-2698) Move getClusterNodeLabels and getNodeToLabels to YarnClient instead of AdminService

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193231#comment-14193231 ] Hudson commented on YARN-2698: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1944 (See

[jira] [Commented] (YARN-2186) Node Manager uploader service for cache manager

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193225#comment-14193225 ] Hudson commented on YARN-2186: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1944 (See

[jira] [Commented] (YARN-2778) YARN node CLI should display labels on returned node reports

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193230#comment-14193230 ] Hudson commented on YARN-2778: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1944 (See

[jira] [Commented] (YARN-2770) Timeline delegation tokens need to be automatically renewed by the RM

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193226#comment-14193226 ] Hudson commented on YARN-2770: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1944 (See

[jira] [Commented] (YARN-2701) Potential race condition in startLocalizer when using LinuxContainerExecutor

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193228#comment-14193228 ] Hudson commented on YARN-2701: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1944 (See

[jira] [Commented] (YARN-2707) Potential null dereference in FSDownload

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193224#comment-14193224 ] Hudson commented on YARN-2707: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1944 (See

[jira] [Resolved] (YARN-2791) Add Disk as a resource for scheduling

2014-11-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-2791. Resolution: Duplicate Add Disk as a resource for scheduling

[jira] [Updated] (YARN-2010) If RM fails to recover an app, it can never transition to active again

2014-11-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2010: --- Attachment: yarn-2010-8.patch If RM fails to recover an app, it can never transition to

[jira] [Updated] (YARN-2694) Ensure only single node labels specified in resource request / host, and node label expression only specified when resourceName=ANY

2014-11-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2694: - Attachment: YARN-2694-20141101-1.patch Rebased against latest trunk Ensure only single node labels

[jira] [Commented] (YARN-2010) If RM fails to recover an app, it can never transition to active again

2014-11-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193305#comment-14193305 ] Hadoop QA commented on YARN-2010: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2010) Handle app-recovery failures gracefully

2014-11-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2010: --- Summary: Handle app-recovery failures gracefully (was: If RM fails to recover an app, it can

[jira] [Commented] (YARN-2010) Handle app-recovery failures gracefully

2014-11-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193311#comment-14193311 ] Karthik Kambatla commented on YARN-2010: The latest patch is a step back, closer to

[jira] [Updated] (YARN-1922) Process group remains alive after container process is killed externally

2014-11-01 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-1922: - Attachment: YARN-1922.4.patch Updated patch. We're worried about this causing problems for

[jira] [Commented] (YARN-2261) YARN should have a way to run post-application cleanup

2014-11-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193324#comment-14193324 ] Steve Loughran commented on YARN-2261: -- One problem with this proposal as is that it

[jira] [Commented] (YARN-2788) yarn logs -applicationId on 2.6.0 should support logs written by 2.4.0

2014-11-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193336#comment-14193336 ] Vinod Kumar Vavilapalli commented on YARN-2788: --- Linking the related tickets.

[jira] [Commented] (YARN-1922) Process group remains alive after container process is killed externally

2014-11-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193357#comment-14193357 ] Hadoop QA commented on YARN-1922: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2694) Ensure only single node labels specified in resource request / host, and node label expression only specified when resourceName=ANY

2014-11-01 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12678692/YARN-2694-20141101-1.patch against trunk revision ed63b11. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears

[jira] [Commented] (YARN-1922) Process group remains alive after container process is killed externally

2014-11-01 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193368#comment-14193368 ] Varun Vasudev commented on YARN-1922: - Thanks for the patch Billie. Some comments -

[jira] [Commented] (YARN-1922) Process group remains alive after container process is killed externally

2014-11-01 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193374#comment-14193374 ] Billie Rinaldi commented on YARN-1922: -- You're right, isSetsidAvailable would be

[jira] [Commented] (YARN-1922) Process group remains alive after container process is killed externally

2014-11-01 Thread Sumit Mohanty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193379#comment-14193379 ] Sumit Mohanty commented on YARN-1922: - This is critical for long running processes

[jira] [Commented] (YARN-2790) NM can't aggregate logs past HDFS delegation token expiry.

2014-11-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193384#comment-14193384 ] Vinod Kumar Vavilapalli commented on YARN-2790: --- bq. localization happens

[jira] [Updated] (YARN-1922) Process group remains alive after container process is killed externally

2014-11-01 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-1922: - Attachment: YARN-1922.5.patch Updated patch so the test only runs when setsid is available.

[jira] [Commented] (YARN-2788) yarn logs -applicationId on 2.6.0 should support logs written by 2.4.0

2014-11-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193403#comment-14193403 ] Vinod Kumar Vavilapalli commented on YARN-2788: --- Quick comments on the patch

[jira] [Commented] (YARN-2703) Add logUploadedTime into LogValue for better display

2014-11-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193404#comment-14193404 ] Vinod Kumar Vavilapalli commented on YARN-2703: --- Not for future readers: We

[jira] [Commented] (YARN-2790) NM can't aggregate logs past HDFS delegation token expiry.

2014-11-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193414#comment-14193414 ] Jian He commented on YARN-2790: --- created YARN-2794 for fixing the logs. NM can't aggregate

[jira] [Created] (YARN-2794) Fix log msgs about distributing system credentials

2014-11-01 Thread Jian He (JIRA)
Jian He created YARN-2794: - Summary: Fix log msgs about distributing system credentials Key: YARN-2794 URL: https://issues.apache.org/jira/browse/YARN-2794 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-1922) Process group remains alive after container process is killed externally

2014-11-01 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193420#comment-14193420 ] Varun Vasudev commented on YARN-1922: - +1 for the latest patch pending Jenkins.

[jira] [Updated] (YARN-2783) TestApplicationClientProtocolOnHA fails on trunk intermittently

2014-11-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2783: -- Summary: TestApplicationClientProtocolOnHA fails on trunk intermittently (was:

[jira] [Commented] (YARN-1922) Process group remains alive after container process is killed externally

2014-11-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193442#comment-14193442 ] Hadoop QA commented on YARN-1922: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2010) Handle app-recovery failures gracefully

2014-11-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193443#comment-14193443 ] Jian He commented on YARN-2010: --- bq. The comments elaborate on potential reasons for

[jira] [Created] (YARN-2795) Resource Manager fails startup with HDFS label storage and secure cluster

2014-11-01 Thread Phil D'Amore (JIRA)
Phil D'Amore created YARN-2795: -- Summary: Resource Manager fails startup with HDFS label storage and secure cluster Key: YARN-2795 URL: https://issues.apache.org/jira/browse/YARN-2795 Project: Hadoop

[jira] [Commented] (YARN-2785) TestContainerResourceUsage fails intermittently

2014-11-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193449#comment-14193449 ] Zhijie Shen commented on YARN-2785: --- Why don't we need to prolong timeout for

[jira] [Updated] (YARN-2794) Fix log msgs about distributing system-credentials

2014-11-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2794: -- Summary: Fix log msgs about distributing system-credentials (was: Fix log msgs about distributing system

[jira] [Commented] (YARN-2752) TestContainerExecutor.testRunCommandNoPriority fails in branch-2

2014-11-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193494#comment-14193494 ] Zhijie Shen commented on YARN-2752: --- The fix makes sense. Currently the branch-2 code

[jira] [Created] (YARN-2796) deprecate sbin/*.sh

2014-11-01 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created YARN-2796: -- Summary: deprecate sbin/*.sh Key: YARN-2796 URL: https://issues.apache.org/jira/browse/YARN-2796 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-2795) Resource Manager fails startup with HDFS label storage and secure cluster

2014-11-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193554#comment-14193554 ] Wangda Tan commented on YARN-2795: -- Thanks for [~tweek] reporting this, working on this

[jira] [Commented] (YARN-2794) Fix log msgs about distributing system-credentials

2014-11-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193568#comment-14193568 ] Vinod Kumar Vavilapalli commented on YARN-2794: --- While you are at it, can you

[jira] [Commented] (YARN-2790) NM can't aggregate logs past HDFS delegation token expiry.

2014-11-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193571#comment-14193571 ] Vinod Kumar Vavilapalli commented on YARN-2790: --- Thank you. +1, checking this

[jira] [Updated] (YARN-2790) NM can't aggregate logs past HDFS delegation token expiry.

2014-11-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2790: -- Priority: Critical (was: Major) Target Version/s: 2.6.0 NM can't

[jira] [Commented] (YARN-2790) NM can't aggregate logs past HDFS delegation token expiry.

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193587#comment-14193587 ] Hudson commented on YARN-2790: -- FAILURE: Integrated in Hadoop-trunk-Commit #6422 (See

[jira] [Commented] (YARN-2704) Localization and log-aggregation will fail if hdfs delegation token expired after token-max-life-time

2014-11-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193586#comment-14193586 ] Hudson commented on YARN-2704: -- FAILURE: Integrated in Hadoop-trunk-Commit #6422 (See

[jira] [Updated] (YARN-2788) yarn logs -applicationId on 2.6.0 should support logs written by 2.4.0

2014-11-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2788: Attachment: YARN-2788.3.patch yarn logs -applicationId on 2.6.0 should support logs written by 2.4.0

[jira] [Commented] (YARN-2788) yarn logs -applicationId on 2.6.0 should support logs written by 2.4.0

2014-11-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193616#comment-14193616 ] Xuan Gong commented on YARN-2788: - bq. AggregatedLogFormat.readAcontainerLogs(): There is

[jira] [Assigned] (YARN-2795) Resource Manager fails startup with HDFS label storage and secure cluster

2014-11-01 Thread Wangda Tan (JIRA)
D'Amore Assignee: Wangda Tan Attachments: YARN-2795-20141101-1.patch When node labels are in use, and yarn.node-labels.fs-store.root-dir is set to a hdfs:// path, and the cluster is using kerberos, the RM fails to start while trying to unmarshal the label store

[jira] [Updated] (YARN-2795) Resource Manager fails startup with HDFS label storage and secure cluster

2014-11-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2795: - Attachment: YARN-2795-20141101-1.patch Resource Manager fails startup with HDFS label storage and secure

[jira] [Commented] (YARN-2788) yarn logs -applicationId on 2.6.0 should support logs written by 2.4.0

2014-11-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193636#comment-14193636 ] Hadoop QA commented on YARN-2788: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2014-11-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2786: - Description: With YARN-2778, we can list node labels on existing RM nodes. But it is not enough, we

[jira] [Updated] (YARN-2795) Resource Manager fails startup with HDFS label storage and secure cluster

2014-11-01 Thread Wangda Tan (JIRA)
: Phil D'Amore Assignee: Wangda Tan Attachments: YARN-2795-20141101-1.patch When node labels are in use, and yarn.node-labels.fs-store.root-dir is set to a hdfs:// path, and the cluster is using kerberos, the RM fails to start while trying to unmarshal the label store

[jira] [Updated] (YARN-2795) Resource Manager fails startup with HDFS label storage and secure cluster

2014-11-01 Thread Wangda Tan (JIRA)
D'Amore Assignee: Wangda Tan Attachments: YARN-2795-20141101-1.patch When node labels are in use, and yarn.node-labels.fs-store.root-dir is set to a hdfs:// path, and the cluster is using kerberos, the RM fails to start while trying to unmarshal the label store

[jira] [Commented] (YARN-2788) yarn logs -applicationId on 2.6.0 should support logs written by 2.4.0

2014-11-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193650#comment-14193650 ] Xuan Gong commented on YARN-2788: - Testcase failures are not related. They are tracked in

[jira] [Commented] (YARN-2795) Resource Manager fails startup with HDFS label storage and secure cluster

2014-11-01 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12678746/YARN-2795-20141101-1.patch against trunk revision 5c0381c. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't

[jira] [Updated] (YARN-2010) Handle app-recovery failures gracefully

2014-11-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2010: --- Attachment: yarn-2010-9.patch Handle app-recovery failures gracefully

[jira] [Commented] (YARN-2010) Handle app-recovery failures gracefully

2014-11-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193678#comment-14193678 ] Karthik Kambatla commented on YARN-2010: Updated patch doesn't handle

[jira] [Created] (YARN-2797) TestWorkPreservingRMRestart should use ParametrizedSchedulerTestBase

2014-11-01 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-2797: -- Summary: TestWorkPreservingRMRestart should use ParametrizedSchedulerTestBase Key: YARN-2797 URL: https://issues.apache.org/jira/browse/YARN-2797 Project: Hadoop

[jira] [Commented] (YARN-2010) Handle app-recovery failures gracefully

2014-11-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193702#comment-14193702 ] Hadoop QA commented on YARN-2010: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1922) Process group remains alive after container process is killed externally

2014-11-01 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193721#comment-14193721 ] Gour Saha commented on YARN-1922: - Tested and confirmed that this patch fixes this issue in