[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068248#comment-14068248 ] Wangda Tan commented on YARN-796: - Allen, I think what we was just talking about is how to

[jira] [Updated] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-21 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2247: Attachment: apache-yarn-2247.3.patch {quote} bq.The current implementation uses the standard

[jira] [Commented] (YARN-2325) need check whether node is null in nodeUpdate for FairScheduler

2014-07-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068258#comment-14068258 ] Tsuyoshi OZAWA commented on YARN-2325: -- Hi [~zxu], could you explain the case when

[jira] [Commented] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068289#comment-14068289 ] Hadoop QA commented on YARN-2247: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2325) need check whether node is null in nodeUpdate for FairScheduler

2014-07-21 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068319#comment-14068319 ] zhihai xu commented on YARN-2325: - Hi Tsuyoshi OZAWA, thanks for your quick response to my

[jira] [Updated] (YARN-2325) need check whether node is null in nodeUpdate for FairScheduler

2014-07-21 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2325: Priority: Minor (was: Major) need check whether node is null in nodeUpdate for FairScheduler

[jira] [Commented] (YARN-2301) Improve yarn container command

2014-07-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068332#comment-14068332 ] Naganarasimha G R commented on YARN-2301: - Hi [~jianhe] and [~zjshen]

[jira] [Updated] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2033: -- Attachment: YARN-2033_ALL.3.patch Investigate merging generic-history into the Timeline Store

[jira] [Updated] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2033: -- Attachment: YARN-2033.3.patch Rebase against the latest trunk Investigate merging generic-history

[jira] [Assigned] (YARN-2262) Few fields displaying wrong values in Timeline server after RM restart

2014-07-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-2262: --- Assignee: Naganarasimha G R Few fields displaying wrong values in Timeline server

[jira] [Commented] (YARN-2013) The diagnostics is always the ExitCodeException stack when the container crashes

2014-07-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068363#comment-14068363 ] Junping Du commented on YARN-2013: -- Agree that the test failure is not related as it

[jira] [Commented] (YARN-2323) FairShareComparator creates too many Resource objects

2014-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068389#comment-14068389 ] Hudson commented on YARN-2323: -- FAILURE: Integrated in Hadoop-Yarn-trunk #619 (See

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068397#comment-14068397 ] Hadoop QA commented on YARN-2033: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1954) Add waitFor to AMRMClient(Async)

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068411#comment-14068411 ] Zhijie Shen commented on YARN-1954: --- [~ozawa], I'm generally fine with the patch. Just

[jira] [Commented] (YARN-2304) TestRMWebServices* fails intermittently

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068431#comment-14068431 ] Zhijie Shen commented on YARN-2304: --- [~ozawa] and [~kj-ki], the test failures seem to go

[jira] [Updated] (YARN-2313) Livelock can occur on FairScheduler when there are lots entry in queue

2014-07-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2313: - Attachment: YARN-2313.4.patch Thanks for the review, [~sandyr]. Updated a patch: * Moved new

[jira] [Commented] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068444#comment-14068444 ] Zhijie Shen commented on YARN-2319: --- [~gujilangzi], it seems that setupKDC is not need to

[jira] [Commented] (YARN-1342) Recover container tokens upon nodemanager restart

2014-07-21 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068449#comment-14068449 ] Devaraj K commented on YARN-1342: - Thanks for updating the patch. Good work [~jlowe]. Here

[jira] [Commented] (YARN-2304) TestRMWebServices* fails intermittently

2014-07-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068457#comment-14068457 ] Tsuyoshi OZAWA commented on YARN-2304: -- Hi Zhijie, thank you for the comment. {quote}

[jira] [Created] (YARN-2326) WritingYarnApplications.html includes deprecated information

2014-07-21 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created YARN-2326: Summary: WritingYarnApplications.html includes deprecated information Key: YARN-2326 URL: https://issues.apache.org/jira/browse/YARN-2326 Project: Hadoop YARN

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068474#comment-14068474 ] Karthik Kambatla commented on YARN-2273: Yep. Thanks for pointing it out, Tsuyoshi.

[jira] [Commented] (YARN-2313) Livelock can occur on FairScheduler when there are lots entry in queue

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068478#comment-14068478 ] Hadoop QA commented on YARN-2313: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068500#comment-14068500 ] Karthik Kambatla commented on YARN-2273: +1. Checking this in. NPE in

[jira] [Commented] (YARN-2323) FairShareComparator creates too many Resource objects

2014-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068506#comment-14068506 ] Hudson commented on YARN-2323: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1838 (See

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068508#comment-14068508 ] Karthik Kambatla commented on YARN-2273: Actually, let me retract that +1

[jira] [Commented] (YARN-2323) FairShareComparator creates too many Resource objects

2014-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068537#comment-14068537 ] Hudson commented on YARN-2323: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1811 (See

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-07-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068545#comment-14068545 ] Jason Lowe commented on YARN-1198: -- We need to worry about headroom as a report of

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068546#comment-14068546 ] Zhijie Shen commented on YARN-2033: --- The test failures are not related. See YARN-2304.

[jira] [Commented] (YARN-2045) Data persisted in NM should be versioned

2014-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068587#comment-14068587 ] Hudson commented on YARN-2045: -- FAILURE: Integrated in Hadoop-trunk-Commit #5922 (See

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-07-21 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068594#comment-14068594 ] Chen He commented on YARN-1198: --- {quote} With preemption, resource beyond guaranteed resource

[jira] [Updated] (YARN-2262) Few fields displaying wrong values in Timeline server after RM restart

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2262: -- Issue Type: Sub-task (was: Bug) Parent: YARN-1530 Few fields displaying wrong values in

[jira] [Commented] (YARN-2262) Few fields displaying wrong values in Timeline server after RM restart

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068597#comment-14068597 ] Zhijie Shen commented on YARN-2262: --- [~nishan], do you have more details about the issue?

[jira] [Updated] (YARN-2262) Few fields displaying wrong values in Timeline server after RM restart

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2262: -- Issue Type: Sub-task (was: Bug) Parent: YARN-321 Few fields displaying wrong values in

[jira] [Updated] (YARN-2262) Few fields displaying wrong values in Timeline server after RM restart

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2262: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-1530) Few fields displaying wrong

[jira] [Commented] (YARN-2304) TestRMWebServices* fails intermittently

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068607#comment-14068607 ] Zhijie Shen commented on YARN-2304: --- I saw we've opened a number of Test*WebServices*

[jira] [Updated] (YARN-2304) Test*WebServices* fails intermittently

2014-07-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2304: - Summary: Test*WebServices* fails intermittently (was: TestRMWebServices* fails intermittently)

[jira] [Resolved] (YARN-2316) TestNMWebServices* get failed on trunk

2014-07-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA resolved YARN-2316. -- Resolution: Duplicate TestNMWebServices* get failed on trunk

[jira] [Commented] (YARN-2304) Test*WebServices* fails intermittently

2014-07-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068624#comment-14068624 ] Tsuyoshi OZAWA commented on YARN-2304: -- OK, let's deal with the problem on this JIRA.

[jira] [Commented] (YARN-2316) TestNMWebServices* get failed on trunk

2014-07-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068628#comment-14068628 ] Tsuyoshi OZAWA commented on YARN-2316: -- Close this as dup off YARN-2304, because the

[jira] [Commented] (YARN-2322) Provide Cli to refesh Admin Acls for Timeline server

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068633#comment-14068633 ] Zhijie Shen commented on YARN-2322: --- In fact, we need an admin service for the timeline

[jira] [Updated] (YARN-2322) Provide Cli to refesh Admin Acls for Timeline server

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2322: -- Issue Type: Sub-task (was: Improvement) Parent: YARN-1530 Provide Cli to refesh Admin Acls

[jira] [Updated] (YARN-2304) Test*WebServices* fails intermittently

2014-07-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2304: - Description: TestNMWebService, TestRMWebService, and TestAMWebService get failed with address

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068640#comment-14068640 ] Tsuyoshi OZAWA commented on YARN-2273: -- Sounds reasonable. [~ywskycn], could you

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-21 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068684#comment-14068684 ] Wei Yan commented on YARN-2273: --- [~kasha], [~ozawa], will update a patch soon. NPE in

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-21 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068704#comment-14068704 ] Alejandro Abdelnur commented on YARN-796: - Wandga, previously I've missed the new

[jira] [Commented] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068735#comment-14068735 ] Jian He commented on YARN-2295: --- patch looks good overall, one comment: we can have the

[jira] [Updated] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-21 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2273: -- Attachment: YARN-2273.patch NPE in ContinuousScheduling Thread crippled RM after DN flap

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-07-21 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068791#comment-14068791 ] Craig Welch commented on YARN-1198: --- [~wangda] I concur with [~jlowe] and [~airbots] that

[jira] [Commented] (YARN-2301) Improve yarn container command

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068810#comment-14068810 ] Zhijie Shen commented on YARN-2301: --- bq. Issue1 : As i understand this option should be

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068834#comment-14068834 ] Karthik Kambatla commented on YARN-2273: Thanks Wei. Few comments on the latest

[jira] [Commented] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068872#comment-14068872 ] Jian He commented on YARN-2211: --- - AMRMTokenSecretManagerState class is not needed. we may

[jira] [Commented] (YARN-1372) Ensure all completed containers are reported to the AMs across RM restart

2014-07-21 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068879#comment-14068879 ] Anubhav Dhoot commented on YARN-1372: - Yes. Working on this now. Ensure all completed

[jira] [Updated] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-21 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2273: -- Attachment: YARN-2273.patch Thanks, [~kasha], update a new patch to address the comments. NPE in

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068910#comment-14068910 ] Hadoop QA commented on YARN-2273: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-07-21 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068947#comment-14068947 ] Craig Welch commented on YARN-1198: --- Also - this combined with preemption will be

[jira] [Updated] (YARN-2327) YARN should warn about nodes with poor clock synchronization

2014-07-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated YARN-2327: --- Summary: YARN should warn about nodes with poor clock synchronization (was: A hadoop

[jira] [Moved] (YARN-2327) A hadoop cluster needs clock synchronization

2014-07-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe moved HADOOP-10794 to YARN-2327: - Key: YARN-2327 (was: HADOOP-10794) Project:

[jira] [Updated] (YARN-2327) YARN should warn about nodes with poor clock synchronization

2014-07-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated YARN-2327: --- Description: YARN should warn about nodes with poor clock synchronization. YARN

[jira] [Updated] (YARN-2327) YARN should warn about nodes with poor clock synchronization

2014-07-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated YARN-2327: --- Description: YARN should warn about nodes with poor clock synchronization. YARN

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069040#comment-14069040 ] Hadoop QA commented on YARN-2273: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069077#comment-14069077 ] Karthik Kambatla commented on YARN-2273: Still missing a return in this block:

[jira] [Created] (YARN-2328) FairScheduler: Update and Continuous-Scheduling threads should be singletons

2014-07-21 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-2328: -- Summary: FairScheduler: Update and Continuous-Scheduling threads should be singletons Key: YARN-2328 URL: https://issues.apache.org/jira/browse/YARN-2328

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069085#comment-14069085 ] Karthik Kambatla commented on YARN-2273: Filed YARN-2328 for the latter comment.

[jira] [Commented] (YARN-2131) Add a way to format the RMStateStore

2014-07-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069092#comment-14069092 ] Karthik Kambatla commented on YARN-2131: +1 to the addendum. I ll commit this

[jira] [Commented] (YARN-671) Add an interface on the RM to move NMs into a maintenance state

2014-07-21 Thread Jian Fang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069124#comment-14069124 ] Jian Fang commented on YARN-671: YARN-796 is adding label support for NMs, could label based

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-21 Thread Jian Fang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069175#comment-14069175 ] Jian Fang commented on YARN-796: * RM has list of valid labels. (hot reloadable) This

[jira] [Updated] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2211: Attachment: YARN-2211.6.patch RMStateStore needs to save AMRMToken master key for recovery when RM

[jira] [Updated] (YARN-2321) NodeManager web UI can incorrectly report Pmem enforcement

2014-07-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-2321: - Summary: NodeManager web UI can incorrectly report Pmem enforcement (was: NodeManager WebUI get wrong

[jira] [Moved] (YARN-2329) Machine List generated by machines.jsp should be sorted

2014-07-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved MAPREDUCE-498 to YARN-2329: -- Key: YARN-2329 (was: MAPREDUCE-498) Project: Hadoop

[jira] [Commented] (YARN-2321) NodeManager web UI can incorrectly report Pmem enforcement

2014-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069426#comment-14069426 ] Hudson commented on YARN-2321: -- FAILURE: Integrated in Hadoop-trunk-Commit #5927 (See

[jira] [Commented] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069453#comment-14069453 ] Hadoop QA commented on YARN-2211: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1726) ResourceSchedulerWrapper failed due to the AbstractYarnScheduler introduced in YARN-1041

2014-07-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1726: --- Priority: Blocker (was: Minor) Target Version/s: 2.5.0 Affects Version/s:

[jira] [Commented] (YARN-1726) ResourceSchedulerWrapper failed due to the AbstractYarnScheduler introduced in YARN-1041

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069522#comment-14069522 ] Hadoop QA commented on YARN-1726: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2211: Attachment: YARN-2211.6.1.patch fix the testcase failures RMStateStore needs to save AMRMToken master key

[jira] [Updated] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-21 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Attachment: YARN-2295-072114.patch Thanks [~jianhe]! I've addressed the problem in the latest patch. If you've got

[jira] [Commented] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069588#comment-14069588 ] Hadoop QA commented on YARN-2295: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2316) TestNMWebServices* get failed on trunk

2014-07-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069593#comment-14069593 ] Junping Du commented on YARN-2316: -- +1 on resolving it as duplicated. It looks like these

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069615#comment-14069615 ] Wangda Tan commented on YARN-796: - Hi Tucu, Thanks for providing thoughts about how to stage

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069619#comment-14069619 ] Wangda Tan commented on YARN-796: - Jian Fang, I think it's make sense to make RM has a

[jira] [Commented] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069644#comment-14069644 ] Hadoop QA commented on YARN-2211: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-07-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069651#comment-14069651 ] Wangda Tan commented on YARN-1198: -- I agree with [~jlowe], [~airbots] and [~cwelch], used

[jira] [Commented] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069662#comment-14069662 ] Xuan Gong commented on YARN-2211: - testcase failures are un-related. All the testcases can

[jira] [Commented] (YARN-2321) NodeManager web UI can incorrectly report Pmem enforcement

2014-07-21 Thread Leitao Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069661#comment-14069661 ] Leitao Guo commented on YARN-2321: -- Thanks Jason Lowe! NodeManager web UI can

[jira] [Resolved] (YARN-2131) Add a way to format the RMStateStore

2014-07-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-2131. Resolution: Fixed Thanks Robert. Committed addendum to trunk and branch-2. Add a way to

[jira] [Commented] (YARN-2131) Add a way to format the RMStateStore

2014-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069673#comment-14069673 ] Hudson commented on YARN-2131: -- FAILURE: Integrated in Hadoop-trunk-Commit #5930 (See

[jira] [Updated] (YARN-1726) ResourceSchedulerWrapper failed due to the AbstractYarnScheduler introduced in YARN-1041

2014-07-21 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1726: -- Attachment: YARN-1726-5.patch Rebase the patch. ResourceSchedulerWrapper failed due to the

[jira] [Commented] (YARN-2013) The diagnostics is always the ExitCodeException stack when the container crashes

2014-07-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069765#comment-14069765 ] Tsuyoshi OZAWA commented on YARN-2013: -- Thanks for your review, [~djp]! The

[jira] [Commented] (YARN-2013) The diagnostics is always the ExitCodeException stack when the container crashes

2014-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069768#comment-14069768 ] Hudson commented on YARN-2013: -- FAILURE: Integrated in Hadoop-trunk-Commit #5931 (See

[jira] [Updated] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-21 Thread Wenwu Peng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenwu Peng updated YARN-2319: - Attachment: YARN-2319.1.patch Thanks [~zjshen] great comments. the new patch address [~zjshen] 's comment

[jira] [Commented] (YARN-1726) ResourceSchedulerWrapper failed due to the AbstractYarnScheduler introduced in YARN-1041

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069782#comment-14069782 ] Hadoop QA commented on YARN-1726: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2242) Improve exception information on AM launch crashes

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069783#comment-14069783 ] Hadoop QA commented on YARN-2242: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2270) TestFSDownload#testDownloadPublicWithStatCache fails in trunk

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069814#comment-14069814 ] Zhijie Shen commented on YARN-2270: --- +1, LGTM as well. The test failure was gone locally

[jira] [Created] (YARN-2330) Jobs are not displaying in timeline server after RM restart

2014-07-21 Thread Nishan Shetty (JIRA)
Nishan Shetty created YARN-2330: --- Summary: Jobs are not displaying in timeline server after RM restart Key: YARN-2330 URL: https://issues.apache.org/jira/browse/YARN-2330 Project: Hadoop YARN

[jira] [Commented] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069823#comment-14069823 ] Hadoop QA commented on YARN-2319: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2270) TestFSDownload#testDownloadPublicWithStatCache fails in trunk

2014-07-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069831#comment-14069831 ] Hudson commented on YARN-2270: -- FAILURE: Integrated in Hadoop-trunk-Commit #5932 (See

[jira] [Commented] (YARN-2270) TestFSDownload#testDownloadPublicWithStatCache fails in trunk

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069832#comment-14069832 ] Zhijie Shen commented on YARN-2270: --- Committed to trunk, branch-2, and branch-2.5. Thanks

[jira] [Commented] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069858#comment-14069858 ] Hadoop QA commented on YARN-2319: - {color:green}+1 overall{color}. Here are the results of