[jira] [Updated] (YARN-2330) Jobs are not displaying in timeline server after RM restart

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2330: -- Issue Type: Sub-task (was: Bug) Parent: YARN-321 Jobs are not displaying in timeline server

[jira] [Commented] (YARN-2330) Jobs are not displaying in timeline server after RM restart

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069943#comment-14069943 ] Zhijie Shen commented on YARN-2330: --- It is very likely that the history file of the given

[jira] [Commented] (YARN-2262) Few fields displaying wrong values in Timeline server after RM restart

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069950#comment-14069950 ] Zhijie Shen commented on YARN-2262: --- How's your setup for RM restarting? does the

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069994#comment-14069994 ] Zhijie Shen commented on YARN-2229: --- Some additional comments: 0. For those that have

[jira] [Commented] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070019#comment-14070019 ] Zhijie Shen commented on YARN-2319: --- Almost good to me, but would you mind fixing the

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-22 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070039#comment-14070039 ] Yuliya Feldman commented on YARN-796: - To everybody that were so involved in providing

[jira] [Updated] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-22 Thread Wenwu Peng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenwu Peng updated YARN-2319: - Attachment: YARN-2319.2.patch Thanks [~zjshen] comments. sorry, My IDE formatter have issues. Fix the

[jira] [Commented] (YARN-2262) Few fields displaying wrong values in Timeline server after RM restart

2014-07-22 Thread Nishan Shetty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070073#comment-14070073 ] Nishan Shetty commented on YARN-2262: - [~zjshen] {quote}How's your setup for RM

[jira] [Commented] (YARN-2262) Few fields displaying wrong values in Timeline server after RM restart

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070080#comment-14070080 ] Zhijie Shen commented on YARN-2262: --- Then, it should be a bug. Would you mind sharing the

[jira] [Commented] (YARN-2330) Jobs are not displaying in timeline server after RM restart

2014-07-22 Thread Nishan Shetty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070081#comment-14070081 ] Nishan Shetty commented on YARN-2330: - Here RM has gone down abrupty Jobs are not

[jira] [Commented] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070090#comment-14070090 ] Zhijie Shen commented on YARN-2319: --- +1. Will commit it once jenkins +1 as well. Fix

[jira] [Commented] (YARN-2301) Improve yarn container command

2014-07-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070095#comment-14070095 ] Naganarasimha G R commented on YARN-2301: - bq. How about having -list only, and

[jira] [Assigned] (YARN-2330) Jobs are not displaying in timeline server after RM restart

2014-07-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-2330: --- Assignee: Naganarasimha G R Jobs are not displaying in timeline server after RM

[jira] [Commented] (YARN-2045) Data persisted in NM should be versioned

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070126#comment-14070126 ] Hudson commented on YARN-2045: -- FAILURE: Integrated in Hadoop-Yarn-trunk #620 (See

[jira] [Commented] (YARN-2321) NodeManager web UI can incorrectly report Pmem enforcement

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070117#comment-14070117 ] Hudson commented on YARN-2321: -- FAILURE: Integrated in Hadoop-Yarn-trunk #620 (See

[jira] [Commented] (YARN-2013) The diagnostics is always the ExitCodeException stack when the container crashes

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070119#comment-14070119 ] Hudson commented on YARN-2013: -- FAILURE: Integrated in Hadoop-Yarn-trunk #620 (See

[jira] [Commented] (YARN-2131) Add a way to format the RMStateStore

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070118#comment-14070118 ] Hudson commented on YARN-2131: -- FAILURE: Integrated in Hadoop-Yarn-trunk #620 (See

[jira] [Commented] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070161#comment-14070161 ] Hadoop QA commented on YARN-2319: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070165#comment-14070165 ] Zhijie Shen commented on YARN-2247: --- [~vvasudev], thanks for your patience on my

[jira] [Updated] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2319: -- Attachment: YARN-2319.2.patch Trigger the jenkins again Fix MiniKdc not close in

[jira] [Commented] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070223#comment-14070223 ] Hadoop QA commented on YARN-2319: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2242) Improve exception information on AM launch crashes

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070239#comment-14070239 ] Hudson commented on YARN-2242: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5934 (See

[jira] [Commented] (YARN-2131) Add a way to format the RMStateStore

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070279#comment-14070279 ] Hudson commented on YARN-2131: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1812 (See

[jira] [Commented] (YARN-2270) TestFSDownload#testDownloadPublicWithStatCache fails in trunk

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070281#comment-14070281 ] Hudson commented on YARN-2270: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1812 (See

[jira] [Commented] (YARN-2321) NodeManager web UI can incorrectly report Pmem enforcement

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070278#comment-14070278 ] Hudson commented on YARN-2321: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1812 (See

[jira] [Created] (YARN-2331) Distinguish shutdown during supervision vs. shutdown for rolling upgrade

2014-07-22 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-2331: Summary: Distinguish shutdown during supervision vs. shutdown for rolling upgrade Key: YARN-2331 URL: https://issues.apache.org/jira/browse/YARN-2331 Project: Hadoop YARN

[jira] [Commented] (YARN-2321) NodeManager web UI can incorrectly report Pmem enforcement

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070350#comment-14070350 ] Hudson commented on YARN-2321: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1839 (See

[jira] [Commented] (YARN-2013) The diagnostics is always the ExitCodeException stack when the container crashes

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070352#comment-14070352 ] Hudson commented on YARN-2013: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1839 (See

[jira] [Commented] (YARN-2270) TestFSDownload#testDownloadPublicWithStatCache fails in trunk

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070353#comment-14070353 ] Hudson commented on YARN-2270: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1839 (See

[jira] [Commented] (YARN-2045) Data persisted in NM should be versioned

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070359#comment-14070359 ] Hudson commented on YARN-2045: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1839 (See

[jira] [Commented] (YARN-2131) Add a way to format the RMStateStore

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070351#comment-14070351 ] Hudson commented on YARN-2131: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1839 (See

[jira] [Commented] (YARN-2331) Distinguish shutdown during supervision vs. shutdown for rolling upgrade

2014-07-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070372#comment-14070372 ] Jason Lowe commented on YARN-2331: -- We can distinguish between supervised/unsupervised via

[jira] [Commented] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070383#comment-14070383 ] Zhijie Shen commented on YARN-2319: --- Committed the patch to trunk, branch-2, and

[jira] [Updated] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2319: -- Target Version/s: 2.5.0 (was: 2.6.0) Affects Version/s: (was: 2.6.0)

[jira] [Commented] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070385#comment-14070385 ] Hudson commented on YARN-2319: -- FAILURE: Integrated in Hadoop-trunk-Commit #5935 (See

[jira] [Reopened] (YARN-2131) Add a way to format the RMStateStore

2014-07-22 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter reopened YARN-2131: - Sorry to have to reopen this again for another addendum patch, but we didn't update the

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-07-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070501#comment-14070501 ] Jian He commented on YARN-2229: --- Copied from protobuf guide, changing int32 to int64 seems to

[jira] [Commented] (YARN-2301) Improve yarn container command

2014-07-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070512#comment-14070512 ] Jian He commented on YARN-2301: --- bq. How about having -list only, and then parsing whether

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070541#comment-14070541 ] Zhijie Shen commented on YARN-2229: --- bq. Copied from protobuf guide, changing int32 to

[jira] [Updated] (YARN-2131) Add a way to format the RMStateStore

2014-07-22 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-2131: Attachment: YARN-2131_addendum2.patch Add a way to format the RMStateStore

[jira] [Commented] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070559#comment-14070559 ] Jian He commented on YARN-2295: --- patch looks good, +1 Refactor YARN distributed shell with

[jira] [Reopened] (YARN-2317) Update documentation about how to write YARN applications

2014-07-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reopened YARN-2317: --- Commented on the wrong jira.. reopen this. Update documentation about how to write YARN applications

[jira] [Commented] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070587#comment-14070587 ] Hudson commented on YARN-2295: -- FAILURE: Integrated in Hadoop-trunk-Commit #5939 (See

[jira] [Commented] (YARN-2131) Add a way to format the RMStateStore

2014-07-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070611#comment-14070611 ] Karthik Kambatla commented on YARN-2131: My bad. Should have caught that in my

[jira] [Resolved] (YARN-2131) Add a way to format the RMStateStore

2014-07-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-2131. Resolution: Fixed Committed addendum-2 to trunk and branch-2. Add a way to format the

[jira] [Commented] (YARN-2301) Improve yarn container command

2014-07-22 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070632#comment-14070632 ] Devaraj K commented on YARN-2301: - Here it is trying allocate this memory for heap size.

[jira] [Commented] (YARN-2131) Add a way to format the RMStateStore

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070638#comment-14070638 ] Hudson commented on YARN-2131: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5940 (See

[jira] [Updated] (YARN-2332) Create REST interface for app submission

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2332: --- Summary: Create REST interface for app submission (was: Create service interface for app

[jira] [Moved] (YARN-2332) Create service interface for app submission

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved MAPREDUCE-454 to YARN-2332: -- Component/s: (was: mrv2) webapp

[jira] [Updated] (YARN-1342) Recover container tokens upon nodemanager restart

2014-07-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-1342: - Attachment: YARN-1342v5.patch Thanks for the review, Devaraj! bq. I think we can get the state from

[jira] [Commented] (YARN-2301) Improve yarn container command

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070730#comment-14070730 ] Zhijie Shen commented on YARN-2301: --- bq. I think there would not be much useful by

[jira] [Created] (YARN-2333) RM UI : show pending containers at cluster level in the application/scheduler page

2014-07-22 Thread Ashwin Shankar (JIRA)
Ashwin Shankar created YARN-2333: Summary: RM UI : show pending containers at cluster level in the application/scheduler page Key: YARN-2333 URL: https://issues.apache.org/jira/browse/YARN-2333

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-07-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070770#comment-14070770 ] Eric Payne commented on YARN-415: - {quote} 5. I think it's better to add a new method in

[jira] [Commented] (YARN-1342) Recover container tokens upon nodemanager restart

2014-07-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070772#comment-14070772 ] Hadoop QA commented on YARN-1342: - {color:red}-1 overall{color}. Here are the results of

[jira] [Moved] (YARN-2334) Document exit codes and their meanings used by linux task controller

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved MAPREDUCE-1318 to YARN-2334: --- Component/s: (was: documentation)

[jira] [Commented] (YARN-2334) Document exit codes and their meanings used by linux task controller

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070801#comment-14070801 ] Allen Wittenauer commented on YARN-2334: Moving this to YARN. The same problem

[jira] [Commented] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

2014-07-22 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070818#comment-14070818 ] Craig Welch commented on YARN-1994: --- FYI, took a look at the changes between patch 3 and

[jira] [Commented] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

2014-07-22 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070838#comment-14070838 ] Craig Welch commented on YARN-1994: --- -re [~arpitagarwal] comments - [~mipoto] made the

[jira] [Updated] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

2014-07-22 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1994: -- Attachment: YARN-1994.6.patch Expose YARN/MR endpoints on multiple interfaces

[jira] [Assigned] (YARN-2008) CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure

2014-07-22 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch reassigned YARN-2008: - Assignee: Craig Welch (was: Chen He) CapacityScheduler may report incorrect queueMaxCap if

[jira] [Commented] (YARN-2008) CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure

2014-07-22 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070859#comment-14070859 ] Craig Welch commented on YARN-2008: --- I believe we've resolved on [YARN-1198] to move

[jira] [Commented] (YARN-1342) Recover container tokens upon nodemanager restart

2014-07-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070861#comment-14070861 ] Jason Lowe commented on YARN-1342: -- The NMWebServices failures are unrelated. They pass

[jira] [Updated] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2273: -- Attachment: YARN-2273-5.patch new patch adds return in the continuous scheduling thread. NPE in

[jira] [Commented] (YARN-2304) Test*WebServices* fails intermittently

2014-07-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070874#comment-14070874 ] Jason Lowe commented on YARN-2304: -- I noticed many (all?) of the failures occurred on the

[jira] [Commented] (YARN-2008) CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure

2014-07-22 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070875#comment-14070875 ] Craig Welch commented on YARN-2008: --- [~airbots], -re {quote} and if the application gets

[jira] [Commented] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

2014-07-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070880#comment-14070880 ] Hadoop QA commented on YARN-1994: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2331) Distinguish shutdown during supervision vs. shutdown for rolling upgrade

2014-07-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070925#comment-14070925 ] Jason Lowe commented on YARN-2331: -- Another possible approach is to have the NM always try

[jira] [Commented] (YARN-2314) ContainerManagementProtocolProxy can create thousands of threads for a large cluster

2014-07-22 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070967#comment-14070967 ] Li Lu commented on YARN-2314: - Hi [~jlowe], I'm interested in looking into the cache overflow

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070965#comment-14070965 ] Hadoop QA commented on YARN-2273: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2314) ContainerManagementProtocolProxy can create thousands of threads for a large cluster

2014-07-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-2314: - Attachment: nmproxycachefix.prototype.patch I was thinking along similar lines, but I am worried about

[jira] [Created] (YARN-2335) Annotate all hadoop-sls APIs as @Private

2014-07-22 Thread Wei Yan (JIRA)
Wei Yan created YARN-2335: - Summary: Annotate all hadoop-sls APIs as @Private Key: YARN-2335 URL: https://issues.apache.org/jira/browse/YARN-2335 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-2314) ContainerManagementProtocolProxy can create thousands of threads for a large cluster

2014-07-22 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071018#comment-14071018 ] Li Lu commented on YARN-2314: - Thanks [~jlowe]! About the corner case, I'm wondering whether a

[jira] [Updated] (YARN-2273) NPE in ContinuousScheduling thread when we lose a node

2014-07-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2273: --- Summary: NPE in ContinuousScheduling thread when we lose a node (was: NPE in

[jira] [Updated] (YARN-2335) Annotate all hadoop-sls APIs as @Private

2014-07-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2335: -- Attachment: YARN-2335-1.patch Annotate all hadoop-sls APIs as @Private

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling thread when we lose a node

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071077#comment-14071077 ] Hudson commented on YARN-2273: -- FAILURE: Integrated in Hadoop-trunk-Commit #5945 (See

[jira] [Commented] (YARN-2313) Livelock can occur on FairScheduler when there are lots entry in queue

2014-07-22 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071118#comment-14071118 ] Tsuyoshi OZAWA commented on YARN-2313: -- The test failure is not related. Livelock

[jira] [Commented] (YARN-2304) Test*WebServices* fails intermittently

2014-07-22 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071217#comment-14071217 ] Tsuyoshi OZAWA commented on YARN-2304: -- [~jlowe], thanks for your survey! After

[jira] [Commented] (YARN-1342) Recover container tokens upon nodemanager restart

2014-07-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071272#comment-14071272 ] Junping Du commented on YARN-1342: -- Thanks [~jlowe] for updating the patch. I'd like to

[jira] [Created] (YARN-2336) Fair scheduler REST api returns a missing '[' bracket JSON for deep queue tree

2014-07-22 Thread Kenji Kikushima (JIRA)
Kenji Kikushima created YARN-2336: - Summary: Fair scheduler REST api returns a missing '[' bracket JSON for deep queue tree Key: YARN-2336 URL: https://issues.apache.org/jira/browse/YARN-2336

[jira] [Updated] (YARN-2336) Fair scheduler REST api returns a missing '[' bracket JSON for deep queue tree

2014-07-22 Thread Kenji Kikushima (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenji Kikushima updated YARN-2336: -- Attachment: YARN-2336.patch Attached a patch. To notice childQueues as a collection to

[jira] [Commented] (YARN-1050) Document the Fair Scheduler REST API

2014-07-22 Thread Kenji Kikushima (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071289#comment-14071289 ] Kenji Kikushima commented on YARN-1050: --- Hi [~ajisakaa], created YARN-2336 for

[jira] [Updated] (YARN-2215) Add preemption info to REST/CLI

2014-07-22 Thread Kenji Kikushima (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenji Kikushima updated YARN-2215: -- Attachment: YARN-2215.patch Hi [~leftnoteasy], I found Resource Preempted from Current Attempt

[jira] [Commented] (YARN-2336) Fair scheduler REST api returns a missing '[' bracket JSON for deep queue tree

2014-07-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071324#comment-14071324 ] Hadoop QA commented on YARN-2336: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2328) FairScheduler: Verify update and continuous scheduling threads are stopped when the scheduler is stopped

2014-07-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071361#comment-14071361 ] Sandy Ryza commented on YARN-2328: -- {code} -if (node != null

[jira] [Updated] (YARN-2313) Livelock can occur in FairScheduler when there are lots of running apps

2014-07-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-2313: - Summary: Livelock can occur in FairScheduler when there are lots of running apps (was: Livelock can

[jira] [Commented] (YARN-2301) Improve yarn container command

2014-07-22 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071395#comment-14071395 ] Devaraj K commented on YARN-2301: - Thanks [~zjshen] for the clarification. +1 for the