[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058461#comment-14058461 ] Hadoop QA commented on YARN-2229: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2229) ContainerId can overflow with RM restart

2014-07-11 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2229: - Attachment: YARN-2229.7.patch Fixed to pass TestWorkPreservingRMRestart. ContainerId can

[jira] [Created] (YARN-2278) YARN RPC should support Protocol Version in client/server

2014-07-11 Thread Junping Du (JIRA)
Junping Du created YARN-2278: Summary: YARN RPC should support Protocol Version in client/server Key: YARN-2278 URL: https://issues.apache.org/jira/browse/YARN-2278 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-2278) YARN RPC should support Protocol Version in client/server

2014-07-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2278: - Attachment: YARN-2278-demo.patch Update a demo patch to show a fix in client side. YARN RPC should

[jira] [Commented] (YARN-2278) YARN RPC should support Protocol Version in client/server

2014-07-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058517#comment-14058517 ] Junping Du commented on YARN-2278: -- However, it seems we don't check version number in RPC

[jira] [Commented] (YARN-2278) YARN RPC should support Protocol Version in client/server

2014-07-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058520#comment-14058520 ] Junping Du commented on YARN-2278: -- {code} version = RPC.getProtocolVersion(protocolPB) +

[jira] [Commented] (YARN-2228) TimelineServer should load pseudo authentication filter when authentication = simple

2014-07-11 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058523#comment-14058523 ] Vinod Kumar Vavilapalli commented on YARN-2228: --- Tx.. Quick replies..

[jira] [Updated] (YARN-2248) Capacity Scheduler changes for moving apps between queues

2014-07-11 Thread Krisztian Horvath (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Horvath updated YARN-2248: Fix Version/s: 2.6.0 Capacity Scheduler changes for moving apps between queues

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058531#comment-14058531 ] Wangda Tan commented on YARN-796: - Hi [~yufeldman] and Swapnil, Thanks for uploading the

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058550#comment-14058550 ] Hadoop QA commented on YARN-2229: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058563#comment-14058563 ] Wangda Tan commented on YARN-1408: -- Hi [~sunilg], It seems your patch cannot apply against

[jira] [Updated] (YARN-2233) Implement web services to create, renew and cancel delegation tokens

2014-07-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2233: Attachment: apache-yarn-2233.3.patch bq.Shouldn't RMWebservices.DELEGATION_TOKEN_HEADER be a

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-07-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058590#comment-14058590 ] Wangda Tan commented on YARN-415: - Hi [~eepayne], Thanks for reply, I've looked at your

[jira] [Assigned] (YARN-2270) TestFSDownload#testDownloadPublicWithStatCache fails in trunk

2014-07-11 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA reassigned YARN-2270: --- Assignee: Akira AJISAKA TestFSDownload#testDownloadPublicWithStatCache fails in trunk

[jira] [Commented] (YARN-2270) TestFSDownload#testDownloadPublicWithStatCache fails in trunk

2014-07-11 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058599#comment-14058599 ] Akira AJISAKA commented on YARN-2270: - I reproduced this issue locally. Using debugger,

[jira] [Commented] (YARN-2233) Implement web services to create, renew and cancel delegation tokens

2014-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058609#comment-14058609 ] Hadoop QA commented on YARN-2233: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2257) Add user to queue mappings to automatically place users' apps into specific queues

2014-07-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058612#comment-14058612 ] Wangda Tan commented on YARN-2257: -- Hi [~Patrick Liu], Thanks for creating this JIRA, I

[jira] [Commented] (YARN-2204) TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058634#comment-14058634 ] Hudson commented on YARN-2204: -- FAILURE: Integrated in Hadoop-Yarn-trunk #610 (See

[jira] [Commented] (YARN-2269) External links need to be removed from YARN UI

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058630#comment-14058630 ] Hudson commented on YARN-2269: -- FAILURE: Integrated in Hadoop-Yarn-trunk #610 (See

[jira] [Commented] (YARN-2181) Add preemption info to RM Web UI and add logs when preemption occurs

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058622#comment-14058622 ] Hudson commented on YARN-2181: -- FAILURE: Integrated in Hadoop-Yarn-trunk #610 (See

[jira] [Commented] (YARN-2224) Explicitly enable vmem check in TestContainersMonitor#testContainerKillOnMemoryOverflow

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058633#comment-14058633 ] Hudson commented on YARN-2224: -- FAILURE: Integrated in Hadoop-Yarn-trunk #610 (See

[jira] [Commented] (YARN-2270) TestFSDownload#testDownloadPublicWithStatCache fails in trunk

2014-07-11 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058639#comment-14058639 ] Akira AJISAKA commented on YARN-2270: - The above comment is wrong. I'm thinking the

[jira] [Commented] (YARN-2261) YARN should have a way to run post-application cleanup

2014-07-11 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058745#comment-14058745 ] Robert Joseph Evans commented on YARN-2261: --- +1 either approach seems fine to me.

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-07-11 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058760#comment-14058760 ] Tsuyoshi OZAWA commented on YARN-2229: -- The javac warning is by annotating getId as

[jira] [Commented] (YARN-2224) Explicitly enable vmem check in TestContainersMonitor#testContainerKillOnMemoryOverflow

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058773#comment-14058773 ] Hudson commented on YARN-2224: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1828 (See

[jira] [Commented] (YARN-2204) TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058774#comment-14058774 ] Hudson commented on YARN-2204: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1828 (See

[jira] [Commented] (YARN-2181) Add preemption info to RM Web UI and add logs when preemption occurs

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058762#comment-14058762 ] Hudson commented on YARN-2181: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1828 (See

[jira] [Commented] (YARN-2088) Fix code bug in GetApplicationsRequestPBImpl#mergeLocalToBuilder

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058772#comment-14058772 ] Hudson commented on YARN-2088: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1828 (See

[jira] [Commented] (YARN-2181) Add preemption info to RM Web UI and add logs when preemption occurs

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058800#comment-14058800 ] Hudson commented on YARN-2181: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1801 (See

[jira] [Commented] (YARN-2224) Explicitly enable vmem check in TestContainersMonitor#testContainerKillOnMemoryOverflow

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058811#comment-14058811 ] Hudson commented on YARN-2224: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1801 (See

[jira] [Commented] (YARN-2269) External links need to be removed from YARN UI

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058808#comment-14058808 ] Hudson commented on YARN-2269: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1801 (See

[jira] [Commented] (YARN-2088) Fix code bug in GetApplicationsRequestPBImpl#mergeLocalToBuilder

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058810#comment-14058810 ] Hudson commented on YARN-2088: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1801 (See

[jira] [Commented] (YARN-2204) TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler

2014-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058812#comment-14058812 ] Hudson commented on YARN-2204: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1801 (See

[jira] [Commented] (YARN-2270) TestFSDownload#testDownloadPublicWithStatCache fails in trunk

2014-07-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058831#comment-14058831 ] Sangjin Lee commented on YARN-2270: --- YARN-1914 might be instructive.

[jira] [Updated] (YARN-1662) Capacity Scheduler reservation issue cause Job Hang

2014-07-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-1662: -- Attachment: Yarn-1.2.patch Capacity Scheduler reservation issue cause Job Hang

[jira] [Updated] (YARN-1662) Capacity Scheduler reservation issue cause Job Hang

2014-07-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-1662: -- Attachment: Yarn-1.1.patch Capacity Scheduler reservation issue cause Job Hang

[jira] [Commented] (YARN-2045) Data persisted in NM should be versioned

2014-07-11 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058832#comment-14058832 ] Varun Vasudev commented on YARN-2045: - [~djp] Mostly looks good. Couple of things

[jira] [Updated] (YARN-2228) TimelineServer should load pseudo authentication filter when authentication = simple

2014-07-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2228: -- Attachment: YARN-2228.5.patch TimelineServer should load pseudo authentication filter when

[jira] [Commented] (YARN-2228) TimelineServer should load pseudo authentication filter when authentication = simple

2014-07-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058866#comment-14058866 ] Zhijie Shen commented on YARN-2228: --- bq. Anonymous access makes sense for web UIs and

[jira] [Created] (YARN-2279) Add UTs to cover timeline server authentication

2014-07-11 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2279: - Summary: Add UTs to cover timeline server authentication Key: YARN-2279 URL: https://issues.apache.org/jira/browse/YARN-2279 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-2013) The diagnostics is always the ExitCodeException stack when the container crashes

2014-07-11 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2013: - Attachment: YARN-2013.4.patch Added tests and fixed to pass them. The diagnostics is always the

[jira] [Created] (YARN-2280) Resource manager web service fields are not accessible

2014-07-11 Thread Krisztian Horvath (JIRA)
Krisztian Horvath created YARN-2280: --- Summary: Resource manager web service fields are not accessible Key: YARN-2280 URL: https://issues.apache.org/jira/browse/YARN-2280 Project: Hadoop YARN

[jira] [Commented] (YARN-2277) Add JSONP support to the ATS REST API

2014-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058903#comment-14058903 ] Hadoop QA commented on YARN-2277: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2280) Resource manager web service fields are not accessible

2014-07-11 Thread Krisztian Horvath (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Horvath updated YARN-2280: Attachment: YARN-2280.patch Resource manager web service fields are not accessible

[jira] [Updated] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-1408: -- Attachment: Yarn-1408.9.patch 1. bq.Now request can only be null or non-empty, right? Yes [~leftnoteasy]. It

[jira] [Commented] (YARN-2228) TimelineServer should load pseudo authentication filter when authentication = simple

2014-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058921#comment-14058921 ] Hadoop QA commented on YARN-2228: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2013) The diagnostics is always the ExitCodeException stack when the container crashes

2014-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058923#comment-14058923 ] Hadoop QA commented on YARN-2013: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2013) The diagnostics is always the ExitCodeException stack when the container crashes

2014-07-11 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058927#comment-14058927 ] Tsuyoshi OZAWA commented on YARN-2013: -- [~djp], the patch is ready for review. Could

[jira] [Updated] (YARN-2277) Add JSONP support to the ATS REST API

2014-07-11 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-2277: -- Attachment: YARN-2277-CORS.patch Add JSONP support to the ATS REST API

[jira] [Updated] (YARN-2277) Add Cross-Origin support to the ATS REST API

2014-07-11 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-2277: -- Attachment: (was: YARN-2277-CORS.patch) Add Cross-Origin support to the ATS REST API

[jira] [Updated] (YARN-2277) Add Cross-Origin support to the ATS REST API

2014-07-11 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-2277: -- Attachment: YARN-2277-JSONP.patch Add Cross-Origin support to the ATS REST API

[jira] [Updated] (YARN-2277) Add Cross-Origin support to the ATS REST API

2014-07-11 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-2277: -- Description: As the Application Timeline Server is provided with built-in UI, it may make

[jira] [Updated] (YARN-2277) Add Cross-Origin support to the ATS REST API

2014-07-11 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-2277: -- Attachment: (was: YARN-2277.patch) Add Cross-Origin support to the ATS REST API

[jira] [Updated] (YARN-2277) Add Cross-Origin support to the ATS REST API

2014-07-11 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-2277: -- Attachment: YARN-2277-CORS.patch Add Cross-Origin support to the ATS REST API

[jira] [Commented] (YARN-2045) Data persisted in NM should be versioned

2014-07-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058952#comment-14058952 ] Jason Lowe commented on YARN-2045: -- Thanks for the patch, Junping! Is the schema version

[jira] [Commented] (YARN-2261) YARN should have a way to run post-application cleanup

2014-07-11 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058979#comment-14058979 ] Bikas Saha commented on YARN-2261: -- The cleanup would be indistinguishable from an AM that

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058980#comment-14058980 ] Hadoop QA commented on YARN-1408: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2277) Add Cross-Origin support to the ATS REST API

2014-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058983#comment-14058983 ] Hadoop QA commented on YARN-2277: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-11 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058989#comment-14058989 ] Wei Yan commented on YARN-2273: --- I run a testcase locally. Disable the continuousScheduling,

[jira] [Commented] (YARN-2280) Resource manager web service fields are not accessible

2014-07-11 Thread Krisztian Horvath (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058992#comment-14058992 ] Krisztian Horvath commented on YARN-2280: - Test failures are not relevant to this

[jira] [Commented] (YARN-2275) When log aggregation not enabled, message should point to NM HTTP port, not IPC port

2014-07-11 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058994#comment-14058994 ] Ray Chiang commented on YARN-2275: -- That makes sense. Thanks! When log aggregation not

[jira] [Assigned] (YARN-2275) When log aggregation not enabled, message should point to NM HTTP port, not IPC port

2014-07-11 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang reassigned YARN-2275: Assignee: Ray Chiang (was: Sandy Ryza) When log aggregation not enabled, message should point to

[jira] [Updated] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-11 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2273: -- Attachment: YARN-2273.patch NPE in ContinuousScheduling Thread crippled RM after DN flap

[jira] [Updated] (YARN-2228) TimelineServer should load pseudo authentication filter when authentication = simple

2014-07-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2228: -- Attachment: YARN-2228.6.patch Fix the findbugs, the test failures are not related. TimelineServer

[jira] [Commented] (YARN-2261) YARN should have a way to run post-application cleanup

2014-07-11 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059060#comment-14059060 ] Robert Joseph Evans commented on YARN-2261: --- Yes and that is not necessarily a

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059074#comment-14059074 ] Sandy Ryza commented on YARN-796: - +1 on reducing the complexity of the label predicates.

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-11 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059084#comment-14059084 ] Tsuyoshi OZAWA commented on YARN-2273: -- Hi [~ywskycn], thank you for taking this JIRA.

[jira] [Commented] (YARN-2261) YARN should have a way to run post-application cleanup

2014-07-11 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059094#comment-14059094 ] Bikas Saha commented on YARN-2261: -- Would that be an existing issue that needs to be

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-11 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059096#comment-14059096 ] Wei Yan commented on YARN-2273: --- Thanks, [~ozawa]. IMO, as the nodeIdList makes a copy from

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-11 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059104#comment-14059104 ] Mayank Bansal commented on YARN-1408: - Thanks [~sunilg] for the patch. Patch Looks

[jira] [Commented] (YARN-2228) TimelineServer should load pseudo authentication filter when authentication = simple

2014-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059108#comment-14059108 ] Hadoop QA commented on YARN-2228: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059116#comment-14059116 ] Hadoop QA commented on YARN-2273: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Siqi Li (JIRA)
Siqi Li created YARN-2281: - Summary: In RM webUI, apps are failed with inconsistent state and final state Key: YARN-2281 URL: https://issues.apache.org/jira/browse/YARN-2281 Project: Hadoop YARN

[jira] [Updated] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2281: -- Attachment: 3A0CA0E7-C070-4E18-A07C-E516AB959419.png In RM webUI, apps are failed with inconsistent state and

[jira] [Updated] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2281: -- Affects Version/s: 2.4.0 In RM webUI, apps are failed with inconsistent state and final state

[jira] [Updated] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2281: -- Description: In the attached image, there are jobs failed, but their states are marked as finished. In RM

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-11 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059145#comment-14059145 ] Wei Yan commented on YARN-2273: --- Oh, I saw your point. Yes, move the copy operation to the

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-11 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059134#comment-14059134 ] Tsuyoshi OZAWA commented on YARN-2273: -- Thanks, [~ywskycn]. As you mentioned,

[jira] [Resolved] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-2281. --- Resolution: Invalid In RM webUI, apps are failed with inconsistent state and final state

[jira] [Commented] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059174#comment-14059174 ] Jian He commented on YARN-2281: --- This is expected. There's a difference between application

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-11 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059186#comment-14059186 ] Tsuyoshi OZAWA commented on YARN-2273: -- Make sense. One additional point: should we

[jira] [Commented] (YARN-2277) Add Cross-Origin support to the ATS REST API

2014-07-11 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059205#comment-14059205 ] Jonathan Eagles commented on YARN-2277: --- [~vinodkv] and [~zjshen] do you guys have

[jira] [Updated] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-11 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2273: - Affects Version/s: 2.4.1 NPE in ContinuousScheduling Thread crippled RM after DN flap

[jira] [Updated] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-11 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2273: -- Attachment: YARN-2273.patch NPE in ContinuousScheduling Thread crippled RM after DN flap

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-11 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059252#comment-14059252 ] Wei Yan commented on YARN-2273: --- Thanks, [~ozawa]. Update a new patch. NPE in

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-11 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059260#comment-14059260 ] Yuliya Feldman commented on YARN-796: - [~leftnoteasy] Thank you for your comments. BTW

[jira] [Commented] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059273#comment-14059273 ] Siqi Li commented on YARN-2281: --- [~jianhe] thanks for your explanation. If the state and

[jira] [Commented] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059297#comment-14059297 ] Jian He commented on YARN-2281: --- that's right. In RM webUI, apps are failed with

[jira] [Commented] (YARN-2274) FairScheduler: Add debug information about cluster capacity, availability and reservations

2014-07-11 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059292#comment-14059292 ] Sandy Ryza commented on YARN-2274: -- {code} +if (--updatesToSkipForDebug 0) { +

[jira] [Commented] (YARN-2273) NPE in ContinuousScheduling Thread crippled RM after DN flap

2014-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059307#comment-14059307 ] Hadoop QA commented on YARN-2273: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2131) Add a way to format the RMStateStore

2014-07-11 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059320#comment-14059320 ] Robert Kanter commented on YARN-2131: - Are you sure that the NameNode uses a lock file

[jira] [Commented] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059322#comment-14059322 ] Siqi Li commented on YARN-2281: --- If this is expected, then it doesn't quite make sense.

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-11 Thread amit hadke (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059334#comment-14059334 ] amit hadke commented on YARN-796: - AND is a rare case, probably will never be used. OR is a

[jira] [Commented] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059332#comment-14059332 ] Jian He commented on YARN-2281: --- bq. there are many failed apps with successful

[jira] [Commented] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059339#comment-14059339 ] Siqi Li commented on YARN-2281: --- yes, queue metrics currently will see this as completed

[jira] [Commented] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059409#comment-14059409 ] Jian He commented on YARN-2281: --- Here, queue metrics completed state equals to the FINISHED

[jira] [Commented] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059412#comment-14059412 ] Siqi Li commented on YARN-2281: --- I see, thank you [~jianhe] In RM webUI, apps are failed

[jira] [Commented] (YARN-2242) Improve exception information on AM launch crashes

2014-07-11 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059414#comment-14059414 ] Li Lu commented on YARN-2242: - Hi [~djp], my patch is ready and would you mind to take a look

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-07-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059430#comment-14059430 ] Jian He commented on YARN-2229: --- Thanks for working on this ! some comments: - setId(long

[jira] [Updated] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-11 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2211: Attachment: YARN-2211.3.patch RMStateStore needs to save AMRMToken master key for recovery when RM

  1   2   >