[jira] [Commented] (YARN-2270) TestFSDownload#testDownloadPublicWithStatCache fails in trunk

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061777#comment-14061777 ] Hadoop QA commented on YARN-2270: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-1408: -- Attachment: (was: Yarn-1408.11.patch) > Preemption caused Invalid State Event: ACQUIRED at KILLED and caused

[jira] [Updated] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-1408: -- Attachment: Yarn-1408.11.patch Test case failures are in webapp and its due to connection bind exception. I corr

[jira] [Created] (YARN-2287) Add audit log levels for NM and RM

2014-07-15 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-2287: -- Summary: Add audit log levels for NM and RM Key: YARN-2287 URL: https://issues.apache.org/jira/browse/YARN-2287 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2033: -- Attachment: ProposalofStoringYARNMetricsintotheTimelineStore.pdf > Investigate merging generic-history i

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061873#comment-14061873 ] Zhijie Shen commented on YARN-2033: --- Reassign the ticket to myself. > Investigate mergin

[jira] [Assigned] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-2033: - Assignee: Zhijie Shen (was: Vinod Kumar Vavilapalli) > Investigate merging generic-history into t

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061872#comment-14061872 ] Hadoop QA commented on YARN-1408: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2033: -- Attachment: YARN-2033.Prototype.patch Upload the proposal of changes and the demo code. > Investigate m

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061889#comment-14061889 ] Zhijie Shen commented on YARN-2033: --- bq. I would think the timeline store might have to

[jira] [Commented] (YARN-1341) Recover NMTokens upon nodemanager restart

2014-07-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061891#comment-14061891 ] Junping Du commented on YARN-1341: -- Hey [~jlowe], I also agree it is better to discuss the

[jira] [Created] (YARN-2288) Data persistent in timelinestore should be versioned

2014-07-15 Thread Junping Du (JIRA)
Junping Du created YARN-2288: Summary: Data persistent in timelinestore should be versioned Key: YARN-2288 URL: https://issues.apache.org/jira/browse/YARN-2288 Project: Hadoop YARN Issue Type: Su

[jira] [Updated] (YARN-2289) ApplicationHistoryStore should be versioned

2014-07-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2289: - Component/s: applications > ApplicationHistoryStore should be versioned >

[jira] [Created] (YARN-2289) ApplicationHistoryStore should be versioned

2014-07-15 Thread Junping Du (JIRA)
Junping Du created YARN-2289: Summary: ApplicationHistoryStore should be versioned Key: YARN-2289 URL: https://issues.apache.org/jira/browse/YARN-2289 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-2289) ApplicationHistoryStore should be versioned

2014-07-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061905#comment-14061905 ] Junping Du commented on YARN-2289: -- Generic History Server is being refactored to be based

[jira] [Commented] (YARN-2256) Too many nodemanager audit logs are generated

2014-07-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061907#comment-14061907 ] Varun Saxena commented on YARN-2256: Adding of log levels in RM and NM is addressed by

[jira] [Commented] (YARN-2256) Too many nodemanager audit logs are generated

2014-07-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061908#comment-14061908 ] Varun Saxena commented on YARN-2256: Changed NM container logs to debug level so that t

[jira] [Updated] (YARN-2256) Too many nodemanager audit logs are generated

2014-07-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2256: --- Attachment: YARN-2256.patch Please review the patch > Too many nodemanager audit logs are generated >

[jira] [Commented] (YARN-2287) Add audit log levels for NM and RM

2014-07-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061919#comment-14061919 ] Varun Saxena commented on YARN-2287: I will make the following changes : 1. Create new

[jira] [Commented] (YARN-2256) Too many nodemanager audit logs are generated

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061922#comment-14061922 ] Hadoop QA commented on YARN-2256: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2228) TimelineServer should load pseudo authentication filter when authentication = simple

2014-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061930#comment-14061930 ] Hudson commented on YARN-2228: -- FAILURE: Integrated in Hadoop-Yarn-trunk #613 (See [https://b

[jira] [Commented] (YARN-2260) Add containers to launchedContainers list in RMNode on container recovery

2014-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061932#comment-14061932 ] Hudson commented on YARN-2260: -- FAILURE: Integrated in Hadoop-Yarn-trunk #613 (See [https://b

[jira] [Commented] (YARN-1050) Document the Fair Scheduler REST API

2014-07-15 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061959#comment-14061959 ] Akira AJISAKA commented on YARN-1050: - Thanks [~kj-ki] for the update. {code} +

[jira] [Updated] (YARN-2256) Too many nodemanager audit logs are generated

2014-07-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2256: --- Attachment: (was: YARN-2256.patch) > Too many nodemanager audit logs are generated > -

[jira] [Updated] (YARN-2256) Too many nodemanager audit logs are generated

2014-07-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2256: --- Attachment: YARN-2256.patch > Too many nodemanager audit logs are generated >

[jira] [Commented] (YARN-2256) Too many nodemanager audit logs are generated

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062009#comment-14062009 ] Hadoop QA commented on YARN-2256: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2152) Recover missing container information

2014-07-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062060#comment-14062060 ] Jason Lowe commented on YARN-2152: -- Yeah that's what I suspected as well, but I wanted to

[jira] [Commented] (YARN-2260) Add containers to launchedContainers list in RMNode on container recovery

2014-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062075#comment-14062075 ] Hudson commented on YARN-2260: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1805 (See [https://

[jira] [Commented] (YARN-2228) TimelineServer should load pseudo authentication filter when authentication = simple

2014-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062073#comment-14062073 ] Hudson commented on YARN-2228: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1805 (See [https://

[jira] [Commented] (YARN-2256) Too many nodemanager audit logs are generated

2014-07-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062079#comment-14062079 ] Varun Saxena commented on YARN-2256: Only changed log level from INFO to DEBUG. No test

[jira] [Commented] (YARN-2228) TimelineServer should load pseudo authentication filter when authentication = simple

2014-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062171#comment-14062171 ] Hudson commented on YARN-2228: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1832 (See [htt

[jira] [Commented] (YARN-2260) Add containers to launchedContainers list in RMNode on container recovery

2014-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062173#comment-14062173 ] Hudson commented on YARN-2260: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1832 (See [htt

[jira] [Commented] (YARN-2045) Data persisted in NM should be versioned

2014-07-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062212#comment-14062212 ] Jason Lowe commented on YARN-2045: -- bq. I agree the concept is not quite the same but I te

[jira] [Updated] (YARN-2287) Add audit log levels for NM and RM

2014-07-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2287: --- Attachment: YARN-2287.patch Kindly review the patch > Add audit log levels for NM and RM > --

[jira] [Updated] (YARN-2233) Implement web services to create, renew and cancel delegation tokens

2014-07-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2233: Attachment: apache-yarn-2233.4.patch {quote} bq.It seems to me that all API implementations shou

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-07-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062261#comment-14062261 ] Eric Payne commented on YARN-415: - Hi [~leftnoteasy]. Thank you very much for reviewing my

[jira] [Commented] (YARN-2233) Implement web services to create, renew and cancel delegation tokens

2014-07-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062270#comment-14062270 ] Varun Vasudev commented on YARN-2233: - [~tucu00] I'm going to file another ticket to mi

[jira] [Created] (YARN-2290) Add support for passing delegation tokens via headers for web services

2014-07-15 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-2290: --- Summary: Add support for passing delegation tokens via headers for web services Key: YARN-2290 URL: https://issues.apache.org/jira/browse/YARN-2290 Project: Hadoop YARN

[jira] [Created] (YARN-2291) Timeline and RM web services should use same authentication code

2014-07-15 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-2291: --- Summary: Timeline and RM web services should use same authentication code Key: YARN-2291 URL: https://issues.apache.org/jira/browse/YARN-2291 Project: Hadoop YARN

[jira] [Commented] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

2014-07-15 Thread Milan Potocnik (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062281#comment-14062281 ] Milan Potocnik commented on YARN-1994: -- Both TestFSDownload and TestMemoryApplicationH

[jira] [Created] (YARN-2292) RM web services should use hadoop-common for authentication using delegation tokens

2014-07-15 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-2292: --- Summary: RM web services should use hadoop-common for authentication using delegation tokens Key: YARN-2292 URL: https://issues.apache.org/jira/browse/YARN-2292 Project

[jira] [Commented] (YARN-668) TokenIdentifier serialization should consider Unknown fields

2014-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062331#comment-14062331 ] Vinod Kumar Vavilapalli commented on YARN-668: -- One other important point from

[jira] [Commented] (YARN-2152) Recover missing container information

2014-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062332#comment-14062332 ] Vinod Kumar Vavilapalli commented on YARN-2152: --- Yeah, I just realized that Y

[jira] [Updated] (YARN-2233) Implement web services to create, renew and cancel delegation tokens

2014-07-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2233: Attachment: apache-yarn-2233.5.patch Uploaded new patch fixing findbug error. The test case failures

[jira] [Updated] (YARN-2100) Refactor the Timeline Server code for Kerberos + DT authentication

2014-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2100: -- Summary: Refactor the Timeline Server code for Kerberos + DT authentication (wa

[jira] [Commented] (YARN-2292) RM web services should use hadoop-common for authentication using delegation tokens

2014-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062379#comment-14062379 ] Vinod Kumar Vavilapalli commented on YARN-2292: --- YARN-2100 is the related tic

[jira] [Updated] (YARN-2100) Refactor the Timeline Server code for Kerberos + DT authentication

2014-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2100: -- Target Version/s: 2.6.0 > Refactor the Timeline Server code for Kerberos + DT au

[jira] [Updated] (YARN-2292) RM web services should use hadoop-common for authentication using delegation tokens

2014-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2292: -- Target Version/s: 2.6.0 > RM web services should use hadoop-common for authentic

[jira] [Commented] (YARN-2284) Find missing config options in YarnConfiguration and yarn-default.xml

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062382#comment-14062382 ] Hadoop QA commented on YARN-2284: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2233) Implement web services to create, renew and cancel delegation tokens

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062350#comment-14062350 ] Hadoop QA commented on YARN-2233: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2291) Timeline and RM web services should use same authentication code

2014-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062392#comment-14062392 ] Vinod Kumar Vavilapalli commented on YARN-2291: --- This is likely a dup of the

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062431#comment-14062431 ] Sunil G commented on YARN-796: -- Hi [~gp.leftnoteasy] Great. This feature will be a big addition

[jira] [Updated] (YARN-2219) AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts

2014-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2219: -- Attachment: YARN-2219.2.patch > AMs and NMs can get exceptions after recovery but before scheduler knowns > app

[jira] [Commented] (YARN-2219) AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts

2014-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062492#comment-14062492 ] Jian He commented on YARN-2219: --- Fixed the comments bq. instead of the shouldNotifyAppAccepte

[jira] [Commented] (YARN-2233) Implement web services to create, renew and cancel delegation tokens

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062509#comment-14062509 ] Hadoop QA commented on YARN-2233: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (YARN-2293) Scoring for NMs to identify a better candidate to launch AMs

2014-07-15 Thread Sunil G (JIRA)
Sunil G created YARN-2293: - Summary: Scoring for NMs to identify a better candidate to launch AMs Key: YARN-2293 URL: https://issues.apache.org/jira/browse/YARN-2293 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-2293) Scoring for NMs to identify a better candidate to launch AMs

2014-07-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062530#comment-14062530 ] Jason Lowe commented on YARN-2293: -- This sounds very similar to YARN-2005, if a bit more g

[jira] [Commented] (YARN-2219) AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062547#comment-14062547 ] Hadoop QA commented on YARN-2219: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2264) Race in DrainDispatcher can cause random test failures

2014-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062551#comment-14062551 ] Jian He commented on YARN-2264: --- patch looks good. > Race in DrainDispatcher can cause rand

[jira] [Commented] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062573#comment-14062573 ] Jian He commented on YARN-2211: --- some comments: - setCurrnetMasterKeyData, setNextMasterKeyDa

[jira] [Commented] (YARN-2069) CS queue level preemption should respect user-limits

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062578#comment-14062578 ] Hadoop QA commented on YARN-2069: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-15 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2211: Attachment: YARN-2211.4.patch > RMStateStore needs to save AMRMToken master key for recovery when RM > rest

[jira] [Commented] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-15 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062617#comment-14062617 ] Xuan Gong commented on YARN-2211: - bq. setCurrnetMasterKeyData, setNextMasterKeyData method

[jira] [Commented] (YARN-2285) Preemption can cause capacity scheduler to show 5,000% queue absolute used capacity.

2014-07-15 Thread Tassapol Athiapinya (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062693#comment-14062693 ] Tassapol Athiapinya commented on YARN-2285: --- After closer look, 5000% is valid nu

[jira] [Updated] (YARN-2285) Preemption can cause capacity scheduler to show 5,000% queue capacity.

2014-07-15 Thread Tassapol Athiapinya (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tassapol Athiapinya updated YARN-2285: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) Summary: P

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-15 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062698#comment-14062698 ] Mayank Bansal commented on YARN-1408: - +1 Committing Thanks [~sunilg] for the patch. T

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062696#comment-14062696 ] Hadoop QA commented on YARN-1408: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2285) Preemption can cause capacity scheduler to show 5,000% queue capacity.

2014-07-15 Thread Tassapol Athiapinya (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062697#comment-14062697 ] Tassapol Athiapinya commented on YARN-2285: --- Also it is not major but percentage

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062716#comment-14062716 ] Hudson commented on YARN-1408: -- FAILURE: Integrated in Hadoop-trunk-Commit #5887 (See [https:

[jira] [Updated] (YARN-1336) Work-preserving nodemanager restart

2014-07-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-1336: - Attachment: NMRestartDesignOverview.pdf Attaching a PDF that briefly describes the approach and how the me

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2014-07-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062727#comment-14062727 ] Craig Welch commented on YARN-1680: --- It looks like this won't account for nodes which are

[jira] [Created] (YARN-2294) Update sample program and documentations for writing YARN Application

2014-07-15 Thread Li Lu (JIRA)
Li Lu created YARN-2294: --- Summary: Update sample program and documentations for writing YARN Application Key: YARN-2294 URL: https://issues.apache.org/jira/browse/YARN-2294 Project: Hadoop YARN Issue

[jira] [Created] (YARN-2295) Updating Client of YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
Li Lu created YARN-2295: --- Summary: Updating Client of YARN distributed shell with existing public stable API Key: YARN-2295 URL: https://issues.apache.org/jira/browse/YARN-2295 Project: Hadoop YARN Is

[jira] [Updated] (YARN-2295) Update Client of YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Summary: Update Client of YARN distributed shell with existing public stable API (was: Updating Client of YARN dist

[jira] [Updated] (YARN-2295) Updating Client of YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Attachment: YARN-2295-071514.patch Replacing the unstable privately visible Records.newRecord method with the newIn

[jira] [Created] (YARN-2296) Update Application Master of YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
Li Lu created YARN-2296: --- Summary: Update Application Master of YARN distributed shell with existing public stable API Key: YARN-2296 URL: https://issues.apache.org/jira/browse/YARN-2296 Project: Hadoop YARN

[jira] [Updated] (YARN-2295) Update Client of YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Attachment: YARN-2295-071514-1.patch Updated patch with refactoring in both AM and Client > Update Client of YARN d

[jira] [Updated] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Description: Some API calls in YARN distributed shell have been marked as unstable and private. Use existing public

[jira] [Resolved] (YARN-2296) Update Application Master of YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu resolved YARN-2296. - Resolution: Duplicate Merged into YARN-2295 > Update Application Master of YARN distributed shell with existing p

[jira] [Commented] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062799#comment-14062799 ] Hadoop QA commented on YARN-2295: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2233) Implement web services to create, renew and cancel delegation tokens

2014-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062808#comment-14062808 ] Vinod Kumar Vavilapalli commented on YARN-2233: --- Looks good, +1. Checking thi

[jira] [Updated] (YARN-1695) Implement the rest (writable APIs) of RM web-services

2014-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1695: -- Priority: Major (was: Blocker) > Implement the rest (writable APIs) of RM web-s

[jira] [Commented] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062826#comment-14062826 ] Hadoop QA commented on YARN-2295: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2233) Implement web services to create, renew and cancel delegation tokens

2014-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062831#comment-14062831 ] Hudson commented on YARN-2233: -- FAILURE: Integrated in Hadoop-trunk-Commit #5888 (See [https:

[jira] [Commented] (YARN-1341) Recover NMTokens upon nodemanager restart

2014-07-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062861#comment-14062861 ] Jason Lowe commented on YARN-1341: -- Thanks for commenting, Devaraj! My apologies for the

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-15 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062879#comment-14062879 ] Mayank Bansal commented on YARN-1408: - Committed to trunk, branch 2 and branch-2.5. br

[jira] [Updated] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-15 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-1408: Attachment: YARN-1408-branch-2.5-1.patch rebasing against branch 2.5 > Preemption caused Invalid S

[jira] [Assigned] (YARN-2285) Preemption can cause capacity scheduler to show 5,000% queue capacity.

2014-07-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-2285: Assignee: Wangda Tan Assigned it to me, working on this ... > Preemption can cause capacity schedul

[jira] [Updated] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Attachment: YARN-2295-071514-1.patch Could not reappear the UT failure locally. Resubmitting this patch to see if t

[jira] [Created] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.

2014-07-15 Thread Tassapol Athiapinya (JIRA)
Tassapol Athiapinya created YARN-2297: - Summary: Preemption can hang in corner case by not allowing any task container to proceed. Key: YARN-2297 URL: https://issues.apache.org/jira/browse/YARN-2297

[jira] [Commented] (YARN-2069) CS queue level preemption should respect user-limits

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062911#comment-14062911 ] Hadoop QA commented on YARN-2069: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Attachment: (was: YARN-2295-071514-1.patch) > Refactor YARN distributed shell with existing public stable API >

[jira] [Assigned] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.

2014-07-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-2297: Assignee: Wangda Tan > Preemption can hang in corner case by not allowing any task container to > p

[jira] [Commented] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062936#comment-14062936 ] Hadoop QA commented on YARN-2295: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Attachment: TEST-YARN-2295-071514.patch Probably a deterministic failure on server. Use a trivial formatting patch w

[jira] [Commented] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062964#comment-14062964 ] Hadoop QA commented on YARN-2295: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-07-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062965#comment-14062965 ] Craig Welch commented on YARN-1198: --- It seems like the related problem with these group o

[jira] [Updated] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-07-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1198: -- Attachment: YARN-1198.1.patch > Capacity Scheduler headroom calculation does not work as expected >

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2014-07-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14062972#comment-14062972 ] Craig Welch commented on YARN-1680: --- I was also wondering if we could maintain a Resource

[jira] [Updated] (YARN-2045) Data persisted in NM should be versioned

2014-07-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2045: - Attachment: YARN-2045-v3.patch Thanks [~jlowe] for above comments. In v3 patch: - Remove related interfac

  1   2   >