[jira] [Commented] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

2014-07-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063064#comment-14063064 ] Arpit Agarwal commented on YARN-1994: - [~mipoto], I was unable to apply your v4 patch

[jira] [Commented] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

2014-07-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063065#comment-14063065 ] Arpit Agarwal commented on YARN-1994: - [~mipoto], also feel free to incorporate the

[jira] [Updated] (YARN-2298) Move TimelineClient to yarn-common

2014-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2298: -- Attachment: YARN-2298.1.patch I uploaded a patch to move TimeClient classes to yarn-common, such that

[jira] [Commented] (YARN-1336) Work-preserving nodemanager restart

2014-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063083#comment-14063083 ] Vinod Kumar Vavilapalli commented on YARN-1336: --- Tx for the doc, Jason!

[jira] [Commented] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.

2014-07-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063086#comment-14063086 ] Chris Douglas commented on YARN-2297: - Are there realistic configurations where this

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063096#comment-14063096 ] Jian He commented on YARN-2229: --- add comments to the new getContainerId method Epoch#hashCode

[jira] [Commented] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.

2014-07-15 Thread Tassapol Athiapinya (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063099#comment-14063099 ] Tassapol Athiapinya commented on YARN-2297: --- bq. Are there realistic

[jira] [Commented] (YARN-2298) Move TimelineClient to yarn-common

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063101#comment-14063101 ] Hadoop QA commented on YARN-2298: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.

2014-07-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063115#comment-14063115 ] Chris Douglas commented on YARN-2297: - I'll try asking the question differently. Does

[jira] [Commented] (YARN-2298) Move TimelineClient to yarn-common

2014-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063123#comment-14063123 ] Zhijie Shen commented on YARN-2298: --- Test failure is not related. Move TimelineClient

[jira] [Commented] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.

2014-07-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063156#comment-14063156 ] Wangda Tan commented on YARN-2297: -- Hi [~chris.douglas], Thanks for your jumping in, bq.

[jira] [Created] (YARN-2299) inconsistency at identifying node

2014-07-15 Thread Hong Zhiguo (JIRA)
Hong Zhiguo created YARN-2299: - Summary: inconsistency at identifying node Key: YARN-2299 URL: https://issues.apache.org/jira/browse/YARN-2299 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-2299) inconsistency at identifying node

2014-07-15 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Zhiguo updated YARN-2299: -- Description: If port of yarn.nodemanager.address is not specified at NM, NM will choose random port.

[jira] [Updated] (YARN-2299) inconsistency at identifying node

2014-07-15 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Zhiguo updated YARN-2299: -- Description: If port of yarn.nodemanager.address is not specified at NM, NM will choose random port.

[jira] [Updated] (YARN-2270) TestFSDownload#testDownloadPublicWithStatCache fails in trunk

2014-07-15 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-2270: Attachment: YARN-2270.patch Attaching a patch to fix the test-case.

[jira] [Commented] (YARN-2270) TestFSDownload#testDownloadPublicWithStatCache fails in trunk

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061777#comment-14061777 ] Hadoop QA commented on YARN-2270: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-1408: -- Attachment: (was: Yarn-1408.11.patch) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused

[jira] [Updated] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-1408: -- Attachment: Yarn-1408.11.patch Test case failures are in webapp and its due to connection bind exception. I

[jira] [Created] (YARN-2287) Add audit log levels for NM and RM

2014-07-15 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-2287: -- Summary: Add audit log levels for NM and RM Key: YARN-2287 URL: https://issues.apache.org/jira/browse/YARN-2287 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2033: -- Attachment: ProposalofStoringYARNMetricsintotheTimelineStore.pdf Investigate merging generic-history

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061873#comment-14061873 ] Zhijie Shen commented on YARN-2033: --- Reassign the ticket to myself. Investigate merging

[jira] [Assigned] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-2033: - Assignee: Zhijie Shen (was: Vinod Kumar Vavilapalli) Investigate merging generic-history into

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061872#comment-14061872 ] Hadoop QA commented on YARN-1408: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2033: -- Attachment: YARN-2033.Prototype.patch Upload the proposal of changes and the demo code. Investigate

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061889#comment-14061889 ] Zhijie Shen commented on YARN-2033: --- bq. I would think the timeline store might have to

[jira] [Commented] (YARN-1341) Recover NMTokens upon nodemanager restart

2014-07-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061891#comment-14061891 ] Junping Du commented on YARN-1341: -- Hey [~jlowe], I also agree it is better to discuss the

[jira] [Updated] (YARN-2289) ApplicationHistoryStore should be versioned

2014-07-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2289: - Component/s: applications ApplicationHistoryStore should be versioned

[jira] [Created] (YARN-2289) ApplicationHistoryStore should be versioned

2014-07-15 Thread Junping Du (JIRA)
Junping Du created YARN-2289: Summary: ApplicationHistoryStore should be versioned Key: YARN-2289 URL: https://issues.apache.org/jira/browse/YARN-2289 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-2289) ApplicationHistoryStore should be versioned

2014-07-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061905#comment-14061905 ] Junping Du commented on YARN-2289: -- Generic History Server is being refactored to be based

[jira] [Commented] (YARN-2256) Too many nodemanager audit logs are generated

2014-07-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061907#comment-14061907 ] Varun Saxena commented on YARN-2256: Adding of log levels in RM and NM is addressed by

[jira] [Commented] (YARN-2256) Too many nodemanager audit logs are generated

2014-07-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061908#comment-14061908 ] Varun Saxena commented on YARN-2256: Changed NM container logs to debug level so that

[jira] [Updated] (YARN-2256) Too many nodemanager audit logs are generated

2014-07-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2256: --- Attachment: YARN-2256.patch Please review the patch Too many nodemanager audit logs are generated

[jira] [Commented] (YARN-2287) Add audit log levels for NM and RM

2014-07-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061919#comment-14061919 ] Varun Saxena commented on YARN-2287: I will make the following changes : 1. Create new

[jira] [Commented] (YARN-2256) Too many nodemanager audit logs are generated

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061922#comment-14061922 ] Hadoop QA commented on YARN-2256: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2228) TimelineServer should load pseudo authentication filter when authentication = simple

2014-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061930#comment-14061930 ] Hudson commented on YARN-2228: -- FAILURE: Integrated in Hadoop-Yarn-trunk #613 (See

[jira] [Commented] (YARN-2260) Add containers to launchedContainers list in RMNode on container recovery

2014-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061932#comment-14061932 ] Hudson commented on YARN-2260: -- FAILURE: Integrated in Hadoop-Yarn-trunk #613 (See

[jira] [Commented] (YARN-1050) Document the Fair Scheduler REST API

2014-07-15 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061959#comment-14061959 ] Akira AJISAKA commented on YARN-1050: - Thanks [~kj-ki] for the update. {code} +

[jira] [Updated] (YARN-2256) Too many nodemanager audit logs are generated

2014-07-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2256: --- Attachment: (was: YARN-2256.patch) Too many nodemanager audit logs are generated

[jira] [Updated] (YARN-2256) Too many nodemanager audit logs are generated

2014-07-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2256: --- Attachment: YARN-2256.patch Too many nodemanager audit logs are generated

[jira] [Commented] (YARN-2256) Too many nodemanager audit logs are generated

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062009#comment-14062009 ] Hadoop QA commented on YARN-2256: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2152) Recover missing container information

2014-07-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062060#comment-14062060 ] Jason Lowe commented on YARN-2152: -- Yeah that's what I suspected as well, but I wanted to

[jira] [Commented] (YARN-2260) Add containers to launchedContainers list in RMNode on container recovery

2014-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062075#comment-14062075 ] Hudson commented on YARN-2260: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1805 (See

[jira] [Commented] (YARN-2228) TimelineServer should load pseudo authentication filter when authentication = simple

2014-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062073#comment-14062073 ] Hudson commented on YARN-2228: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1805 (See

[jira] [Commented] (YARN-2256) Too many nodemanager audit logs are generated

2014-07-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062079#comment-14062079 ] Varun Saxena commented on YARN-2256: Only changed log level from INFO to DEBUG. No

[jira] [Commented] (YARN-2228) TimelineServer should load pseudo authentication filter when authentication = simple

2014-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062171#comment-14062171 ] Hudson commented on YARN-2228: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1832 (See

[jira] [Commented] (YARN-2260) Add containers to launchedContainers list in RMNode on container recovery

2014-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062173#comment-14062173 ] Hudson commented on YARN-2260: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1832 (See

[jira] [Commented] (YARN-2045) Data persisted in NM should be versioned

2014-07-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062212#comment-14062212 ] Jason Lowe commented on YARN-2045: -- bq. I agree the concept is not quite the same but I

[jira] [Updated] (YARN-2287) Add audit log levels for NM and RM

2014-07-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2287: --- Attachment: YARN-2287.patch Kindly review the patch Add audit log levels for NM and RM

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-07-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062261#comment-14062261 ] Eric Payne commented on YARN-415: - Hi [~leftnoteasy]. Thank you very much for reviewing my

[jira] [Commented] (YARN-2233) Implement web services to create, renew and cancel delegation tokens

2014-07-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062270#comment-14062270 ] Varun Vasudev commented on YARN-2233: - [~tucu00] I'm going to file another ticket to

[jira] [Created] (YARN-2290) Add support for passing delegation tokens via headers for web services

2014-07-15 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-2290: --- Summary: Add support for passing delegation tokens via headers for web services Key: YARN-2290 URL: https://issues.apache.org/jira/browse/YARN-2290 Project: Hadoop

[jira] [Created] (YARN-2291) Timeline and RM web services should use same authentication code

2014-07-15 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-2291: --- Summary: Timeline and RM web services should use same authentication code Key: YARN-2291 URL: https://issues.apache.org/jira/browse/YARN-2291 Project: Hadoop YARN

[jira] [Commented] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

2014-07-15 Thread Milan Potocnik (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062281#comment-14062281 ] Milan Potocnik commented on YARN-1994: -- Both TestFSDownload and

[jira] [Created] (YARN-2292) RM web services should use hadoop-common for authentication using delegation tokens

2014-07-15 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-2292: --- Summary: RM web services should use hadoop-common for authentication using delegation tokens Key: YARN-2292 URL: https://issues.apache.org/jira/browse/YARN-2292

[jira] [Commented] (YARN-668) TokenIdentifier serialization should consider Unknown fields

2014-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062331#comment-14062331 ] Vinod Kumar Vavilapalli commented on YARN-668: -- One other important point from

[jira] [Commented] (YARN-2152) Recover missing container information

2014-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062332#comment-14062332 ] Vinod Kumar Vavilapalli commented on YARN-2152: --- Yeah, I just realized that

[jira] [Updated] (YARN-2233) Implement web services to create, renew and cancel delegation tokens

2014-07-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2233: Attachment: apache-yarn-2233.5.patch Uploaded new patch fixing findbug error. The test case

[jira] [Updated] (YARN-2100) Refactor the Timeline Server code for Kerberos + DT authentication

2014-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2100: -- Summary: Refactor the Timeline Server code for Kerberos + DT authentication

[jira] [Commented] (YARN-2292) RM web services should use hadoop-common for authentication using delegation tokens

2014-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062379#comment-14062379 ] Vinod Kumar Vavilapalli commented on YARN-2292: --- YARN-2100 is the related

[jira] [Updated] (YARN-2100) Refactor the Timeline Server code for Kerberos + DT authentication

2014-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2100: -- Target Version/s: 2.6.0 Refactor the Timeline Server code for Kerberos + DT

[jira] [Commented] (YARN-2284) Find missing config options in YarnConfiguration and yarn-default.xml

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062382#comment-14062382 ] Hadoop QA commented on YARN-2284: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2233) Implement web services to create, renew and cancel delegation tokens

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062350#comment-14062350 ] Hadoop QA commented on YARN-2233: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2291) Timeline and RM web services should use same authentication code

2014-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062392#comment-14062392 ] Vinod Kumar Vavilapalli commented on YARN-2291: --- This is likely a dup of the

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062431#comment-14062431 ] Sunil G commented on YARN-796: -- Hi [~gp.leftnoteasy] Great. This feature will be a big addition

[jira] [Updated] (YARN-2219) AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts

2014-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2219: -- Attachment: YARN-2219.2.patch AMs and NMs can get exceptions after recovery but before scheduler knowns apps

[jira] [Commented] (YARN-2219) AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts

2014-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062492#comment-14062492 ] Jian He commented on YARN-2219: --- Fixed the comments bq. instead of the

[jira] [Created] (YARN-2293) Scoring for NMs to identify a better candidate to launch AMs

2014-07-15 Thread Sunil G (JIRA)
Sunil G created YARN-2293: - Summary: Scoring for NMs to identify a better candidate to launch AMs Key: YARN-2293 URL: https://issues.apache.org/jira/browse/YARN-2293 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-2293) Scoring for NMs to identify a better candidate to launch AMs

2014-07-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062530#comment-14062530 ] Jason Lowe commented on YARN-2293: -- This sounds very similar to YARN-2005, if a bit more

[jira] [Commented] (YARN-2264) Race in DrainDispatcher can cause random test failures

2014-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062551#comment-14062551 ] Jian He commented on YARN-2264: --- patch looks good. Race in DrainDispatcher can cause

[jira] [Commented] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062573#comment-14062573 ] Jian He commented on YARN-2211: --- some comments: - setCurrnetMasterKeyData,

[jira] [Commented] (YARN-2069) CS queue level preemption should respect user-limits

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062578#comment-14062578 ] Hadoop QA commented on YARN-2069: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-15 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2211: Attachment: YARN-2211.4.patch RMStateStore needs to save AMRMToken master key for recovery when RM

[jira] [Commented] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-15 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062617#comment-14062617 ] Xuan Gong commented on YARN-2211: - bq. setCurrnetMasterKeyData, setNextMasterKeyData

[jira] [Commented] (YARN-2285) Preemption can cause capacity scheduler to show 5,000% queue absolute used capacity.

2014-07-15 Thread Tassapol Athiapinya (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062693#comment-14062693 ] Tassapol Athiapinya commented on YARN-2285: --- After closer look, 5000% is valid

[jira] [Updated] (YARN-2285) Preemption can cause capacity scheduler to show 5,000% queue capacity.

2014-07-15 Thread Tassapol Athiapinya (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tassapol Athiapinya updated YARN-2285: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) Summary:

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-15 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062698#comment-14062698 ] Mayank Bansal commented on YARN-1408: - +1 Committing Thanks [~sunilg] for the patch.

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062696#comment-14062696 ] Hadoop QA commented on YARN-1408: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2285) Preemption can cause capacity scheduler to show 5,000% queue capacity.

2014-07-15 Thread Tassapol Athiapinya (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062697#comment-14062697 ] Tassapol Athiapinya commented on YARN-2285: --- Also it is not major but percentage

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062716#comment-14062716 ] Hudson commented on YARN-1408: -- FAILURE: Integrated in Hadoop-trunk-Commit #5887 (See

[jira] [Updated] (YARN-1336) Work-preserving nodemanager restart

2014-07-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-1336: - Attachment: NMRestartDesignOverview.pdf Attaching a PDF that briefly describes the approach and how the

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2014-07-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062727#comment-14062727 ] Craig Welch commented on YARN-1680: --- It looks like this won't account for nodes which are

[jira] [Created] (YARN-2294) Update sample program and documentations for writing YARN Application

2014-07-15 Thread Li Lu (JIRA)
Li Lu created YARN-2294: --- Summary: Update sample program and documentations for writing YARN Application Key: YARN-2294 URL: https://issues.apache.org/jira/browse/YARN-2294 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-2295) Update Client of YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Summary: Update Client of YARN distributed shell with existing public stable API (was: Updating Client of YARN

[jira] [Updated] (YARN-2295) Updating Client of YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Attachment: YARN-2295-071514.patch Replacing the unstable privately visible Records.newRecord method with the

[jira] [Created] (YARN-2296) Update Application Master of YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
Li Lu created YARN-2296: --- Summary: Update Application Master of YARN distributed shell with existing public stable API Key: YARN-2296 URL: https://issues.apache.org/jira/browse/YARN-2296 Project: Hadoop YARN

[jira] [Updated] (YARN-2295) Update Client of YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Attachment: YARN-2295-071514-1.patch Updated patch with refactoring in both AM and Client Update Client of YARN

[jira] [Updated] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Description: Some API calls in YARN distributed shell have been marked as unstable and private. Use existing public

[jira] [Resolved] (YARN-2296) Update Application Master of YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu resolved YARN-2296. - Resolution: Duplicate Merged into YARN-2295 Update Application Master of YARN distributed shell with existing

[jira] [Commented] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062799#comment-14062799 ] Hadoop QA commented on YARN-2295: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2233) Implement web services to create, renew and cancel delegation tokens

2014-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062808#comment-14062808 ] Vinod Kumar Vavilapalli commented on YARN-2233: --- Looks good, +1. Checking

[jira] [Updated] (YARN-1695) Implement the rest (writable APIs) of RM web-services

2014-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1695: -- Priority: Major (was: Blocker) Implement the rest (writable APIs) of RM

[jira] [Commented] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062826#comment-14062826 ] Hadoop QA commented on YARN-2295: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2233) Implement web services to create, renew and cancel delegation tokens

2014-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062831#comment-14062831 ] Hudson commented on YARN-2233: -- FAILURE: Integrated in Hadoop-trunk-Commit #5888 (See

[jira] [Commented] (YARN-1341) Recover NMTokens upon nodemanager restart

2014-07-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062861#comment-14062861 ] Jason Lowe commented on YARN-1341: -- Thanks for commenting, Devaraj! My apologies for the

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-15 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062879#comment-14062879 ] Mayank Bansal commented on YARN-1408: - Committed to trunk, branch 2 and branch-2.5.

[jira] [Updated] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-15 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-1408: Attachment: YARN-1408-branch-2.5-1.patch rebasing against branch 2.5 Preemption caused Invalid

[jira] [Assigned] (YARN-2285) Preemption can cause capacity scheduler to show 5,000% queue capacity.

2014-07-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-2285: Assignee: Wangda Tan Assigned it to me, working on this ... Preemption can cause capacity

[jira] [Updated] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Attachment: YARN-2295-071514-1.patch Could not reappear the UT failure locally. Resubmitting this patch to see if

[jira] [Created] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.

2014-07-15 Thread Tassapol Athiapinya (JIRA)
Tassapol Athiapinya created YARN-2297: - Summary: Preemption can hang in corner case by not allowing any task container to proceed. Key: YARN-2297 URL: https://issues.apache.org/jira/browse/YARN-2297

[jira] [Commented] (YARN-2069) CS queue level preemption should respect user-limits

2014-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062911#comment-14062911 ] Hadoop QA commented on YARN-2069: - {color:green}+1 overall{color}. Here are the results of

  1   2   >