[jira] [Commented] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

2014-06-24 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041778#comment-14041778 ] Craig Welch commented on YARN-1039: --- That's along the lines of what I was thinking after

[jira] [Updated] (YARN-2142) Add one service to check the nodes' TRUST status

2014-06-24 Thread anders (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anders updated YARN-2142: - Attachment: test.patch test Add one service to check the nodes' TRUST status

[jira] [Commented] (YARN-2069) Add cross-user preemption within CapacityScheduler's leaf-queue

2014-06-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041845#comment-14041845 ] Wangda Tan commented on YARN-2069: -- Hi Mayank, Thanks for you patch, I just looked at it,

[jira] [Updated] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

2014-06-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1039: -- Priority: Major (was: Minor) Add parameter for YARN resource requests to indicate long lived

[jira] [Commented] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

2014-06-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041874#comment-14041874 ] Zhijie Shen commented on YARN-1039: --- bq. I see. I'd assume that the service flag would

[jira] [Commented] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

2014-06-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041875#comment-14041875 ] Zhijie Shen commented on YARN-1039: --- Upgrade the jira to major given a long discussion.

[jira] [Commented] (YARN-2181) Add preemption info to RM Web UI

2014-06-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041916#comment-14041916 ] Wangda Tan commented on YARN-2181: -- [~zjshen], good suggestion! I think it should be very

[jira] [Commented] (YARN-2143) Merge common killContainer logic of Fair/Capacity scheduler into AbstractYarnScheduler

2014-06-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041924#comment-14041924 ] Sunil G commented on YARN-2143: --- Hi [~gp.leftnoteasy] *FairScheduler#warnOrKillContainer*

[jira] [Updated] (YARN-2181) Add preemption info to RM Web UI

2014-06-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2181: - Attachment: queue page.png NM apps.png Add preemption info to RM Web UI

[jira] [Updated] (YARN-2181) Add preemption info to RM Web UI

2014-06-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2181: - Attachment: YARN-2181.patch Add preemption info to RM Web UI

[jira] [Commented] (YARN-2181) Add preemption info to RM Web UI

2014-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041933#comment-14041933 ] Hadoop QA commented on YARN-2181: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2181) Add preemption info to RM Web UI

2014-06-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041937#comment-14041937 ] Wangda Tan commented on YARN-2181: -- Attached first version patch, implemented all

[jira] [Commented] (YARN-2191) Add a test to make sure NM will do application cleanup even if RM restarting happens before application completed

2014-06-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041991#comment-14041991 ] Hudson commented on YARN-2191: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #593 (See

[jira] [Updated] (YARN-2195) Clean a piece of code in ResourceRequest

2014-06-24 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-2195: Hadoop Flags: Reviewed Good catch [~ywskycn]. +1, patch looks good to me. Will commit this. Clean a

[jira] [Commented] (YARN-2191) Add a test to make sure NM will do application cleanup even if RM restarting happens before application completed

2014-06-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042145#comment-14042145 ] Hudson commented on YARN-2191: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1784 (See

[jira] [Commented] (YARN-2195) Clean a piece of code in ResourceRequest

2014-06-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042148#comment-14042148 ] Hudson commented on YARN-2195: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5760 (See

[jira] [Commented] (YARN-2191) Add a test to make sure NM will do application cleanup even if RM restarting happens before application completed

2014-06-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042229#comment-14042229 ] Hudson commented on YARN-2191: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1811 (See

[jira] [Commented] (YARN-2074) Preemption of AM containers shouldn't count towards AM failures

2014-06-24 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042223#comment-14042223 ] Vinod Kumar Vavilapalli commented on YARN-2074: --- This looks good, +1.

[jira] [Commented] (YARN-2143) Merge common killContainer logic of Fair/Capacity scheduler into AbstractYarnScheduler

2014-06-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042251#comment-14042251 ] Wangda Tan commented on YARN-2143: -- Hi Sunil, Thanks for your comment, I took a look at

[jira] [Commented] (YARN-2074) Preemption of AM containers shouldn't count towards AM failures

2014-06-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042253#comment-14042253 ] Hudson commented on YARN-2074: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5761 (See

[jira] [Commented] (YARN-2111) In FairScheduler.attemptScheduling, we don't count containers as assigned if they have 0 memory but non-zero cores

2014-06-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042268#comment-14042268 ] Hudson commented on YARN-2111: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5762 (See

[jira] [Commented] (YARN-2195) Clean a piece of code in ResourceRequest

2014-06-24 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042286#comment-14042286 ] Wei Yan commented on YARN-2195: --- Thanks, [~devaraj.k]. Clean a piece of code in

[jira] [Commented] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

2014-06-24 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042350#comment-14042350 ] Anubhav Dhoot commented on YARN-1039: - The tokens for long lived applications jira is

[jira] [Commented] (YARN-2192) TestRMHA fails when run with a mix of Schedulers

2014-06-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042361#comment-14042361 ] Karthik Kambatla commented on YARN-2192: +1. Committing this. Checked if not

[jira] [Commented] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

2014-06-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042370#comment-14042370 ] Steve Loughran commented on YARN-1039: -- bq. We need to have another flag to indicate

[jira] [Commented] (YARN-2192) TestRMHA fails when run with a mix of Schedulers

2014-06-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042394#comment-14042394 ] Hudson commented on YARN-2192: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5764 (See

[jira] [Commented] (YARN-941) RM Should have a way to update the tokens it has for a running application

2014-06-24 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042399#comment-14042399 ] Anubhav Dhoot commented on YARN-941: Let me try to summarize the different points of

[jira] [Commented] (YARN-2109) TestRM fails some tests when some tests run with CapacityScheduler and some with FairScheduler

2014-06-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042411#comment-14042411 ] Karthik Kambatla commented on YARN-2109: +1. Committing this. TestRM fails some

[jira] [Updated] (YARN-2109) Fix TestRM to work with both schedulers

2014-06-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2109: --- Summary: Fix TestRM to work with both schedulers (was: TestRM fails some tests when some

[jira] [Created] (YARN-2199) FairScheduler: Allow max-AM-share to be specified in the root queue

2014-06-24 Thread Robert Kanter (JIRA)
Robert Kanter created YARN-2199: --- Summary: FairScheduler: Allow max-AM-share to be specified in the root queue Key: YARN-2199 URL: https://issues.apache.org/jira/browse/YARN-2199 Project: Hadoop YARN

[jira] [Updated] (YARN-2199) FairScheduler: Allow max-AM-share to be specified in the root queue

2014-06-24 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-2199: Attachment: YARN-2199.patch FairScheduler: Allow max-AM-share to be specified in the root queue

[jira] [Commented] (YARN-2109) Fix TestRM to work with both schedulers

2014-06-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042426#comment-14042426 ] Hudson commented on YARN-2109: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5766 (See

[jira] [Commented] (YARN-2110) TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler

2014-06-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042429#comment-14042429 ] Karthik Kambatla commented on YARN-2110: The patch doesn't apply anymore.

[jira] [Commented] (YARN-941) RM Should have a way to update the tokens it has for a running application

2014-06-24 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042446#comment-14042446 ] Vinod Kumar Vavilapalli commented on YARN-941: -- Clarifications for folks who

[jira] [Commented] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

2014-06-24 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042469#comment-14042469 ] Craig Welch commented on YARN-1039: --- {quote}We need to have a flag to indicate an AM is

Re: SIMPLE authentication is not enabled error for secured hdfs read

2014-06-24 Thread Chris Nauroth
Hi David, UserGroupInformation.createRemoteUser does not attach credentials to the returned ugi. I expect the server side is rejecting the connection due to lack of credentials. This is actually by design. The UserGroupInformation.createRemoteUser method is primarily intended for use on the

[jira] [Commented] (YARN-2110) TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler

2014-06-24 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042484#comment-14042484 ] Chen He commented on YARN-2110: --- sure TestAMRestart#testAMRestartWithExistingContainers

[jira] [Commented] (YARN-2199) FairScheduler: Allow max-AM-share to be specified in the root queue

2014-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042486#comment-14042486 ] Hadoop QA commented on YARN-2199: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2152) Recover missing container information

2014-06-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2152: -- Attachment: YARN-2152.3.patch Renamed the related fields from startTime to creationTime Recover missing

[jira] [Created] (YARN-2200) Rename related container start time to container creation time

2014-06-24 Thread Jian He (JIRA)
Jian He created YARN-2200: - Summary: Rename related container start time to container creation time Key: YARN-2200 URL: https://issues.apache.org/jira/browse/YARN-2200 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-2152) Recover missing container information

2014-06-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042501#comment-14042501 ] Jian He commented on YARN-2152: --- opened YARN-2200 for other related renames. Recover

[jira] [Created] (YARN-2201) TestRMWebServicesAppsModification dependent on yarn-default.xml

2014-06-24 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-2201: Summary: TestRMWebServicesAppsModification dependent on yarn-default.xml Key: YARN-2201 URL: https://issues.apache.org/jira/browse/YARN-2201 Project: Hadoop YARN

[jira] [Updated] (YARN-2201) TestRMWebServicesAppsModification dependent on yarn-default.xml

2014-06-24 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-2201: - Description: TestRMWebServicesAppsModification.java has some errors that are yarn-default.xml dependent.

[jira] [Created] (YARN-2202) Metrics recovery for nodemanager restart

2014-06-24 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-2202: Summary: Metrics recovery for nodemanager restart Key: YARN-2202 URL: https://issues.apache.org/jira/browse/YARN-2202 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-1341) Recover NMTokens upon nodemanager restart

2014-06-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042559#comment-14042559 ] Jason Lowe commented on YARN-1341: -- bq. So far from I know, RM restart didn't track this

[jira] [Commented] (YARN-2072) RM/NM UIs and webservices are missing vcore information

2014-06-24 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042565#comment-14042565 ] Thomas Graves commented on YARN-2072: - +1, looks good. Thanks Nathan. RM/NM UIs and

[jira] [Updated] (YARN-2072) RM/NM UIs and webservices are missing vcore information

2014-06-24 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated YARN-2072: Issue Type: Improvement (was: Bug) RM/NM UIs and webservices are missing vcore information

[jira] [Commented] (YARN-2072) RM/NM UIs and webservices are missing vcore information

2014-06-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042585#comment-14042585 ] Hudson commented on YARN-2072: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5769 (See

[jira] [Commented] (YARN-2199) FairScheduler: Allow max-AM-share to be specified in the root queue

2014-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042588#comment-14042588 ] Hadoop QA commented on YARN-2199: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2110) TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler

2014-06-24 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated YARN-2110: -- Attachment: YARN-2110-v2.patch patch updated based on latest trunk.

[jira] [Commented] (YARN-2152) Recover missing container information

2014-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042594#comment-14042594 ] Hadoop QA commented on YARN-2152: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2202) Metrics recovery for nodemanager restart

2014-06-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042612#comment-14042612 ] Junping Du commented on YARN-2202: -- Thanks [~jlowe] for filing this JIRA. Will work on

[jira] [Updated] (YARN-2110) TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler

2014-06-24 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated YARN-2110: -- Attachment: (was: MAPREDUCE-5939-v2.patch) TestAMRestart#testAMRestartWithExistingContainers assumes

[jira] [Updated] (YARN-2110) TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler

2014-06-24 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated YARN-2110: -- Attachment: MAPREDUCE-5939-v2.patch TestAMRestart#testAMRestartWithExistingContainers assumes

[jira] [Created] (YARN-2203) Web UI for cache manager

2014-06-24 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-2203: -- Summary: Web UI for cache manager Key: YARN-2203 URL: https://issues.apache.org/jira/browse/YARN-2203 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-2203) Web UI for cache manager

2014-06-24 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-2203: --- Attachment: YARN-2203-trunk-v1.patch Attached is a v1 patch on

[jira] [Commented] (YARN-2110) TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler

2014-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042664#comment-14042664 ] Hadoop QA commented on YARN-2110: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2181) Add preemption info to RM Web UI

2014-06-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042695#comment-14042695 ] Jian He commented on YARN-2181: --- patch need rebase. we don't need to propagate the

[jira] [Commented] (YARN-1972) Implement secure Windows Container Executor

2014-06-24 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042702#comment-14042702 ] Vinod Kumar Vavilapalli commented on YARN-1972: --- bq. I'm thinking to write

[jira] [Commented] (YARN-2152) Recover missing container information

2014-06-24 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042734#comment-14042734 ] Vinod Kumar Vavilapalli commented on YARN-2152: --- +1, checking this in..

[jira] [Updated] (YARN-2069) Add cross-user preemption within CapacityScheduler's leaf-queue

2014-06-24 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-2069: Attachment: YARN-2069-trunk-2.patch Thanks for the review. I don't have any easy way now to

[jira] [Commented] (YARN-2152) Recover missing container information

2014-06-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042753#comment-14042753 ] Hudson commented on YARN-2152: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5773 (See

How do I use java api to read data from secured hadoop cluster?

2014-06-24 Thread Liu, David
Hi experts, Can anyone provide some example or api name to read data from secured hadoop cluster? I have code like this which can read data from unsecured cluster, but when it comes to secured one, authentication error will show. Configuration conf = new Configuration(); FileSystem fs =

Re: How do I use java api to read data from secured hadoop cluster?

2014-06-24 Thread Liu, David
I mean to read data from secured hdfs. On Jun 25, 2014, at 6:14 AM, Liu, David liujion...@gmail.com wrote: Hi experts, Can anyone provide some example or api name to read data from secured hadoop cluster? I have code like this which can read data from unsecured cluster, but when it

[jira] [Created] (YARN-2204) TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler

2014-06-24 Thread Robert Kanter (JIRA)
Robert Kanter created YARN-2204: --- Summary: TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler Key: YARN-2204 URL: https://issues.apache.org/jira/browse/YARN-2204 Project:

[jira] [Updated] (YARN-2204) TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler

2014-06-24 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-2204: Attachment: YARN-2204.patch The patch simply sets the scheduler to the CapacityScheduler, just like

[jira] [Commented] (YARN-2069) Add cross-user preemption within CapacityScheduler's leaf-queue

2014-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042800#comment-14042800 ] Hadoop QA commented on YARN-2069: - {color:red}-1 overall{color}. Here are the results of

[jira] [Assigned] (YARN-2190) Provide a Windows container executor that can limit memory and CPU

2014-06-24 Thread Chuan Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuan Liu reassigned YARN-2190: --- Assignee: Chuan Liu Provide a Windows container executor that can limit memory and CPU

[jira] [Commented] (YARN-2204) TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler

2014-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042830#comment-14042830 ] Hadoop QA commented on YARN-2204: - {color:green}+1 overall{color}. Here are the results of

[jira] [Reopened] (YARN-2168) SCM/Client/NM/Admin protocols

2014-06-24 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo reopened YARN-2168: SCM/Client/NM/Admin protocols - Key: YARN-2168

[jira] [Updated] (YARN-2168) SCM/Client/NM/Admin protocols

2014-06-24 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-2168: --- Attachment: YARN-2168-trunk-v2.patch As per [~vinodkv]'s suggestion: Attached is a v2 patch of the

[jira] [Commented] (YARN-2093) Fair Scheduler IllegalStateException after upgrade from 2.2.0 to 2.4.1-SNAP

2014-06-24 Thread Jon Bringhurst (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042835#comment-14042835 ] Jon Bringhurst commented on YARN-2093: -- When upgrading a second time from 2.2.0 to

[jira] [Updated] (YARN-2168) SCM/Client/NM/Admin protocols

2014-06-24 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-2168: --- Description: This jira is meant to be used to review the main shared cache APIs. They are as

[jira] [Assigned] (YARN-614) Retry attempts automatically for hardware failures or YARN issues and set default app retries to 1

2014-06-24 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-614: -- Assignee: Xuan Gong (was: Chris Riccomini) Retry attempts automatically for hardware failures or YARN

[jira] [Commented] (YARN-2168) SCM/Client/NM/Admin protocols

2014-06-24 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042838#comment-14042838 ] Chris Trezzo commented on YARN-2168: A note about the current use API: Internally we

[jira] [Commented] (YARN-614) Retry attempts automatically for hardware failures or YARN issues and set default app retries to 1

2014-06-24 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042840#comment-14042840 ] Jakob Homan commented on YARN-614: -- Hey Xuan, had missed your comment. Chris is out at the

[jira] [Commented] (YARN-614) Retry attempts automatically for hardware failures or YARN issues and set default app retries to 1

2014-06-24 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042844#comment-14042844 ] Xuan Gong commented on YARN-614: Take this over. Since YARN-2074 is committed, i think for

[jira] [Updated] (YARN-614) Retry attempts automatically for hardware failures or YARN issues and set default app retries to 1

2014-06-24 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-614: --- Attachment: YARN-614.7.patch Retry attempts automatically for hardware failures or YARN issues and set

Re: How do I use java api to read data from secured hadoop cluster?

2014-06-24 Thread Liu, David
By the way, I have kinit hadoop on the cluster, and hadoop fs -ls / works on the cluster. The code below is run on the cluster too. On Jun 25, 2014, at 6:22 AM, Liu, David liujion...@gmail.com wrote: I mean to read data from secured hdfs. On Jun 25, 2014, at 6:14 AM, Liu, David

[jira] [Commented] (YARN-1367) After restart NM should resync with the RM without killing containers

2014-06-24 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042879#comment-14042879 ] Anubhav Dhoot commented on YARN-1367: - [~jianhe] uploading a new patch that addressed

[jira] [Updated] (YARN-1367) After restart NM should resync with the RM without killing containers

2014-06-24 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-1367: Attachment: YARN-1367.002.patch Addressed comments After restart NM should resync with the RM

[jira] [Commented] (YARN-614) Retry attempts automatically for hardware failures or YARN issues and set default app retries to 1

2014-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042897#comment-14042897 ] Hadoop QA commented on YARN-614: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-614) Retry attempts automatically for hardware failures or YARN issues and set default app retries to 1

2014-06-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042910#comment-14042910 ] Steve Loughran commented on YARN-614: - I like this, but need to note one thing: our AM

[jira] [Commented] (YARN-1367) After restart NM should resync with the RM without killing containers

2014-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042912#comment-14042912 ] Hadoop QA commented on YARN-1367: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1708) Add a public API to reserve resources (part of YARN-1051)

2014-06-24 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042917#comment-14042917 ] Vinod Kumar Vavilapalli commented on YARN-1708: --- I discussed a bit about this

[jira] [Created] (YARN-2205) Misspelling of ClusterMetrics#getNumDecommisionedNMs()

2014-06-24 Thread Kenji Kikushima (JIRA)
Kenji Kikushima created YARN-2205: - Summary: Misspelling of ClusterMetrics#getNumDecommisionedNMs() Key: YARN-2205 URL: https://issues.apache.org/jira/browse/YARN-2205 Project: Hadoop YARN

[jira] [Updated] (YARN-2205) Misspelling of ClusterMetrics#getNumDecommisionedNMs()

2014-06-24 Thread Kenji Kikushima (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenji Kikushima updated YARN-2205: -- Attachment: YARN-2205.patch Attached a patch. Misspelling of

[jira] [Created] (YARN-2206) Update document for applications REST API response examples

2014-06-24 Thread Kenji Kikushima (JIRA)
Kenji Kikushima created YARN-2206: - Summary: Update document for applications REST API response examples Key: YARN-2206 URL: https://issues.apache.org/jira/browse/YARN-2206 Project: Hadoop YARN

[jira] [Updated] (YARN-2206) Update document for applications REST API response examples

2014-06-24 Thread Kenji Kikushima (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenji Kikushima updated YARN-2206: -- Attachment: YARN-2206.patch Attached a patch. Update document for applications REST API

[jira] [Created] (YARN-2207) Add ability to roll over AMRMToken

2014-06-24 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-2207: --- Summary: Add ability to roll over AMRMToken Key: YARN-2207 URL: https://issues.apache.org/jira/browse/YARN-2207 Project: Hadoop YARN Issue Type: Task

[jira] [Commented] (YARN-941) RM Should have a way to update the tokens it has for a running application

2014-06-24 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042953#comment-14042953 ] Xuan Gong commented on YARN-941: I have created a ticket for AMRMToken roll-over:

[jira] [Commented] (YARN-2207) Add ability to roll over AMRMToken

2014-06-24 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042952#comment-14042952 ] Xuan Gong commented on YARN-2207: - copy Vinod's comment from YARN-941. {code}

[jira] [Commented] (YARN-2205) Misspelling of ClusterMetrics#getNumDecommisionedNMs()

2014-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042954#comment-14042954 ] Hadoop QA commented on YARN-2205: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (YARN-2208) AMRMTokenManager need to have a way to roll over AMRMToken

2014-06-24 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-2208: --- Summary: AMRMTokenManager need to have a way to roll over AMRMToken Key: YARN-2208 URL: https://issues.apache.org/jira/browse/YARN-2208 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-2206) Update document for applications REST API response examples

2014-06-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042961#comment-14042961 ] Hadoop QA commented on YARN-2206: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1713) Implement getnewapplication and submitapp as part of RM web service

2014-06-24 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042992#comment-14042992 ] Vinod Kumar Vavilapalli commented on YARN-1713: --- I have a bunch of questions

[jira] [Commented] (YARN-614) Retry attempts automatically for hardware failures or YARN issues and set default app retries to 1

2014-06-24 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14043029#comment-14043029 ] Bikas Saha commented on YARN-614: - Steve, what you want should already happen. AM will

[jira] [Commented] (YARN-1365) ApplicationMasterService to allow Register and Unregister of an app that was running before restart

2014-06-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14043033#comment-14043033 ] Jian He commented on YARN-1365: --- looks good, committing ApplicationMasterService to allow

[jira] [Created] (YARN-2209) Replace allocate#resync command with ApplicationMasterNotRegisteredException to indicate AM to re-register on RM restart

2014-06-24 Thread Jian He (JIRA)
Jian He created YARN-2209: - Summary: Replace allocate#resync command with ApplicationMasterNotRegisteredException to indicate AM to re-register on RM restart Key: YARN-2209 URL:

[jira] [Commented] (YARN-1365) ApplicationMasterService to allow Register and Unregister of an app that was running before restart

2014-06-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14043039#comment-14043039 ] Jian He commented on YARN-1365: --- opened YARN-2209 to use exceptions in allocate call instead

  1   2   >