[jira] [Created] (YARN-1038) LocalizationProtocolPBClientImpl RPC failing

Alejandro Abdelnur created YARN-1038: Summary: LocalizationProtocolPBClientImpl RPC failing Key: YARN-1038 URL: https://issues.apache.org/jira/browse/YARN-1038 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-899) Get queue administration ACLs working

[ https://issues.apache.org/jira/browse/YARN-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13731729#comment-13731729 ] Sandy Ryza commented on YARN-899: - Thanks for taking this up, Xuan. I took a look at the

[jira] [Updated] (YARN-1023) [YARN-321] Weservices REST API's support for Application History

[ https://issues.apache.org/jira/browse/YARN-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-1023: Attachment: YARN-1023-v0.patch [YARN-321] Weservices REST API's support for Application History

[jira] [Commented] (YARN-1023) [YARN-321] Weservices REST API's support for Application History

[ https://issues.apache.org/jira/browse/YARN-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13731777#comment-13731777 ] Hadoop QA commented on YARN-1023: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1036) Distributed Cache gives inconsistent result if cache files get deleted from task tracker

[ https://issues.apache.org/jira/browse/YARN-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13731945#comment-13731945 ] Koji Noguchi commented on YARN-1036: When reading MAPREDUCE-4342 initially, I didn't

[jira] [Commented] (YARN-985) Nodemanager should log where a resource was localized

[ https://issues.apache.org/jira/browse/YARN-985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13731956#comment-13731956 ] Hudson commented on YARN-985: - FAILURE: Integrated in Hadoop-Hdfs-trunk #1484 (See

[jira] [Commented] (YARN-985) Nodemanager should log where a resource was localized

[ https://issues.apache.org/jira/browse/YARN-985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732036#comment-13732036 ] Hudson commented on YARN-985: - FAILURE: Integrated in Hadoop-Mapreduce-trunk #1511 (See

[jira] [Commented] (YARN-1036) Distributed Cache gives inconsistent result if cache files get deleted from task tracker

[ https://issues.apache.org/jira/browse/YARN-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732125#comment-13732125 ] Ravi Prakash commented on YARN-1036: Thanks for the review Omkar and Koji! Are you

[jira] [Commented] (YARN-696) Enable multiple states to to be specified in Resource Manager apps REST call

[ https://issues.apache.org/jira/browse/YARN-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732142#comment-13732142 ] Zhijie Shen commented on YARN-696: -- Thanks for supporting multiple states params. Here're

[jira] [Commented] (YARN-899) Get queue administration ACLs working

[ https://issues.apache.org/jira/browse/YARN-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732148#comment-13732148 ] Xuan Gong commented on YARN-899: Thanks for the comments. Sandy. bq.We should go with an

[jira] [Created] (YARN-1039) Add resource for YARN container requests to indicate long lived

Steve Loughran created YARN-1039: Summary: Add resource for YARN container requests to indicate long lived Key: YARN-1039 URL: https://issues.apache.org/jira/browse/YARN-1039 Project: Hadoop YARN

[jira] [Created] (YARN-1040) Add ability to execute multiple programs in the same long-lived container

Steve Loughran created YARN-1040: Summary: Add ability to execute multiple programs in the same long-lived container Key: YARN-1040 URL: https://issues.apache.org/jira/browse/YARN-1040 Project:

[jira] [Updated] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1039: - Description: A container request could support a new parameter long-lived. This could be used by a

[jira] [Commented] (YARN-1041) RM to bind and notify a restarted AM of existing containers

[ https://issues.apache.org/jira/browse/YARN-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732207#comment-13732207 ] Steve Loughran commented on YARN-1041: -- This is not something that MR could

[jira] [Commented] (YARN-1036) Distributed Cache gives inconsistent result if cache files get deleted from task tracker

[ https://issues.apache.org/jira/browse/YARN-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732214#comment-13732214 ] Omkar Vinit Joshi commented on YARN-1036: - [~knoguchi] We get LOCALIZED even when

[jira] [Commented] (YARN-1016) Define a HDFS based repository that allows YARN services to share resources

[ https://issues.apache.org/jira/browse/YARN-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732231#comment-13732231 ] Steve Loughran commented on YARN-1016: -- We can re-use existing artifacts in HDFS today

[jira] [Created] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

Steve Loughran created YARN-1042: Summary: add ability to specify affinity/anti-affinity in container requests Key: YARN-1042 URL: https://issues.apache.org/jira/browse/YARN-1042 Project: Hadoop YARN

[jira] [Commented] (YARN-899) Get queue administration ACLs working

[ https://issues.apache.org/jira/browse/YARN-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732287#comment-13732287 ] Xuan Gong commented on YARN-899: bq. If we can't apply them at this level, then I think the

[jira] [Commented] (YARN-1018) prereq check for AMRMClient.ContainerRequest relaxLocality flag wrong

[ https://issues.apache.org/jira/browse/YARN-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732568#comment-13732568 ] Sandy Ryza commented on YARN-1018: -- Ah ok cool. In that case I'll close this and

[jira] [Resolved] (YARN-1018) prereq check for AMRMClient.ContainerRequest relaxLocality flag wrong

[ https://issues.apache.org/jira/browse/YARN-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved YARN-1018. -- Resolution: Not A Problem prereq check for AMRMClient.ContainerRequest relaxLocality flag wrong

[jira] [Commented] (YARN-899) Get queue administration ACLs working

[ https://issues.apache.org/jira/browse/YARN-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732576#comment-13732576 ] Hitesh Shah commented on YARN-899: -- [~acmurthy] [~vinodkv] can probably correct me as I

[jira] [Commented] (YARN-1016) Define a HDFS based repository that allows YARN services to share resources

[ https://issues.apache.org/jira/browse/YARN-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732610#comment-13732610 ] Jason Lowe commented on YARN-1016: -- YARN already provides a cache of localized resources,

[jira] [Commented] (YARN-899) Get queue administration ACLs working

[ https://issues.apache.org/jira/browse/YARN-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732635#comment-13732635 ] Sandy Ryza commented on YARN-899: - bq. So, I think that the applicationACLs should be only

[jira] [Commented] (YARN-1036) Distributed Cache gives inconsistent result if cache files get deleted from task tracker

[ https://issues.apache.org/jira/browse/YARN-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732637#comment-13732637 ] Ravi Prakash commented on YARN-1036: Omkar! We don't want to delete a file. We want it

[jira] [Commented] (YARN-1036) Distributed Cache gives inconsistent result if cache files get deleted from task tracker

[ https://issues.apache.org/jira/browse/YARN-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732653#comment-13732653 ] Omkar Vinit Joshi commented on YARN-1036: - [~raviprak] Let me try to explain again.

[jira] [Commented] (YARN-1038) LocalizationProtocolPBClientImpl RPC failing

[ https://issues.apache.org/jira/browse/YARN-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732657#comment-13732657 ] Omkar Vinit Joshi commented on YARN-1038: - Can you please attach complete RM/NM/AM

[jira] [Created] (YARN-1043) YARN Queue metrics are not getting pushed to neither file nor Ganglia

Yusaku Sako created YARN-1043: - Summary: YARN Queue metrics are not getting pushed to neither file nor Ganglia Key: YARN-1043 URL: https://issues.apache.org/jira/browse/YARN-1043 Project: Hadoop YARN

[jira] [Updated] (YARN-1043) YARN Queue metrics are getting pushed to neither file nor Ganglia

[ https://issues.apache.org/jira/browse/YARN-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yusaku Sako updated YARN-1043: -- Summary: YARN Queue metrics are getting pushed to neither file nor Ganglia (was: YARN Queue metrics

[jira] [Commented] (YARN-1041) RM to bind and notify a restarted AM of existing containers

[ https://issues.apache.org/jira/browse/YARN-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732723#comment-13732723 ] Alejandro Abdelnur commented on YARN-1041: -- Currently, if an AM wants to support

[jira] [Commented] (YARN-1036) Distributed Cache gives inconsistent result if cache files get deleted from task tracker

[ https://issues.apache.org/jira/browse/YARN-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732731#comment-13732731 ] Ravi Prakash commented on YARN-1036: [~ojoshi] bq. (here we don't want to check

[jira] [Commented] (YARN-1036) Distributed Cache gives inconsistent result if cache files get deleted from task tracker

[ https://issues.apache.org/jira/browse/YARN-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732738#comment-13732738 ] Ravi Prakash commented on YARN-1036: In the way you suggest {quote} {code} case

[jira] [Commented] (YARN-1036) Distributed Cache gives inconsistent result if cache files get deleted from task tracker

[ https://issues.apache.org/jira/browse/YARN-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732743#comment-13732743 ] Omkar Vinit Joshi commented on YARN-1036: - [~raviprak] no it is actually not doing

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: (was: YARN-1021-demo.tar.gz) Yarn Scheduler Load Simulator -

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021-demo.tar.gz Yarn Scheduler Load Simulator -

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021.patch Update a patch to remove javac findbugs warnings. As the simulator uses jquery.js

[jira] [Commented] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732774#comment-13732774 ] Hadoop QA commented on YARN-1021: - {color:red}-1 overall{color}. Here are the results of

[jira] [Assigned] (YARN-1043) YARN Queue metrics are getting pushed to neither file nor Ganglia

[ https://issues.apache.org/jira/browse/YARN-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-1043: - Assignee: Jian He YARN Queue metrics are getting pushed to neither file nor Ganglia

[jira] [Updated] (YARN-1043) YARN Queue metrics are getting pushed to neither file nor Ganglia

[ https://issues.apache.org/jira/browse/YARN-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1043: -- Attachment: YARN-1043.patch Uploaded a patch to address this issue YARN Queue metrics are

[jira] [Updated] (YARN-1036) Distributed Cache gives inconsistent result if cache files get deleted from task tracker

[ https://issues.apache.org/jira/browse/YARN-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated YARN-1036: --- Attachment: YARN-1036.branch-0.23.patch Distributed Cache gives inconsistent result if cache

[jira] [Commented] (YARN-1043) YARN Queue metrics are getting pushed to neither file nor Ganglia

[ https://issues.apache.org/jira/browse/YARN-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732819#comment-13732819 ] Jian He commented on YARN-1043: --- Tested on single node cluster, all the metrics can show up

[jira] [Commented] (YARN-1036) Distributed Cache gives inconsistent result if cache files get deleted from task tracker

[ https://issues.apache.org/jira/browse/YARN-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732824#comment-13732824 ] Hadoop QA commented on YARN-1036: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732829#comment-13732829 ] Hadoop QA commented on YARN-1021: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021.patch New patch for excluding license checks for d3.js and jquery.js.

[jira] [Commented] (YARN-1043) YARN Queue metrics are getting pushed to neither file nor Ganglia

[ https://issues.apache.org/jira/browse/YARN-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732860#comment-13732860 ] Hadoop QA commented on YARN-1043: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-353) Add Zookeeper-based store implementation for RMStateStore

[ https://issues.apache.org/jira/browse/YARN-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732868#comment-13732868 ] Hitesh Shah commented on YARN-353: -- Comments: Identation still off in yarn-default.xml

[jira] [Updated] (YARN-987) Adding History Service to use Store and converting Historydata to Report

[ https://issues.apache.org/jira/browse/YARN-987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-987: --- Summary: Adding History Service to use Store and converting Historydata to Report (was:

[jira] [Commented] (YARN-987) Adding History Service to use Store and converting Historydata to Report

[ https://issues.apache.org/jira/browse/YARN-987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732875#comment-13732875 ] Mayank Bansal commented on YARN-987: I am adding the History service which use of store

[jira] [Commented] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732873#comment-13732873 ] Hadoop QA commented on YARN-1021: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-987) Adding History Service to use Store and converting Historydata to Report

[ https://issues.apache.org/jira/browse/YARN-987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-987: --- Attachment: YARN-987-1.patch Attaching patch Thanks, Mayank Adding History Service

[jira] [Commented] (YARN-1036) Distributed Cache gives inconsistent result if cache files get deleted from task tracker

[ https://issues.apache.org/jira/browse/YARN-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732887#comment-13732887 ] Omkar Vinit Joshi commented on YARN-1036: - Thanks for updating it... few more

[jira] [Commented] (YARN-1041) RM to bind and notify a restarted AM of existing containers

[ https://issues.apache.org/jira/browse/YARN-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732935#comment-13732935 ] Steve Loughran commented on YARN-1041: -- AFAIK, currently, if the AM fails then all its

[jira] [Created] (YARN-1044) used/min/max resources do not display info in the scheduler page

Sangjin Lee created YARN-1044: - Summary: used/min/max resources do not display info in the scheduler page Key: YARN-1044 URL: https://issues.apache.org/jira/browse/YARN-1044 Project: Hadoop YARN

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1044: -- Attachment: screenshot.png If you look at the source html, the values are there. They are like

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1044: -- Description: Go to the scheduler page in RM, and click any queue to display the detailed info. You'll

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-1044: Labels: newbie (was: ) used/min/max resources do not display info in the scheduler

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-1044: Component/s: scheduler used/min/max resources do not display info in the scheduler

[jira] [Commented] (YARN-1044) used/min/max resources do not display info in the scheduler page

[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13733023#comment-13733023 ] Jian He commented on YARN-1044: --- For configuring capacity values, no need to put brackets

[jira] [Created] (YARN-1045) Improve toString implementation for PBImpls

Siddharth Seth created YARN-1045: Summary: Improve toString implementation for PBImpls Key: YARN-1045 URL: https://issues.apache.org/jira/browse/YARN-1045 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-313) Add Admin API for supporting node resource configuration in command line

[ https://issues.apache.org/jira/browse/YARN-313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-313: Description: We should provide some admin interface, e.g. yarn rmadmin -refreshResources to support changes

[jira] [Updated] (YARN-1043) YARN Queue metrics are getting pushed to neither file nor Ganglia

[ https://issues.apache.org/jira/browse/YARN-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1043: -- Attachment: YARN-1043.1.patch updated the test case YARN Queue metrics are getting pushed to

[jira] [Commented] (YARN-353) Add Zookeeper-based store implementation for RMStateStore

[ https://issues.apache.org/jira/browse/YARN-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13733127#comment-13733127 ] Jian He commented on YARN-353: -- Go ahead, thanks for that, Karthik ! Add

[jira] [Commented] (YARN-353) Add Zookeeper-based store implementation for RMStateStore

[ https://issues.apache.org/jira/browse/YARN-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13733164#comment-13733164 ] Jian He commented on YARN-353: -- bq. why the catch and re-throw? The intention was leaving there

[jira] [Commented] (YARN-1040) Add ability to execute multiple programs in the same long-lived container

[ https://issues.apache.org/jira/browse/YARN-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13733172#comment-13733172 ] Bikas Saha commented on YARN-1040: -- Key idea is to not associate a container with a single

[jira] [Commented] (YARN-624) Support gang scheduling in the AM RM protocol

[ https://issues.apache.org/jira/browse/YARN-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13733177#comment-13733177 ] Bikas Saha commented on YARN-624: - RM currently expects something to start in a container