[jira] [Assigned] (YARN-1307) Rethink znode structure for RM HA

[ https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA reassigned YARN-1307: Assignee: Tsuyoshi OZAWA Rethink znode structure for RM HA

[jira] [Commented] (YARN-1139) [Umbrella] Convert all RM components to Services

[ https://issues.apache.org/jira/browse/YARN-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13797804#comment-13797804 ] Steve Loughran commented on YARN-1139: -- # you don't need to convert any exceptions

[jira] [Commented] (YARN-1068) Add admin support for HA operations

[ https://issues.apache.org/jira/browse/YARN-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798043#comment-13798043 ] Vinod Kumar Vavilapalli commented on YARN-1068: --- bq. IIUC, the suggestion is

[jira] [Commented] (YARN-1307) Rethink znode structure for RM HA

[ https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798061#comment-13798061 ] Karthik Kambatla commented on YARN-1307: [~ozawa], if you haven't already started

[jira] [Commented] (YARN-1222) Make improvements in ZKRMStateStore for fencing

[ https://issues.apache.org/jira/browse/YARN-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798062#comment-13798062 ] Karthik Kambatla commented on YARN-1222: Yep. It is better to work on them

[jira] [Commented] (YARN-1307) Rethink znode structure for RM HA

[ https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798067#comment-13798067 ] Tsuyoshi OZAWA commented on YARN-1307: -- Thanks for your review, Vinod and Jian!

[jira] [Commented] (YARN-1307) Rethink znode structure for RM HA

[ https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798070#comment-13798070 ] Tsuyoshi OZAWA commented on YARN-1307: -- [~kkambatl], sure, no problem. Rethink znode

[jira] [Commented] (YARN-1307) Rethink znode structure for RM HA

[ https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798120#comment-13798120 ] Bikas Saha commented on YARN-1307: -- I dont see much value in creating extra hierarchy for

[jira] [Commented] (YARN-1307) Rethink znode structure for RM HA

[ https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798122#comment-13798122 ] Bikas Saha commented on YARN-1307: -- Jira messed up the tree in previous comment. Here it

[jira] [Updated] (YARN-956) [YARN-321] Add a testable in-memory HistoryStorage

[ https://issues.apache.org/jira/browse/YARN-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-956: - Attachment: YARN-956.4.patch I uploaded a new patch, which completely rewrites the

[jira] [Updated] (YARN-947) Defining the history data classes for the implementation of the reading/writing interface

[ https://issues.apache.org/jira/browse/YARN-947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-947: - Attachment: YARN-947.4.patch Update the patch again to fix the bug in newInstance of

[jira] [Commented] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798154#comment-13798154 ] Vinod Kumar Vavilapalli commented on YARN-807: -- Filed YARN-1317 for the Queue

[jira] [Created] (YARN-1317) Make Queue, QueueACLs and QueueMetrics first class citizens in YARN

Vinod Kumar Vavilapalli created YARN-1317: - Summary: Make Queue, QueueACLs and QueueMetrics first class citizens in YARN Key: YARN-1317 URL: https://issues.apache.org/jira/browse/YARN-1317

[jira] [Commented] (YARN-947) Defining the history data classes for the implementation of the reading/writing interface

[ https://issues.apache.org/jira/browse/YARN-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798157#comment-13798157 ] Hadoop QA commented on YARN-947: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-956) [YARN-321] Add a testable in-memory HistoryStorage

[ https://issues.apache.org/jira/browse/YARN-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798174#comment-13798174 ] Hadoop QA commented on YARN-956: {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-891) Store completed application information in RM state store

[ https://issues.apache.org/jira/browse/YARN-891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-891: - Attachment: YARN-891.patch New patch with minor fix Store completed application information in RM state store

[jira] [Updated] (YARN-891) Store completed application information in RM state store

[ https://issues.apache.org/jira/browse/YARN-891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-891: - Attachment: YARN-891.patch upload a patch, details - Add a new field finalState in ApplicationState and

[jira] [Commented] (YARN-891) Store completed application information in RM state store

[ https://issues.apache.org/jira/browse/YARN-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798267#comment-13798267 ] Hadoop QA commented on YARN-891: {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-891) Store completed application information in RM state store

[ https://issues.apache.org/jira/browse/YARN-891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-891: - Attachment: YARN-891.patch Store completed application information in RM state store

[jira] [Commented] (YARN-1222) Make improvements in ZKRMStateStore for fencing

[ https://issues.apache.org/jira/browse/YARN-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798270#comment-13798270 ] Tsuyoshi OZAWA commented on YARN-1222: -- In YARN-1307, [~kkambatl] mentioned that the

[jira] [Commented] (YARN-1307) Rethink znode structure for RM HA

[ https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798273#comment-13798273 ] Tsuyoshi OZAWA commented on YARN-1307: -- OK, the design by Bikas looks good to me. I'll

[jira] [Commented] (YARN-891) Store completed application information in RM state store

[ https://issues.apache.org/jira/browse/YARN-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798276#comment-13798276 ] Hadoop QA commented on YARN-891: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-891) Store completed application information in RM state store

[ https://issues.apache.org/jira/browse/YARN-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798303#comment-13798303 ] Hadoop QA commented on YARN-891: {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1222) Make improvements in ZKRMStateStore for fencing

[ https://issues.apache.org/jira/browse/YARN-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1222: --- Attachment: yarn-1222-2.patch Here is an updated patch on recent trunk. I am yet to add unit

[jira] [Created] (YARN-1318) Promote AdminService to an Always-On service

Karthik Kambatla created YARN-1318: -- Summary: Promote AdminService to an Always-On service Key: YARN-1318 URL: https://issues.apache.org/jira/browse/YARN-1318 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-1222) Make improvements in ZKRMStateStore for fencing

[ https://issues.apache.org/jira/browse/YARN-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798325#comment-13798325 ] Karthik Kambatla commented on YARN-1222: Have tested this manually on a cluster and

[jira] [Updated] (YARN-1303) Allow multiple commands separating with ; in distributed-shell

[ https://issues.apache.org/jira/browse/YARN-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1303: -- Summary: Allow multiple commands separating with ; in distributed-shell (was:

[jira] [Commented] (YARN-1318) Promote AdminService to an Always-On service

[ https://issues.apache.org/jira/browse/YARN-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798358#comment-13798358 ] Karthik Kambatla commented on YARN-1318: This is more complicated than just moving

[jira] [Commented] (YARN-1222) Make improvements in ZKRMStateStore for fencing

[ https://issues.apache.org/jira/browse/YARN-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798363#comment-13798363 ] Bikas Saha commented on YARN-1222: -- I havent seen the patch. I would expect that logical

[jira] [Commented] (YARN-1068) Add admin support for HA operations

[ https://issues.apache.org/jira/browse/YARN-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798367#comment-13798367 ] Karthik Kambatla commented on YARN-1068: Thanks [~vinodkv]. I do agree that we

[jira] [Commented] (YARN-1222) Make improvements in ZKRMStateStore for fencing

[ https://issues.apache.org/jira/browse/YARN-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798372#comment-13798372 ] Karthik Kambatla commented on YARN-1222: Thanks [~bikassaha]. The patch is exactly

[jira] [Commented] (YARN-1222) Make improvements in ZKRMStateStore for fencing

[ https://issues.apache.org/jira/browse/YARN-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798399#comment-13798399 ] Hadoop QA commented on YARN-1222: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1317) Make Queue, QueueACLs and QueueMetrics first class citizens in YARN

[ https://issues.apache.org/jira/browse/YARN-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798397#comment-13798397 ] Sandy Ryza commented on YARN-1317: -- To add, YARN-1052 covers handling queue ACLs

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798432#comment-13798432 ] Jason Lowe commented on YARN-415: - Thanks for the update Andrey. This change should resolve

[jira] [Updated] (YARN-415) Capture memory utilization at the app-level for chargeback

[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Klochkov updated YARN-415: - Attachment: YARN-415--n7.patch Thanks Jason. Attaching a fixed patch. Capture memory utilization

[jira] [Commented] (YARN-1210) During RM restart, RM should start a new attempt only when previous attempt exits for real

[ https://issues.apache.org/jira/browse/YARN-1210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798485#comment-13798485 ] Omkar Vinit Joshi commented on YARN-1210: - taking it over. During RM restart, RM

[jira] [Assigned] (YARN-1210) During RM restart, RM should start a new attempt only when previous attempt exits for real

[ https://issues.apache.org/jira/browse/YARN-1210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi reassigned YARN-1210: --- Assignee: Omkar Vinit Joshi (was: Jian He) During RM restart, RM should start a new

[jira] [Updated] (YARN-891) Store completed application information in RM state store

[ https://issues.apache.org/jira/browse/YARN-891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-891: - Attachment: YARN-891.patch New patch added one more test case that If Attempt failed while app is still running,

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798532#comment-13798532 ] Hadoop QA commented on YARN-415: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-891) Store completed application information in RM state store

[ https://issues.apache.org/jira/browse/YARN-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798538#comment-13798538 ] Hadoop QA commented on YARN-891: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798535#comment-13798535 ] Jason Lowe commented on YARN-415: - The REST API doc change is a good catch, Kendall. The

[jira] [Updated] (YARN-1210) During RM restart, RM should start a new attempt only when previous attempt exits for real

[ https://issues.apache.org/jira/browse/YARN-1210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-1210: Attachment: YARN-1210.1.patch During RM restart, RM should start a new attempt only when

[jira] [Updated] (YARN-1288) Make Fair Scheduler ACLs more user friendly

[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1288: - Attachment: YARN-1288-2.patch Make Fair Scheduler ACLs more user friendly

[jira] [Commented] (YARN-1288) Make Fair Scheduler ACLs more user friendly

[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798586#comment-13798586 ] Sandy Ryza commented on YARN-1288: -- For the record, the old default behavior was that the

[jira] [Commented] (YARN-1288) Make Fair Scheduler ACLs more user friendly

[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798601#comment-13798601 ] Alejandro Abdelnur commented on YARN-1288: -- +1. Would be possible in the docs to

[jira] [Commented] (YARN-1210) During RM restart, RM should start a new attempt only when previous attempt exits for real

[ https://issues.apache.org/jira/browse/YARN-1210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798620#comment-13798620 ] Omkar Vinit Joshi commented on YARN-1210: - Summarizing current patch. * After

[jira] [Updated] (YARN-891) Store completed application information in RM state store

[ https://issues.apache.org/jira/browse/YARN-891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-891: - Attachment: YARN-891.patch Store completed application information in RM state store

[jira] [Commented] (YARN-1288) Make Fair Scheduler ACLs more user friendly

[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798621#comment-13798621 ] Hadoop QA commented on YARN-1288: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1172) Convert *SecretManagers in the RM to services

[ https://issues.apache.org/jira/browse/YARN-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1172: - Attachment: YARN-1172.3.patch Updated the design and changed *SecretManager to init/start/stop

[jira] [Commented] (YARN-1172) Convert *SecretManagers in the RM to services

[ https://issues.apache.org/jira/browse/YARN-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798640#comment-13798640 ] Hadoop QA commented on YARN-1172: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-891) Store completed application information in RM state store

[ https://issues.apache.org/jira/browse/YARN-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798652#comment-13798652 ] Hadoop QA commented on YARN-891: {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-415) Capture memory utilization at the app-level for chargeback

[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Klochkov updated YARN-415: - Attachment: YARN-415--n8.patch Adding changes in REST API docs to the patch. Capture memory

[jira] [Updated] (YARN-1172) Convert *SecretManagers in the RM to services

[ https://issues.apache.org/jira/browse/YARN-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1172: - Attachment: YARN-1172.4.patch Updated diff format. Convert *SecretManagers in the RM to

[jira] [Commented] (YARN-1172) Convert *SecretManagers in the RM to services

[ https://issues.apache.org/jira/browse/YARN-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798673#comment-13798673 ] Tsuyoshi OZAWA commented on YARN-1172: -- I noticed that I forgot to add some test

[jira] [Commented] (YARN-1172) Convert *SecretManagers in the RM to services

[ https://issues.apache.org/jira/browse/YARN-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798676#comment-13798676 ] Hadoop QA commented on YARN-1172: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798679#comment-13798679 ] Hadoop QA commented on YARN-415: {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1172) Convert *SecretManagers in the RM to services

[ https://issues.apache.org/jira/browse/YARN-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1172: - Attachment: YARN-1172.5.patch Updated a patch to pass compile Convert *SecretManagers in the RM

[jira] [Commented] (YARN-1139) [Umbrella] Convert all RM components to Services

[ https://issues.apache.org/jira/browse/YARN-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798690#comment-13798690 ] Tsuyoshi OZAWA commented on YARN-1139: -- Thank you for sharing the knowledge,

[jira] [Commented] (YARN-1305) RMHAProtocolService#serviceInit should handle HAUtil's IllegalArgumentException

[ https://issues.apache.org/jira/browse/YARN-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798694#comment-13798694 ] Tsuyoshi OZAWA commented on YARN-1305: -- I appreciate if someone can review this JIRA.

[jira] [Commented] (YARN-1172) Convert *SecretManagers in the RM to services

[ https://issues.apache.org/jira/browse/YARN-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798705#comment-13798705 ] Hadoop QA commented on YARN-1172: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1185) FileSystemRMStateStore can leave partial files that prevent subsequent recovery

[ https://issues.apache.org/jira/browse/YARN-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798711#comment-13798711 ] Omkar Vinit Joshi commented on YARN-1185: - Thanks [~vinodkv] and [~jianhe]. bq.

[jira] [Updated] (YARN-1185) FileSystemRMStateStore can leave partial files that prevent subsequent recovery

[ https://issues.apache.org/jira/browse/YARN-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-1185: Attachment: YARN-1185.2.patch FileSystemRMStateStore can leave partial files that prevent

[jira] [Commented] (YARN-1305) RMHAProtocolService#serviceInit should handle HAUtil's IllegalArgumentException

[ https://issues.apache.org/jira/browse/YARN-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798714#comment-13798714 ] Bikas Saha commented on YARN-1305: -- Showing the invalid value will help debugging

[jira] [Commented] (YARN-1185) FileSystemRMStateStore can leave partial files that prevent subsequent recovery

[ https://issues.apache.org/jira/browse/YARN-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798727#comment-13798727 ] Hadoop QA commented on YARN-1185: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1172) Convert *SecretManagers in the RM to services

[ https://issues.apache.org/jira/browse/YARN-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13798793#comment-13798793 ] Hadoop QA commented on YARN-1172: - {color:red}-1 overall{color}. Here are the results of