[jira] [Commented] (YARN-321) Generic application history service

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353825#comment-14353825 ] Allen Wittenauer commented on YARN-321: --- Looks like this should get closed out w/a fix

[jira] [Commented] (YARN-321) Generic application history service

2014-07-28 Thread Patrick Morton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14076080#comment-14076080 ] Patrick Morton commented on YARN-321: - Compared to wrists well is less available status

[jira] [Commented] (YARN-321) Generic application history service

2014-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13887745#comment-13887745 ] Hudson commented on YARN-321: - SUCCESS: Integrated in Hadoop-Hdfs-trunk #1659 (See [https://bui

[jira] [Commented] (YARN-321) Generic application history service

2014-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13887731#comment-13887731 ] Hudson commented on YARN-321: - FAILURE: Integrated in Hadoop-Mapreduce-trunk #1684 (See [https:

[jira] [Commented] (YARN-321) Generic application history service

2014-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13887647#comment-13887647 ] Hudson commented on YARN-321: - SUCCESS: Integrated in Hadoop-Yarn-trunk #467 (See [https://buil

[jira] [Commented] (YARN-321) Generic application history service

2014-01-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13887036#comment-13887036 ] Hudson commented on YARN-321: - SUCCESS: Integrated in Hadoop-trunk-Commit #5074 (See [https://b

[jira] [Commented] (YARN-321) Generic application history service

2014-01-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13882302#comment-13882302 ] Hudson commented on YARN-321: - SUCCESS: Integrated in Hadoop-Hdfs-trunk #1654 (See [https://bui

[jira] [Commented] (YARN-321) Generic application history service

2014-01-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13882297#comment-13882297 ] Hudson commented on YARN-321: - FAILURE: Integrated in Hadoop-Mapreduce-trunk #1679 (See [https:

[jira] [Commented] (YARN-321) Generic application history service

2014-01-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13882274#comment-13882274 ] Hudson commented on YARN-321: - SUCCESS: Integrated in Hadoop-Yarn-trunk #462 (See [https://buil

[jira] [Commented] (YARN-321) Generic application history service

2014-01-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13882206#comment-13882206 ] Hudson commented on YARN-321: - SUCCESS: Integrated in Hadoop-trunk-Commit #5040 (See [https://b

[jira] [Commented] (YARN-321) Generic application history service

2014-01-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13882176#comment-13882176 ] Hudson commented on YARN-321: - SUCCESS: Integrated in Hadoop-trunk-Commit #5039 (See [https://b

[jira] [Commented] (YARN-321) Generic application history service

2014-01-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13868043#comment-13868043 ] Zhijie Shen commented on YARN-321: -- bq. 1. Does it provide a function to set maximum files

[jira] [Commented] (YARN-321) Generic application history service

2014-01-07 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865140#comment-13865140 ] Shinichi Yamashita commented on YARN-321: - I confirmed attached design document. And

[jira] [Commented] (YARN-321) Generic application history service

2013-12-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13856021#comment-13856021 ] Vinod Kumar Vavilapalli commented on YARN-321: -- Tx Zhijie for answering most of

[jira] [Commented] (YARN-321) Generic application history service

2013-12-23 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13855707#comment-13855707 ] Robert Joseph Evans commented on YARN-321: -- The way it currently works is based off

[jira] [Commented] (YARN-321) Generic application history service

2013-12-20 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13853830#comment-13853830 ] Bikas Saha commented on YARN-321: - What is the jira for app specific history data? Could yo

[jira] [Commented] (YARN-321) Generic application history service

2013-12-19 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13853492#comment-13853492 ] Zhijie Shen commented on YARN-321: -- AFAIK, bq. Will the AHS serve logs? It will serve the

[jira] [Commented] (YARN-321) Generic application history service

2013-12-19 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13853439#comment-13853439 ] Sandy Ryza commented on YARN-321: - Thanks Vinod for the design doc. A few additional questi

[jira] [Commented] (YARN-321) Generic application history service

2013-12-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13838599#comment-13838599 ] Zhijie Shen commented on YARN-321: -- bq. Thanks Shen. Is there any estimation for the releas

[jira] [Commented] (YARN-321) Generic application history service

2013-12-03 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13838492#comment-13838492 ] Jeff Zhang commented on YARN-321: - Thanks Shen. Is there any estimation for the release of 2

[jira] [Commented] (YARN-321) Generic application history service

2013-12-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13838096#comment-13838096 ] Zhijie Shen commented on YARN-321: -- bq. Will this jira been included in the next release ?

[jira] [Commented] (YARN-321) Generic application history service

2013-12-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13837281#comment-13837281 ] Jeff Zhang commented on YARN-321: - Another question about this jira. I found that the contai

[jira] [Commented] (YARN-321) Generic application history service

2013-12-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13837276#comment-13837276 ] Jeff Zhang commented on YARN-321: - Will this jira been included in the next release ? > Gen

[jira] [Commented] (YARN-321) Generic application history service

2013-10-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13790604#comment-13790604 ] Zhijie Shen commented on YARN-321: -- bq. I like the diagrams, but I want to understand if th

[jira] [Commented] (YARN-321) Generic application history service

2013-10-09 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13790555#comment-13790555 ] Robert Joseph Evans commented on YARN-321: -- I like the diagrams, but I want to unde

[jira] [Commented] (YARN-321) Generic application history service

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13790047#comment-13790047 ] Sandy Ryza commented on YARN-321: - Thanks Vinod and Zhijie. Didn't see the comment. I'm go

[jira] [Commented] (YARN-321) Generic application history service

2013-10-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13789951#comment-13789951 ] Vinod Kumar Vavilapalli commented on YARN-321: -- I assumed this is a well known

[jira] [Commented] (YARN-321) Generic application history service

2013-10-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13789876#comment-13789876 ] Sandy Ryza commented on YARN-321: - Was a design doc ever written up for this? The HistorySt

[jira] [Commented] (YARN-321) Generic application history service

2013-07-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713204#comment-13713204 ] Bikas Saha commented on YARN-321: - Sounds right. > Generic application hist

[jira] [Commented] (YARN-321) Generic application history service

2013-07-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13712796#comment-13712796 ] Zhijie Shen commented on YARN-321: -- bq. Running as service: By default, ApplicationHistoryS

[jira] [Commented] (YARN-321) Generic application history service

2013-07-18 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13712546#comment-13712546 ] Karthik Kambatla commented on YARN-321: --- bq. Folks, it would be great if we have a con

[jira] [Commented] (YARN-321) Generic application history service

2013-07-17 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13711345#comment-13711345 ] Bikas Saha commented on YARN-321: - Folks, it would be great if we have a consolidated docume

[jira] [Commented] (YARN-321) Generic application history service

2013-07-16 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13709991#comment-13709991 ] Vinod Kumar Vavilapalli commented on YARN-321: -- I just created YARN-321 branch

[jira] [Commented] (YARN-321) Generic application history service

2013-07-16 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13709989#comment-13709989 ] Vinod Kumar Vavilapalli commented on YARN-321: -- bq. How about starting with an

[jira] [Commented] (YARN-321) Generic application history service

2013-07-16 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13709966#comment-13709966 ] Mayank Bansal commented on YARN-321: I think History storage should be written by AHS no

[jira] [Commented] (YARN-321) Generic application history service

2013-07-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13709940#comment-13709940 ] Karthik Kambatla commented on YARN-321: --- The approach in HistoryStorageDemo looks good

[jira] [Commented] (YARN-321) Generic application history service

2013-07-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13709262#comment-13709262 ] Jason Lowe commented on YARN-321: - bq. Is there a reason to embed this inside the RM? I don'

[jira] [Commented] (YARN-321) Generic application history service

2013-07-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13709192#comment-13709192 ] Karthik Kambatla commented on YARN-321: --- Few other considerations: bq. Running as ser

[jira] [Commented] (YARN-321) Generic application history service

2013-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13709098#comment-13709098 ] Zhijie Shen commented on YARN-321: -- bq. Is it per application or only one thread in RM? I

[jira] [Commented] (YARN-321) Generic application history service

2013-07-15 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13709030#comment-13709030 ] Mayank Bansal commented on YARN-321: Overall Looks good, However some points to consider

[jira] [Commented] (YARN-321) Generic application history service

2013-07-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13706773#comment-13706773 ] Zhijie Shen commented on YARN-321: -- bq. Are we moving aggregated log management(i.e deletio

[jira] [Commented] (YARN-321) Generic application history service

2013-07-12 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13706753#comment-13706753 ] Devaraj K commented on YARN-321: I agree Zhijie Shen. In the above comment, I mean JHS cur

[jira] [Commented] (YARN-321) Generic application history service

2013-07-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13706730#comment-13706730 ] Zhijie Shen commented on YARN-321: -- bq. How about the Job History Server which is currently

[jira] [Commented] (YARN-321) Generic application history service

2013-07-11 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13706699#comment-13706699 ] Devaraj K commented on YARN-321: bq. *Aggregated logs:* Logs will be served and potentially

[jira] [Commented] (YARN-321) Generic application history service

2013-07-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13706686#comment-13706686 ] Zhijie Shen commented on YARN-321: -- bq. ResoureManager will write per-application data to a

[jira] [Commented] (YARN-321) Generic application history service

2013-07-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13706673#comment-13706673 ] Zhijie Shen commented on YARN-321: -- bq. To start with, we will have an implementation with

[jira] [Commented] (YARN-321) Generic application history service

2013-07-11 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13706654#comment-13706654 ] Vinod Kumar Vavilapalli commented on YARN-321: -- Like I mentioned: bq. Querying

[jira] [Commented] (YARN-321) Generic application history service

2013-07-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13706645#comment-13706645 ] Hitesh Shah commented on YARN-321: -- {quote} To start with, we will have an implementation w

[jira] [Commented] (YARN-321) Generic application history service

2013-07-11 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13706553#comment-13706553 ] Vinod Kumar Vavilapalli commented on YARN-321: -- Fundamentally, this JIRA is to