[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2017-04-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15967137#comment-15967137 ] Haibo Chen commented on YARN-4061: -- [~jrottinghuis] do you think we should at least target this at hadoop

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2017-04-06 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959393#comment-15959393 ] Joep Rottinghuis commented on YARN-4061: I'm removing the yarn-5355-merge-blocker label not

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2017-02-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889016#comment-15889016 ] Haibo Chen commented on YARN-4061: -- I found this during my attempt to do coprocessor refactoring and did

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2017-02-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888979#comment-15888979 ] Sangjin Lee commented on YARN-4061: --- [~haibochen], is your comment a general comment on what that method

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2017-02-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888753#comment-15888753 ] Haibo Chen commented on YARN-4061: -- I notice that in FlowAcitivityColumnPrefix.store(byte[] rowKey,

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-12-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762438#comment-15762438 ] Li Lu commented on YARN-4061: - Thanks [~jrottinghuis]! bq. For our usecase, that makes the puts idempotent.

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-12-16 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15756464#comment-15756464 ] Joep Rottinghuis commented on YARN-4061: [~gtCarrera9] I've filed a separate jira HBASE-17327 to be

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-12-16 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15755117#comment-15755117 ] Joep Rottinghuis commented on YARN-4061: For the next version of the patch I'll modify the code so

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-12-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15752682#comment-15752682 ] Li Lu commented on YARN-4061: - I went through the new design doc in HBASE-17018 and I think it's mostly good.

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-12-13 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746555#comment-15746555 ] Joep Rottinghuis commented on YARN-4061: Attached an updated design for a SpoolingBufferedMutator

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-11-03 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15634966#comment-15634966 ] Joep Rottinghuis commented on YARN-4061: Opened HBASE-17018 and attached a pdf of my doc there. >

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-10-20 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592611#comment-15592611 ] Joep Rottinghuis commented on YARN-4061: You do bring up an interesting question [~gtCarrera9], and

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-10-11 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566718#comment-15566718 ] Li Lu commented on YARN-4061: - Thanks [~jrottinghuis]! So our current plan is to extend the buffered mutator

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-09-29 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15532914#comment-15532914 ] Joep Rottinghuis commented on YARN-4061: Potential additional challenge, to serialize mutations (in

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-09-28 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15530324#comment-15530324 ] Joep Rottinghuis commented on YARN-4061: HBASE-12728 introduced the BufferedMutator. > [Fault

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-09-28 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529989#comment-15529989 ] Joep Rottinghuis commented on YARN-4061: I'm going to write up some requirements for what we'd want

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-08-03 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15406938#comment-15406938 ] Li Lu commented on YARN-4061: - Let me revive this thread after the branch merge. From some offline discussion

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2016-02-04 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15132936#comment-15132936 ] Vrushali C commented on YARN-4061: -- Need to handle aggregation/compaction correctly in case of hbase

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2015-10-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943999#comment-14943999 ] Sangjin Lee commented on YARN-4061: --- Sorry it took me a while to get to this. Thanks for the proposal

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2015-10-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944009#comment-14944009 ] Sangjin Lee commented on YARN-4061: --- Another thing to consider is also the throughput of writing to

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2015-10-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944067#comment-14944067 ] Li Lu commented on YARN-4061: - Thanks for the review [~sjlee0]! bq. Since the actual storage writer (HBase)

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2015-10-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944200#comment-14944200 ] Sangjin Lee commented on YARN-4061: --- I don't think the MR JHS is an apt comparison. First, we're dealing

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2015-08-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14711671#comment-14711671 ] Junping Du commented on YARN-4061: -- Thanks [~gtCarrera9] for working on a document for

[jira] [Commented] (YARN-4061) [Fault tolerance] Fault tolerant writer for timeline v2

2015-08-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14710384#comment-14710384 ] Li Lu commented on YARN-4061: - I just realized that if we implement our logger on HDFS, we need