[GitHub] flink issue #2332: [FLINK-2055] Implement Streaming HBaseSink

2017-05-30 Thread nragon
Github user nragon commented on the issue: https://github.com/apache/flink/pull/2332 Indeed, I'm also not aware of how users use it. I would take a similiar approach than c*, already in made for streaming, seems to use a existing async api from datastax. But again, I couldn&#

[GitHub] flink issue #2332: [FLINK-2055] Implement Streaming HBaseSink

2017-05-30 Thread nragon
Github user nragon commented on the issue: https://github.com/apache/flink/pull/2332 No, only puts. Aggregation is coming from a reduce which by itself aggregates, keeping recent values on hbase, more like snapshots I think. During our analysis sending data to hbase was only reliable

[GitHub] flink issue #2332: [FLINK-2055] Implement Streaming HBaseSink

2017-05-29 Thread nragon
Github user nragon commented on the issue: https://github.com/apache/flink/pull/2332 From my point of view, my sample works fine (my use case) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] flink issue #2332: [FLINK-2055] Implement Streaming HBaseSink

2017-05-19 Thread nragon
Github user nragon commented on the issue: https://github.com/apache/flink/pull/2332 I've made a custom solution which works for my use cases. Notice that the code attached is not working because it's only a skeleton. This prototype uses asynchbase and tries to manage

[GitHub] flink issue #2332: [FLINK-2055] Implement Streaming HBaseSink

2017-05-17 Thread nragon
Github user nragon commented on the issue: https://github.com/apache/flink/pull/2332 Currently trying to fix some throttling issues, reported here https://github.com/OpenTSDB/asynchbase/issues/162 --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] flink issue #2332: [FLINK-2055] Implement Streaming HBaseSink

2017-05-16 Thread nragon
Github user nragon commented on the issue: https://github.com/apache/flink/pull/2332 Hi, I'm testing one my self with a third party library, http://opentsdb.github.io/asynchbase. I'm following a simliar approach as cassandra sink. Testing it as we speak. Thanks -

[GitHub] flink issue #2332: [FLINK-2055] Implement Streaming HBaseSink

2017-05-16 Thread nragon
Github user nragon commented on the issue: https://github.com/apache/flink/pull/2332 Any updates on this sink? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] flink pull request #3642: SignalWindow

2017-03-30 Thread nragon
Github user nragon closed the pull request at: https://github.com/apache/flink/pull/3642 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink issue #3642: SignalWindow

2017-03-30 Thread nragon
Github user nragon commented on the issue: https://github.com/apache/flink/pull/3642 Also, relating this. You think keeping a value state within the trigger would be better instead of using a window attribute to save the signal event timestamp? --- If your project is set up for it

[GitHub] flink issue #3642: SignalWindow

2017-03-30 Thread nragon
Github user nragon commented on the issue: https://github.com/apache/flink/pull/3642 @StephanEwen would this implementation work? In you opinion, at first sight :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] flink issue #3642: SignalWindow

2017-03-29 Thread nragon
Github user nragon commented on the issue: https://github.com/apache/flink/pull/3642 @StephanEwen I'm doing some test with this type of window. I'll try to see some other way (hash related as you said) --- If your project is set up for it, you can reply to this email and

[GitHub] flink pull request #3639: Update TimeWindow.java

2017-03-29 Thread nragon
Github user nragon closed the pull request at: https://github.com/apache/flink/pull/3639 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink issue #3639: Update TimeWindow.java

2017-03-29 Thread nragon
Github user nragon commented on the issue: https://github.com/apache/flink/pull/3639 Closing due to #3642 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] flink issue #3642: SignalWindow

2017-03-29 Thread nragon
Github user nragon commented on the issue: https://github.com/apache/flink/pull/3642 But the hash code and equals remais the same, just like in TimeWindow. The only difference is that we can merge and control signaled events. --- If your project is set up for it, you can reply to

[GitHub] flink pull request #3642: SignalWindow

2017-03-29 Thread nragon
GitHub user nragon opened a pull request: https://github.com/apache/flink/pull/3642 SignalWindow Related with https://github.com/apache/flink/pull/3639 but might be better with a new window. This concept can also be represented with a state on trigger keeping the signaled

[GitHub] flink pull request #3639: Update TimeWindow.java

2017-03-29 Thread nragon
GitHub user nragon opened a pull request: https://github.com/apache/flink/pull/3639 Update TimeWindow.java A method to update the time window max timestamp would be useful when we need control the max timestamp based on events. For instance a session time window may end after the

[GitHub] flink issue #3554: Detached (Remote)StreamEnvironment execution

2017-03-16 Thread nragon
Github user nragon commented on the issue: https://github.com/apache/flink/pull/3554 I guess for backward compatibility this last commig would do. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] flink pull request #3554: Detached (Remote)StreamEnvironment execution

2017-03-16 Thread nragon
GitHub user nragon opened a pull request: https://github.com/apache/flink/pull/3554 Detached (Remote)StreamEnvironment execution Thanks for contributing to Apache Flink. Before you open your pull request, please take the following check list into consideration. If your changes

[GitHub] flink issue #2332: [FLINK-2055] Implement Streaming HBaseSink

2017-03-01 Thread nragon
Github user nragon commented on the issue: https://github.com/apache/flink/pull/2332 Hi :) I needed to use hbase as sink so i decided to take a look at this pull a use it. Current changes that might be interesting: Like hbase connector for dataset, it's possib