Re: Weird serialization bug?

Have you tried making fooo static ? Cheers On Sat, Apr 29, 2017 at 4:26 AM, Sebastian Neef < gehax...@mailbox.tu-berlin.de> wrote: > Hello Apache Flink users, > > I implemented a FilterFunction some months ago that worked quite well > back then. However, I wanted to check it out right now and it

Re: CEP timeout occurs even for a successful match when using followedBy

Hi Moiz, Here are the instructions on how to build Flink from source: https://ci.apache.org/projects/flink/flink-docs-release-1.2/setup/building.html Kostas > On Apr 29, 2017, at 7:15 PM, Moiz S Jinia wrote: >

Re: CEP timeout occurs even for a successful match when using followedBy

I meant maven dependencies that i can use by generating them from sources. On Sat, Apr 29, 2017 at 10:31 PM, Moiz S Jinia wrote: > Ok I'll try that. Its just that I'd rather use a stable version. > Are there any instructions for building binaries from latest sources? > > Moiz > > On Sat, Apr 29,

Re: CEP timeout occurs even for a successful match when using followedBy

Ok I'll try that. Its just that I'd rather use a stable version. Are there any instructions for building binaries from latest sources? Moiz On Sat, Apr 29, 2017 at 10:09 PM, Kostas Kloudas < k.klou...@data-artisans.com> wrote: > Hi Moiz, > > The skip-till-next is a big change and backporting it

Re: CEP timeout occurs even for a successful match when using followedBy

Hi Moiz, The skip-till-next is a big change and backporting it does not seem feasible. Also this would require more general changes to the 1.2 to make it compatible with the previous 1.2 versions. If you want you can already use the 1.3 version by downloading the master branch and writing your

Re: CEP timeout occurs even for a successful match when using followedBy

Oh ok thats a bit far off. Is there any chance of a backport of https://issues.apache.org/jira/browse/FLINK-6208 to the 1.2 branch? I require the SKIP_TILL_NEXT behaviour for a production use case that we want to use Flink for. Moiz On Sat, Apr 29, 2017 at 9:49 PM, Kostas Kloudas wrote: > The 1

Re: CEP timeout occurs even for a successful match when using followedBy

The 1.3 is scheduled for the beginning of June. Cheers, Kostas > On Apr 29, 2017, at 6:16 PM, Moiz S Jinia wrote: > > Thanks Dawid! > Yes thats what i was expecting. I'll give it a try. > > When do you expect 1.3.0 stable to be out? > > Moiz > > On Sat, Apr 29, 2017 at 9:20 PM, Dawid Wysako

Re: CEP timeout occurs even for a successful match when using followedBy

Thanks Dawid! Yes thats what i was expecting. I'll give it a try. When do you expect 1.3.0 stable to be out? Moiz On Sat, Apr 29, 2017 at 9:20 PM, Dawid Wysakowicz < wysakowicz.da...@gmail.com> wrote: > Hi, > > This is an expected behaviour. After the "ar" event there still may occur > other "a

Re: Periodic flush sink?

Thanks. The specific table I have here is used to debugging purposes so at the HBase level I set a TTL of the data of 12 hours. So I'm not worrying about the Hfiles. Doing a lot of 'small' calls has an impact on HBase as a whole (not just this table) so I want buffering. Having a buffer that can h

Re: CEP timeout occurs even for a successful match when using followedBy

Hi, This is an expected behaviour. After the "ar" event there still may occur other "ar" event that will also trigger a match. To be more generic in all versions prior to 1.3.0 there are two different consuming strategies: - STRICT (the next operator) - that accepts only if the event occurs

Re: Periodic flush sink?

I expect Flink expert to answer your question. bq. I get a flush of the buffers atleast every few seconds >From hbase point of view, during low traffic period, the above may result in many small hfiles, leading to more work for the compaction. FYI On Sat, Apr 29, 2017 at 7:32 AM, Niels Basjes

Re: Disk I/O in Flink

Hey Martin, I'm still on it. I have switched to analyzing the flink-runtime tests, as I observe similar divergence there. I'm not sure how long it'll take, but if I find something I'll make sure to let you all know :) Robert On Sat, Apr 29, 2017 at 3:12 PM, Martin Eden wrote: > Hi Robert, > >

Periodic flush sink?

Hi, I have a sink that writes my records into HBase. The data stream is attached to measurements from an internal testing instance of the website. As a consequence there are periods of really high load (someone is doing a load test) and really low load (only a hand full of people are testing stuf

Re: Disk I/O in Flink

Hi Robert, Any updates on the below for the community? Thanks, M On Tue, Apr 25, 2017 at 8:50 AM, Robert Schmidtke wrote: > Hi Ufuk, thanks for coming back to me on this. > > The records are 100 bytes in size, the benchmark being TeraSort, so that > should not be an issue. I have played around

Weird serialization bug?

Hello Apache Flink users, I implemented a FilterFunction some months ago that worked quite well back then. However, I wanted to check it out right now and it somehow broke in the sense that Flink can't serialize it anymore. I might be mistaken, but afaik I didn't touch the code at all. I think th

CEP timeout occurs even for a successful match when using followedBy

When using "next", this pattern works fine for the both a match as well as a timeout: Pattern pattern = Pattern.begin("start") .where(evt -> evt.value.equals("ni")) .next("last").where(evt -> evt.value.equals("ar")).within(Time.seconds(5)); 1. "ni" then "ar" within 5 seconds - tri

Batch source improvement

Hi to all, we're still using Flink as a batch processor and despite not very advertised is still doing great. However there's one thing I always wanted to ask: when reading data from a source the job manager computes the splits and assigns a set of them to every instance of the InputFormat. This wo

Collector.collect

Hello I am working on RichProcessFunction and I want to emit multiple records at a time. To achieve this, I am currently doing : while(condition) { Collector.collect(new Tuple<>...); } I was wondering, is this the correct way or there is any other alternative.

Re: Fault tolerance & idempotency on window functions

Big thanks for replying Aljoscha, I spend quite some time on thinking how to solve this problem and came to some conclusions. Would be cool if you can verify if my logic is correct. I decided that if I will partition data in kafka in the same way as I partition my window with keyby. It's tenant, u

Re: Behavior of the cancel command

Hi Aljoscha, In my case the valid-length file created contains a value which e.g. says 100 MB are valid to read for exactly once but the file with the data is only 95 MB large. As I understand it the valid-length file contains the length of the file at the checkpoint. This does also not happe