subject:"CEP memory requirements"

Re: CEP memory requirements

2017-05-04 Thread Dawid Wysakowicz

Yes you are right, prior to 1.3.0 the state per key was never cleared. Right now due to FLINK-5174 , in master branch, it is stored only if necessary. Z pozdrowieniami! / Cheers! Dawid Wysakowicz *Data/Software Engineer* Skype: dawid_wys |

Re: CEP memory requirements

2017-05-04 Thread Elias Levy

Looking at the code I gather that 1.2 does not clear the per key NFA state even if there is no state to keep, whereas this appears fixed in the master branch. Yes? On Thu, May 4, 2017 at 11:25 AM, Elias Levy wrote: > I am observing odd memory behavior with the CEP

CEP memory requirements

2017-05-04 Thread Elias Levy

I am observing odd memory behavior with the CEP library and I am wondering if it is expected. If I write a simple local streaming Flink job that reads from a 65MB compressed file of JSON objects, one per line, parses the JSON, performs a filter operation, and then a keyBy, heap usage is stable,