Any help/pointers on this please ?
Thanks.
On Thu, 11 Oct 2018 at 10:33, Ahmad Hassan wrote:
> Hi All,
>
> Thanks for the replies. Here is the code snippet of what we want to
> achieve:
>
> We have sliding windows of 24hrs with 5 minutes apart.
>
> inStream
> .filter(Objects::nonNull)
>
Hi Ahmad,
Few comments from my side:
1. FoldFunction is deprecated because of many problems, e.g. no
possibility to merge contents of windows. Therefore you should at least
use the AggregateFunction.
2. I am not sure if you need to store this in RocksDB, do you expect
24millions product
Hi All,
Thanks for the replies. Here is the code snippet of what we want to achieve:
We have sliding windows of 24hrs with 5 minutes apart.
inStream
.filter(Objects::nonNull)
.keyBy("tenant")
.window(SlidingProcessingTimeWindows.of(Time.minutes(1440),
Time.minutes(5)))
.fold(new
Yes, it would be good to post your code.
Are you using a FoldFunction in a window (if yes, what window) or as a
running aggregate?
In general, collecting state in a FoldFunction is usually not something
that you should do. Did you consider using an AggregateFunction?
Fabian
Am Mi., 10. Okt.
In which method are you calling getRuntimeContext()? This method can
only be used after open() has been called.
On 09.10.2018 17:09, Ahmad Hassan wrote:
Hi,
We want to use MapState inside fold function to keep the map of all
products that we see in 24 hour window to store huge state in
Hi,
We want to use MapState inside fold function to keep the map of all
products that we see in 24 hour window to store huge state in rocksdb
rather than overflowing heap. However, I don't seem to initialise mapstate
within foldfunction or any class that is extending RichMapFunction
private
