Hi Navneeth
For me I think you may start with using the window function and an example
for the custom window function could be found in [1]. From the description I
think it should be a standard Tumbling window, if implementing with the
customized process function, it would end up have a similar functionality with
the current window operator.
Best,
Yun
[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.12/dev/stream/operators/windows.html#processwindowfunction
------------------------------------------------------------------
Sender:Navneeth Krishnan<[email protected]>
Date:2021/01/04 08:05:17
Recipient:user<[email protected]>
Theme:Tumbling Time Window
Hello All,
First of all Happy New Year!! Thanks for the excellent community support.
I have a job which requires a 2 seconds tumbling time window per key, For each
user we wait for 2 seconds to collect enough data and proceed to
further processing. My question is should I use the regular DSL windowing or
write a custom process function which does the windowing. I have heard that the
DSL window has more overhead versus the custom window function.
What do you guys suggest and can someone provide an example of custom window
function per key. Also given the window time is very less (2 secs) would there
be more overhead in firing so many timers for each key?
Thanks!
Regards,
Navneeth
