Re: Customer operator in BATCH execution mode

2021-05-27 Thread Piotr Nowojski
>> >> Yes, it should be possible to register a timer for Long.MAX_WATERMARK if >> you want to apply a transformation at the end of each key. You could >> also use the reduce operation (DataStream#keyBy#reduce) in BATCH mode. > > According to [0], timer time is irrelevant since timer will be

Re: Customer operator in BATCH execution mode

2021-05-26 Thread 陳昌倬
On Wed, May 26, 2021 at 01:03:53PM +0200, Dawid Wysakowicz wrote: > Hi, > > No there is no API in the operator to know which mode it works in. We > aim to have separate operators for both modes if required. You can check > e.g. how we do it in KeyedBroadcastStateTransformationTranslator[1].

Re: Customer operator in BATCH execution mode

2021-05-26 Thread Dawid Wysakowicz
Hi, No there is no API in the operator to know which mode it works in. We aim to have separate operators for both modes if required. You can check e.g. how we do it in KeyedBroadcastStateTransformationTranslator[1]. Yes, it should be possible to register a timer for Long.MAX_WATERMARK if you

Re: Customer operator in BATCH execution mode

2021-05-25 Thread Piotr Nowojski
Hi, 1. I don't know if there is a built-in way of doing it. You can always pass this information anyway on your own when you are starting the job (via operator/function's constructors). 2. Yes, I think this should work. Best, Piotrek wt., 25 maj 2021 o 17:05 ChangZhuo Chen (陳昌倬) napisał(a): >