Re: DataStream in batch mode - handling (un)ordered bounded data

2021-03-13 Thread Alexis Sarda-Espinosa
: Dawid Wysakowicz Sent: Friday, March 12, 2021 4:10 PM To: Alexis Sarda-Espinosa; user@flink.apache.org Subject: Re: DataStream in batch mode - handling (un)ordered bounded data Hi Alexis, As of now there is no such feature in the DataStream API. The Batch mode in DataStream API is a new feature

Re: DataStream in batch mode - handling (un)ordered bounded data

2021-03-12 Thread Dawid Wysakowicz
Hi Alexis, As of now there is no such feature in the DataStream API. The Batch mode in DataStream API is a new feature and we would be interested to hear about the use cases people want to use it for to identify potential areas to improve. What you are suggesting generally make sense so I think

DataStream in batch mode - handling (un)ordered bounded data

2021-03-12 Thread Alexis Sarda-Espinosa
Hello, Regarding the new BATCH mode of the data stream API, I see that the documentation states that some operators will process all data for a given key before moving on to the next one. However, I don't see how Flink is supposed to know whether the input will provide all data for a given key