Re: Issue in WordCount Example with DataStream API in BATCH RuntimeExecutionMode

2020-12-26 Thread Derek Sheng
Thank you both very much! Happy holidays! Aljoscha Krettek 于2020年12月24日周四 下午4:00写道: > Thanks for reporting this! This is not the expected behaviour, I created > a Jira Issue: https://issues.apache.org/jira/browse/FLINK-20764. > > Best, > Aljoscha > > On 23.12.20 22:26, David Anderson wrote: > >

Re: Issue in WordCount Example with DataStream API in BATCH RuntimeExecutionMode

2020-12-24 Thread Aljoscha Krettek
Thanks for reporting this! This is not the expected behaviour, I created a Jira Issue: https://issues.apache.org/jira/browse/FLINK-20764. Best, Aljoscha On 23.12.20 22:26, David Anderson wrote: I did a little experiment, and I was able to reproduce this if I use the sum aggregator on KeyedStre

Re: Issue in WordCount Example with DataStream API in BATCH RuntimeExecutionMode

2020-12-23 Thread David Anderson
I did a little experiment, and I was able to reproduce this if I use the sum aggregator on KeyedStream to do the counting. However, if I implement my own counting in a KeyedProcessFunction, or if I use the Table API, I get correct results with RuntimeExecutionMode.BATCH -- though the results are p

Issue in WordCount Example with DataStream API in BATCH RuntimeExecutionMode

2020-12-23 Thread Derek Sheng
Hi team, Recently I am trying to explore the new features of Flink 1.12 with Batch Execution. I locally wrote a classic WordCount program to read from text file and count the words (almost same as the one in Flink Github repo https://github.com/apache/flink/blob/master/flink-examples/flink-exampl