RE: KafkaFetcher closed before end of stream is received for all partitions.

2020-02-19 Thread Bill Wicker
user@flink.apache.org Subject: Re: KafkaFetcher closed before end of stream is received for all partitions. Hi, Your observations are correct. It is expected that the result of `KafkaDeserializationSchema#isEndOfStream` triggers a single subtask to escape its fetch loop. Therefore, if a subtask is ass

Re: KafkaFetcher closed before end of stream is received for all partitions.

2020-02-16 Thread Tzu-Li Tai
Hi, Your observations are correct. It is expected that the result of `KafkaDeserializationSchema#isEndOfStream` triggers a single subtask to escape its fetch loop. Therefore, if a subtask is assigned multiple partitions, as soon as one record (regardless of which partition it came from) signals en