Hi Feng, I'm using flink-connector-kafka 3.0.1-1.17. I see that 1.17 is affected, but the ticket is marked as fixed so I'm not sure if that is actually the issue.
Best, Irakli ________________________________ From: Feng Jin <jinfeng1...@gmail.com> Sent: 12 March 2024 18:28 To: Keshelava, Irakli <irakli.keshel...@sony.com> Cc: user@flink.apache.org <user@flink.apache.org> Subject: Re: Flink Batch Execution Mode Hi Irakli What version of flink-connector-kafka are you using? You may have encountered a bug [1] in the old version that prevents the source task from entering the finished state. [1]. https://issues.apache.org/jira/browse/FLINK-31319<https://issues.apache.org/jira/browse/FLINK-31319> Best, Feng On Tue, Mar 12, 2024 at 7:21 PM irakli.keshel...@sony.com<mailto:irakli.keshel...@sony.com> <irakli.keshel...@sony.com<mailto:irakli.keshel...@sony.com>> wrote: Hello, I have a Flink job that is running in the Batch mode. The source for the job is a Kafka topic which has limited number of events. I can see that the job starts running fine and consumes the events, but never makes it past the first task and becomes idle. The Kafka source is defined to be bounded by following command: "KafkaSource.builder().setBounded(OffsetsInitializer.latest())". I expect the job to consume all the events that are in the Kafka topic and then move to the next task, but I'm not sure if the "OffsetsInitializer.latest()" is the right OffsetInitializer. Can anyone help me out here? Thanks! Cheers, Irakli
