The GitHub Actions job "Flink Connector Kafka CI" on 
flink-connector-kafka.git/FLINK-40586-signal-no-more-splits-once has failed.
Run started by GitHub user vbhanuchander-lang (triggered by MartijnVisser).

Head commit for run:
c6d8edd30cf86e46535c11b156848ea09372ff12 / Bhanu Chander Vallabaneni 
<[email protected]>
[FLINK-40586][Connectors/Kafka] Clear the no-more-splits dedup set on a 
metadata change

FLINK-39712 added readersWithNoMoreSplits so a reader is told no more splits
once per registration. A metadata change closes and recreates every sub
enumerator, and the reader recreates its sub readers, which then need the
signal again. The entries from before the change suppress it, so the bounded
job never finishes.

This only happens when metadata discovery runs more than once for a bounded
source. DynamicKafkaSourceBuilder forces the discovery interval to -1 for
bounded sources, but setProperty on the builder after build() bypasses that,
because the source keeps the builder's Properties. Such a job hangs after a
cluster switch since FLINK-39712.

Clear the set right after the sub enumerators are closed.

Generated-by: Claude Code (Opus 5, Opus 5.5)

Report URL: 
https://github.com/apache/flink-connector-kafka/actions/runs/40108437302

With regards,
GitHub Actions via GitBox

Reply via email to