The GitHub Actions job "Flink Connector Kafka CI" on 
flink-connector-kafka.git/FLINK-40586-signal-no-more-splits-once has failed.
Run started by GitHub user vbhanuchander-lang (triggered by MartijnVisser).

Head commit for run:
0bd5e42c5df3aade3ce648f1efeda17af826e8f6 / Bhanu Chander Vallabaneni 
<[email protected]>
[FLINK-40586][Connectors/Kafka] Signal no more splits to each reader once per 
registration

DynamicKafkaSourceEnumerator.handleNoMoreSplits() signalled every registered
reader on every invocation, and it is reached from addReader, addSplitsBack and
tryCompletePendingReaderRegistration. A reader that already finished on an
earlier signal is therefore signalled again when another reader registers, or
when any reader is reset -- SourceCoordinator.subtaskReset calls addSplitsBack
for every reset subtask, with an empty list for a reader that owned no splits.
NoMoreSplitsEvent is not loss tolerant, so delivering it to a task already in
FINISHED fails the job with "An OperatorEvent from an OperatorCoordinator to a
task was lost", which is the DynamicKafkaSourceITTest.testIdleReader failure
seen in CI.

Track which subtasks have been signalled and skip them, clearing a subtask's
entry in addReader. Registration is the point at which a new attempt of a reader
becomes addressable, so it is the event that has to re-arm the signal; without
that, a restarted reader would never be told and the job would not finish.

Generated-by: Claude Code (Opus 5)

Report URL: 
https://github.com/apache/flink-connector-kafka/actions/runs/34469117863

With regards,
GitHub Actions via GitBox

Reply via email to