The GitHub Actions job "Flink Connector Kafka CI" on 
flink-connector-kafka.git/fix-enumerator-duplicate-partition-assignment has 
succeeded.
Run started by GitHub user slachiewicz (triggered by slachiewicz).

Head commit for run:
8623fc6526caea99870d1266e50222f061dce51c / Sylwester Lachiewicz 
<[email protected]>
[FLINK-40615][Connectors/Kafka] Fix duplicate partition assignment in 
KafkaSourceEnumerator

When the discovery interval is shorter than split initialization,
KafkaSourceEnumerator.getPartitionChange() only deduplicates against
assignedSplits and pendingPartitionSplitAssignment. Periodic discovery
that fires before initializePartitionSplits completes on the worker
thread treats the same partitions as new again, which assigns the
splits twice and consumes records twice.

Track in-flight partitions in a partitionsBeingInitialized set:
populated before dispatching callAsync, cleared when the handler
completes (success and failure), and excluded from getPartitionChange
deduplication.

SourceTopicIntegrityITCase keeps its 50 ms discovery interval. That
interval is what surfaced the race, so it stays as the regression
guard rather than being tuned away.

Generated-by: Claude Code

Report URL: 
https://github.com/apache/flink-connector-kafka/actions/runs/34571368816

With regards,
GitHub Actions via GitBox

Reply via email to