The GitHub Actions job "Flink Connector Kafka CI" on 
flink-connector-kafka.git/FLINK-41100-dynamic-split-id-collision has failed.
Run started by GitHub user Admaing (triggered by MartijnVisser).

Head commit for run:
4729b197456bcc9af0afc0c5e1e66410f0b6dcdd / yongfu.gao <[email protected]>
[FLINK-41100][Connectors/Kafka] Make dynamic source split ids unique per 
partition

DynamicKafkaSourceSplit#splitId() joined the cluster id and the partition id 
with '-', so
cluster "a" with topic "b-c" and cluster "a-b" with topic "c" both formatted 
partition 0 as
"a-b-c-0". Flink keys the split-local output, and with it the split-local 
watermark
generator, by that id, so both partitions shared one generator, finishing one 
released the
output the other still wrote to, and the enumerator conflated their owners.

The cluster id is now length prefixed so that the encoding is injective over 
(cluster id,
partition id) pairs, and one shared helper formats the id at all four sites so 
the ids the
records carry match DynamicKafkaSourceSplit#splitId(). The split order of the 
enumerator
drops its now redundant cluster id tiebreaker. 
DynamicKafkaSourceSplitSerializer keeps its
version and wire format because it stores the cluster id and the 
KafkaPartitionSplit, never
the formatted id, so existing checkpoint and savepoint state is unaffected.

Generated-by: DeepSeek Harness (deepseek-v4.1-flash)

Report URL: 
https://github.com/apache/flink-connector-kafka/actions/runs/40059599384

With regards,
GitHub Actions via GitBox

Reply via email to