[
https://issues.apache.org/jira/browse/FLINK-35630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855812#comment-17855812
]
tanjialiang commented on FLINK-35630:
-------------------------------------
In addtion this, user can not set the *auto.offset.reset* option, because in
KafkaSourceBuilder#parseAndSetRequiredProperties will be force overriden, it is
a bug?
> Kafka source may reset the consume offset to earliest when the partition
> leader changes
> ---------------------------------------------------------------------------------------
>
> Key: FLINK-35630
> URL: https://issues.apache.org/jira/browse/FLINK-35630
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka
> Affects Versions: kafka-3.2.0
> Reporter: tanjialiang
> Priority: Major
>
> Kafka producer using the ack=1 option to write data to a topic.
> Flink Kafka source startup with the *scan.startup.mode=earliest-offset*
> option to consume (the Kafka *auto.offset.reset* option will be force
> override to earliest).
> If a partition leader is not available, a follower may become the new leader
> and this may trigger log truncation. It may cause consumers to consume offset
> out of range and use the *auto.offset.reset* strategy to reset the offset.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)