[
https://issues.apache.org/jira/browse/KAFKA-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742124#comment-17742124
]
Justine Olshan commented on KAFKA-14359:
----------------------------------------
also https://issues.apache.org/jira/browse/KAFKA-9199 offers a way to fix.
> Idempotent Producer continues to retry on OutOfOrderSequence error when first
> batch fails
> -----------------------------------------------------------------------------------------
>
> Key: KAFKA-14359
> URL: https://issues.apache.org/jira/browse/KAFKA-14359
> Project: Kafka
> Issue Type: Task
> Reporter: Justine Olshan
> Priority: Major
>
> When the idempotent producer does not have any state it can fall into a state
> where the producer keeps retrying an out of order sequence. Consider the
> following scenario where an idempotent producer has retries and delivery
> timeout are int max (a configuration used in streams).
> 1. A producer send out several batches (up to 5) with the first one starting
> at sequence 0.
> 2. The first batch with sequence 0 fails due to a transient error (ie,
> NOT_LEADER_OR_FOLLOWER or a timeout error)
> 3. The second batch, say with sequence 200 comes in. Since there is no
> previous state to invalidate it, it gets written to the log
> 4. The original batch is retried and will get an out of order sequence number
> 5. Current java client will continue to retry this batch, but it will never
> resolve.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
