[
https://issues.apache.org/jira/browse/KAFKA-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
huangfulibo updated KAFKA-13087:
--------------------------------
Description:
Hi Kafka team,
I am a new Kafka user.
some basic informations
Kafka server version is 2.6.0
Kafka client version is 2.6.0
enable idempotent function and not use transaction function
After we upgrade Kafka version from 2.3.1 to 2.6.0, we find that in our product
environment kafka server the ProducerStateManager class throw out huge numbers
OutOfOrderSequenceException ("Invalid sequence number for new epoch at
offset....") intermittently.
the details logs as bellow:
2021-07-10T03:35:31.790257-04:00 pc8bkafka04 kafka[2653]: [2021-07-10
03:35:31,790] ERROR [ReplicaManager broker=4] Error processing append operation
on partition platform.foundation.user.sync-1 (kafka.server.ReplicaManager)
2021-07-10T03:35:31.790895-04:00 pc8bkafka04 kafka[2653]:
org.apache.kafka.common.errors.OutOfOrderSequenceException: Invalid sequence
number for new epoch at offset 7007971 in partition
platform.foundation.user.sync-1: 6159 (request epoch), 1 (seq. number)
I have spent some days to investigate this issue, and have read some related
Kafka client and server source code based on Kafka 2.6 version, but i can not
reproduce the Exception in my local develop environment, and i can not find the
root cause, it confused me some days.
cloud your Kafka team give me some guides to troubleshooting this issue.
Thanks,
huangfulibo
was:
Hi Kafka team,
I am a new Kafka user.
some basic informations
Kafka server version is 2.6.0
Kafka client version is 2.6.0
enable idempotent function and not use transaction function
After we upgrade Kafka version from 2.3.1 to 2.6.0, we find that in our product
environment kafka server the ProducerStateManager class throw out huge numbers
OutOfOrderSequenceException ("Invalid sequence number for new epoch at
offset....") intermittently.
the details logs as bellow:
2021-07-10T03:35:31.790257-04:00 pc8bkafka04 kafka[2653]: [2021-07-10
03:35:31,790] ERROR [ReplicaManager broker=4] Error processing append operation
on partition platform.foundation.user.sync-1 (kafka.server.ReplicaManager)
2021-07-10T03:35:31.790895-04:00 pc8bkafka04 kafka[2653]:
org.apache.kafka.common.errors.OutOfOrderSequenceException: Invalid sequence
number for new epoch at offset 7007971 in partition
platform.foundation.user.sync-1: 6159 (request epoch), 1 (seq. number)
I have spent some days to investigate this issue, and have read some related
Kafka client and server source code based on Kafka 2.6 version, but i can not
reproduce the Exception in my local develop environment, and i can not find the
root cause, it confused me some days.
cloud your Kafka team give me some guides to troubleshooting this issue.
> production environment throw huge OutOfOrderSequenceException("Invalid
> sequence number for new epoch at offset..") when enable idempotent function
> ---------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: KAFKA-13087
> URL: https://issues.apache.org/jira/browse/KAFKA-13087
> Project: Kafka
> Issue Type: Task
> Components: clients, core
> Affects Versions: 2.6.0
> Reporter: huangfulibo
> Priority: Critical
>
> Hi Kafka team,
> I am a new Kafka user.
> some basic informations
> Kafka server version is 2.6.0
> Kafka client version is 2.6.0
> enable idempotent function and not use transaction function
>
> After we upgrade Kafka version from 2.3.1 to 2.6.0, we find that in our
> product environment kafka server the ProducerStateManager class throw out
> huge numbers OutOfOrderSequenceException ("Invalid sequence number for new
> epoch at offset....") intermittently.
> the details logs as bellow:
> 2021-07-10T03:35:31.790257-04:00 pc8bkafka04 kafka[2653]: [2021-07-10
> 03:35:31,790] ERROR [ReplicaManager broker=4] Error processing append
> operation on partition platform.foundation.user.sync-1
> (kafka.server.ReplicaManager)
> 2021-07-10T03:35:31.790895-04:00 pc8bkafka04 kafka[2653]:
> org.apache.kafka.common.errors.OutOfOrderSequenceException: Invalid sequence
> number for new epoch at offset 7007971 in partition
> platform.foundation.user.sync-1: 6159 (request epoch), 1 (seq. number)
> I have spent some days to investigate this issue, and have read some related
> Kafka client and server source code based on Kafka 2.6 version, but i can not
> reproduce the Exception in my local develop environment, and i can not find
> the root cause, it confused me some days.
>
> cloud your Kafka team give me some guides to troubleshooting this issue.
>
>
> Thanks,
> huangfulibo
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
