Aravind created KAFKA-14798:
-------------------------------
Summary: corrupted consumer offsets
Key: KAFKA-14798
URL: https://issues.apache.org/jira/browse/KAFKA-14798
Project: Kafka
Issue Type: Bug
Reporter: Aravind
Kafka version 3.2.3
The consumer offsets for some partitions in a kafka topic are not refreshing
after a restart of consumer application which made negative lag accumulating
and the messages in the partitions are not consumed by the application until
the log-end offset equals to older consumer offset.
{noformat}
2023-02-07 14:33:43.485 ERROR 15 --- [ntainer#0-0-C-1]
o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=consumer-dummy-1,
groupId=dummy] User provided listener
org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer$ListenerConsumerRebalanceListener
failed on invocation of onPartitionsAssigned for partitions [dummy-0, dummy-1,
dummy-2]
org.apache.kafka.common.errors.TimeoutException: Timeout of 60000ms expired
before the position for partition dummy-0 could be determined
2023-02-07 14:33:43.487 ERROR 15 --- [ntainer#0-0-C-1]
essageListenerContainer$ListenerConsumer : Consumer
exceptionjava.lang.IllegalStateException: This error handler cannot process
'org.apache.kafka.common.errors.TimeoutException's; no record information is
available at
org.springframework.kafka.listener.SeekUtils.seekOrRecover(SeekUtils.java:200)
~[spring-kafka-2.7.9.jar!/:2.7.9] at
org.springframework.kafka.listener.SeekToCurrentErrorHandler.handle(SeekToCurrentErrorHandler.java:112)
~[spring-kafka-2.7.9.jar!/:2.7.9] at
org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.handleConsumerException(KafkaMessageListenerContainer.java:1604)
~[spring-kafka-2.7.9.jar!/:2.7.9] at
org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.run(KafkaMessageListenerContainer.java:1212)
~[spring-kafka-2.7.9.jar!/:2.7.9] at
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
~[na:na] at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused
by: org.apache.kafka.common.errors.TimeoutException: Timeout of 60000ms expired
before the position for partition dummy-0 could be determined
{noformat}
Getting "no record information available" consumer exception as the
FetchPosition is pointing to old committed offset.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
