kangning.li created KAFKA-19735:
-----------------------------------
Summary: Add automatic commit offset caching in subscribe mode
Key: KAFKA-19735
URL: https://issues.apache.org/jira/browse/KAFKA-19735
Project: Kafka
Issue Type: Improvement
Reporter: kangning.li
Assignee: kangning.li
Suppose that no new messages have been written to the target topic for a long
time, for example, the producer has not generated new data for nearly an hour.
On the consumer side, when the user sets enable.auto.commit=true, the
OFFSET_COMMIT request will still be repeatedly submitted every 5 seconds. This
not only wastes network resources but also increases the burden on
__consumer_offset.
Therefore, maybe we can add a cache for committed offsets to check if the
currently committed offset is consistent with the most recently successfully
committed offset. If they are the same, this offset commit can be ignored. Of
course, all the above applies to the subscribe mode.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
