[ 
https://issues.apache.org/jira/browse/KAFKA-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902191#comment-17902191
 ] 

Chia-Ping Tsai commented on KAFKA-806:
--------------------------------------

Please disregard my previous comment. The issue stems from a single 
MemoryRecords instance containing multiple batches. Typically, MemoryRecords 
created by the producer's write path have only one batch (at least in our Java 
client). However, the follower's write path can receive a single MemoryRecords 
instance with many batches, which is indeed problematic.

> Index may not always observe log.index.interval.bytes
> -----------------------------------------------------
>
>                 Key: KAFKA-806
>                 URL: https://issues.apache.org/jira/browse/KAFKA-806
>             Project: Kafka
>          Issue Type: Improvement
>          Components: log
>            Reporter: Jun Rao
>            Assignee: Chun-Hao Tang
>            Priority: Major
>              Labels: newbie++
>
> Currently, each log.append() will add at most 1 index entry, even when the 
> appended data is larger than log.index.interval.bytes. One potential issue is 
> that if a follower restarts after being down for a long time, it may fetch 
> data much bigger than log.index.interval.bytes at a time. This means that 
> fewer index entries are created, which can increase the fetch time from the 
> consumers.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to