[
https://issues.apache.org/jira/browse/KAFKA-14912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17756886#comment-17756886
]
Divij Vaidya commented on KAFKA-14912:
--------------------------------------
Hey [~hudeqi]
We would ideally want to imeplement it based on size. As the limit based on
number of entries doesn't make sense, because segment indexes could be very
large or very small, hence, that value is not deterministic. Did you explore
usage of
[https://www.javadoc.io/static/com.github.ben-manes.caffeine/caffeine/2.2.0/com/github/benmanes/caffeine/cache/Caffeine.html#weigher-com.github.benmanes.caffeine.cache.Weigher-]
as I suggested above in Caffeine and use size based eviction using
[https://www.javadoc.io/static/com.github.ben-manes.caffeine/caffeine/2.2.0/com/github/benmanes/caffeine/cache/Caffeine.html#maximumWeight-long-]
> Introduce a configuration for remote index cache size, preferably a dynamic
> config.
> -----------------------------------------------------------------------------------
>
> Key: KAFKA-14912
> URL: https://issues.apache.org/jira/browse/KAFKA-14912
> Project: Kafka
> Issue Type: Sub-task
> Components: core
> Reporter: Satish Duggana
> Assignee: hudeqi
> Priority: Major
>
> Context: We need to make the 1024 value here [1] as dynamically configurable
> [1]
> https://github.com/apache/kafka/blob/8d24716f27b307da79a819487aefb8dec79b4ca8/storage/src/main/java/org/apache/kafka/storage/internals/log/RemoteIndexCache.java#L119
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
