Jun Rao created KAFKA-4072: ------------------------------ Summary: improving memory usage in LogCleaner Key: KAFKA-4072 URL: https://issues.apache.org/jira/browse/KAFKA-4072 Project: Kafka Issue Type: Improvement Reporter: Jun Rao
This is a followup jira from KAFKA-3894. We can potentially make the allocation of the dedup buffer more dynamic. We can start with something small like 100MB. If needed, we can grow the dedup buffer up to the configured size. This will allow us to set a larger default dedup buffer size (say 1GB). If there are not lots of keys, the broker won't be using that much memory. This will allow the default configuration to accommodate more keys. -- This message was sent by Atlassian JIRA (v6.3.4#6332)