Jun Rao created KAFKA-4072:
------------------------------

             Summary: improving memory usage in LogCleaner
                 Key: KAFKA-4072
                 URL: https://issues.apache.org/jira/browse/KAFKA-4072
             Project: Kafka
          Issue Type: Improvement
            Reporter: Jun Rao


This is a followup jira from KAFKA-3894.

We can potentially make the allocation of the dedup buffer more dynamic. We can 
start with something small like 100MB. If needed, we can grow the dedup buffer 
up to the configured size. This will allow us to set a larger default dedup 
buffer size (say 1GB). If there are not lots of keys, the broker won't be using 
that much memory. This will allow the default configuration to accommodate more 
keys.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to