[
https://issues.apache.org/jira/browse/KAFKA-13489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18136418#comment-18136418
]
Chia-Ping Tsai commented on KAFKA-13489:
----------------------------------------
I ran a Kafka cluster with 2000 topics x 10 partitions x 3 RF. The snapshot
file is 2.5 MB, so it can grow to ~128 MB for a cluster with 1M partitions.
gzip and zstd both give about 13x, so I think this ticket is worthwhile to take
a look at.
Maybe introducing a new config {{metadata.log.snapshot.compression.type}} to
enable the compression is a good way. Most of the code is ready, only a public
config is missing :)
> Support different compression type for snapshots
> ------------------------------------------------
>
> Key: KAFKA-13489
> URL: https://issues.apache.org/jira/browse/KAFKA-13489
> Project: Kafka
> Issue Type: Sub-task
> Reporter: Jose Armando Garcia Sancio
> Assignee: Jose Armando Garcia Sancio
> Priority: Major
>
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)