Jianbin Chen created KAFKA-16378: ------------------------------------ Summary: Under tiered storage, deleting local logs does not free disk space Key: KAFKA-16378 URL: https://issues.apache.org/jira/browse/KAFKA-16378 Project: Kafka Issue Type: Wish Affects Versions: 3.7.0 Reporter: Jianbin Chen Attachments: image-2024-03-15-09-33-13-903.png
Of course, this is an occasional phenomenon, as long as the tiered storage topic triggered the deletion of the local log action, there is always the possibility of residual file references, but these files on the local disk is already impossible to find! I use the implementation as: [Aiven-Open/tiered-storage-for-apache-kafka: RemoteStorageManager for Apache Kafka® Tiered Storage (github.com)|https://github.com/Aiven-Open/tiered-storage-for-apache-kafka] I also filed an issue in their community, which also contains a full description of the problem [Disk space not released · Issue #513 · Aiven-Open/tiered-storage-for-apache-kafka (github.com)|https://github.com/Aiven-Open/tiered-storage-for-apache-kafka/issues/513] !image-2024-03-15-09-33-13-903.png! You can clearly see in this figure that the kafka log has already output the log of the operation that deleted the log, but the log is still referenced and the disk space has not been released -- This message was sent by Atlassian Jira (v8.20.10#820010)