[jira] [Created] (KAFKA-19728) Disk space is not being freed

Sat, 18 Oct 2025 17:01:49 -0700 

Jianbin Chen created KAFKA-19728:
------------------------------------

             Summary: Disk space is not being freed
                 Key: KAFKA-19728
                 URL: https://issues.apache.org/jira/browse/KAFKA-19728
             Project: Kafka
          Issue Type: Wish
    Affects Versions: 3.9.1
            Reporter: Jianbin Chen


I found that the remoteFetch thread is holding the file, preventing the disk 
space from being freed.

[!https://private-user-images.githubusercontent.com/19943636/492100660-6febbc6c-d445-43a7-b84d-3e2fb07bd7dd.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTg1MDc4MTcsIm5iZiI6MTc1ODUwNzUxNywicGF0aCI6Ii8xOTk0MzYzNi80OTIxMDA2NjAtNmZlYmJjNmMtZDQ0NS00M2E3LWI4NGQtM2UyZmIwN2JkN2RkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTA5MjIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwOTIyVDAyMTgzN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTc2ZTA3N2U3ZjVlMzA4YmFiZjY5YjI0ZTdjNGEzMTNiMjc0N2NmNDIwYzBmMTc0N2NkOTFjNDQyNDFiMDhmOTYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.2S7WLoNc2IYNB-cBX4EzNa2w2pktJVOG69kSKmenvzY|width=658,height=227!|https://private-user-images.githubusercontent.com/19943636/492100660-6febbc6c-d445-43a7-b84d-3e2fb07bd7dd.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTg1MDc4MTcsIm5iZiI6MTc1ODUwNzUxNywicGF0aCI6Ii8xOTk0MzYzNi80OTIxMDA2NjAtNmZlYmJjNmMtZDQ0NS00M2E3LWI4NGQtM2UyZmIwN2JkN2RkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTA5MjIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwOTIyVDAyMTgzN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTc2ZTA3N2U3ZjVlMzA4YmFiZjY5YjI0ZTdjNGEzMTNiMjc0N2NmNDIwYzBmMTc0N2NkOTFjNDQyNDFiMDhmOTYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.2S7WLoNc2IYNB-cBX4EzNa2w2pktJVOG69kSKmenvzY]
 
[!https://private-user-images.githubusercontent.com/19943636/492100806-8822c0db-6621-4490-a657-a0aca7b203fd.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTg1MDc4MTcsIm5iZiI6MTc1ODUwNzUxNywicGF0aCI6Ii8xOTk0MzYzNi80OTIxMDA4MDYtODgyMmMwZGItNjYyMS00NDkwLWE2NTctYTBhY2E3YjIwM2ZkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTA5MjIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwOTIyVDAyMTgzN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWI1OWEzYmQxYzZmODAzMmRjNmFlMWRjN2UxMGE2N2VhOGNkMTU3OTY3ZTQyMGY1YTNiMTg5YmUwZGU3NzI2ZWMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.vFQcJvYG1qm89NKZ1dykKAkiuamarcIuV8cTu1PQjs4|width=885,height=355!|https://private-user-images.githubusercontent.com/19943636/492100806-8822c0db-6621-4490-a657-a0aca7b203fd.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTg1MDc4MTcsIm5iZiI6MTc1ODUwNzUxNywicGF0aCI6Ii8xOTk0MzYzNi80OTIxMDA4MDYtODgyMmMwZGItNjYyMS00NDkwLWE2NTctYTBhY2E3YjIwM2ZkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTA5MjIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwOTIyVDAyMTgzN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWI1OWEzYmQxYzZmODAzMmRjNmFlMWRjN2UxMGE2N2VhOGNkMTU3OTY3ZTQyMGY1YTNiMTg5YmUwZGU3NzI2ZWMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.vFQcJvYG1qm89NKZ1dykKAkiuamarcIuV8cTu1PQjs4]

However, I didn't encounter this problem with the earlier 0.0.1-SNAPSHOT build, 
which used Kafka 3.8.1. The current issue appears in version 1.0.0 together 
with Kafka 3.9.1.

[!https://private-user-images.githubusercontent.com/19943636/492102239-77420f4c-8dd2-43cb-8330-a62208850937.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTg1MDc4MTcsIm5iZiI6MTc1ODUwNzUxNywicGF0aCI6Ii8xOTk0MzYzNi80OTIxMDIyMzktNzc0MjBmNGMtOGRkMi00M2NiLTgzMzAtYTYyMjA4ODUwOTM3LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTA5MjIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwOTIyVDAyMTgzN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWJiZDQwOTJlM2U1OTZiNTNlMWJiZjRlMTExM2M4ZmRjZDcxMDkxNjg5NDcyMTY1YWJiMTNjZjk5YmFlYTNmNjUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.KlH8E3VkemmTeQiejb-U5_u_pZu67qamnjLuahr1FvA|width=599,height=190!|https://private-user-images.githubusercontent.com/19943636/492102239-77420f4c-8dd2-43cb-8330-a62208850937.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTg1MDc4MTcsIm5iZiI6MTc1ODUwNzUxNywicGF0aCI6Ii8xOTk0MzYzNi80OTIxMDIyMzktNzc0MjBmNGMtOGRkMi00M2NiLTgzMzAtYTYyMjA4ODUwOTM3LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTA5MjIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwOTIyVDAyMTgzN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWJiZDQwOTJlM2U1OTZiNTNlMWJiZjRlMTExM2M4ZmRjZDcxMDkxNjg5NDcyMTY1YWJiMTNjZjk5YmFlYTNmNjUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.KlH8E3VkemmTeQiejb-U5_u_pZu67qamnjLuahr1FvA]

I'm not sure whether this issue is caused by the tiered storage plugin or by 
Kafka itself. Could someone help take a look?

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to