[
https://issues.apache.org/jira/browse/KAFKA-19728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jianbin Chen updated KAFKA-19728:
---------------------------------
Attachment: image-2025-09-24-10-38-36-572.png
image-2025-09-24-10-38-25-161.png
Description:
I found that the remoteFetch thread is holding the file, preventing the disk
space from being freed.
!image-2025-09-24-10-38-25-161.png!
However, I didn't encounter this problem with the earlier 0.0.1-SNAPSHOT build,
which used Kafka 3.8.1. The current issue appears in version 1.0.0 together
with Kafka 3.9.1.
!image-2025-09-24-10-38-36-572.png!
I'm not sure whether this issue is caused by the tiered storage plugin or by
Kafka itself. Could someone help take a look?
was:
I found that the remoteFetch thread is holding the file, preventing the disk
space from being freed.
[!https://private-user-images.githubusercontent.com/19943636/492100660-6febbc6c-d445-43a7-b84d-3e2fb07bd7dd.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTg1MDc4MTcsIm5iZiI6MTc1ODUwNzUxNywicGF0aCI6Ii8xOTk0MzYzNi80OTIxMDA2NjAtNmZlYmJjNmMtZDQ0NS00M2E3LWI4NGQtM2UyZmIwN2JkN2RkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTA5MjIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwOTIyVDAyMTgzN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTc2ZTA3N2U3ZjVlMzA4YmFiZjY5YjI0ZTdjNGEzMTNiMjc0N2NmNDIwYzBmMTc0N2NkOTFjNDQyNDFiMDhmOTYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.2S7WLoNc2IYNB-cBX4EzNa2w2pktJVOG69kSKmenvzY|width=658,height=227!|https://private-user-images.githubusercontent.com/19943636/492100660-6febbc6c-d445-43a7-b84d-3e2fb07bd7dd.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTg1MDc4MTcsIm5iZiI6MTc1ODUwNzUxNywicGF0aCI6Ii8xOTk0MzYzNi80OTIxMDA2NjAtNmZlYmJjNmMtZDQ0NS00M2E3LWI4NGQtM2UyZmIwN2JkN2RkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTA5MjIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwOTIyVDAyMTgzN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTc2ZTA3N2U3ZjVlMzA4YmFiZjY5YjI0ZTdjNGEzMTNiMjc0N2NmNDIwYzBmMTc0N2NkOTFjNDQyNDFiMDhmOTYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.2S7WLoNc2IYNB-cBX4EzNa2w2pktJVOG69kSKmenvzY]
[!https://private-user-images.githubusercontent.com/19943636/492100806-8822c0db-6621-4490-a657-a0aca7b203fd.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTg1MDc4MTcsIm5iZiI6MTc1ODUwNzUxNywicGF0aCI6Ii8xOTk0MzYzNi80OTIxMDA4MDYtODgyMmMwZGItNjYyMS00NDkwLWE2NTctYTBhY2E3YjIwM2ZkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTA5MjIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwOTIyVDAyMTgzN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWI1OWEzYmQxYzZmODAzMmRjNmFlMWRjN2UxMGE2N2VhOGNkMTU3OTY3ZTQyMGY1YTNiMTg5YmUwZGU3NzI2ZWMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.vFQcJvYG1qm89NKZ1dykKAkiuamarcIuV8cTu1PQjs4|width=885,height=355!|https://private-user-images.githubusercontent.com/19943636/492100806-8822c0db-6621-4490-a657-a0aca7b203fd.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTg1MDc4MTcsIm5iZiI6MTc1ODUwNzUxNywicGF0aCI6Ii8xOTk0MzYzNi80OTIxMDA4MDYtODgyMmMwZGItNjYyMS00NDkwLWE2NTctYTBhY2E3YjIwM2ZkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTA5MjIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwOTIyVDAyMTgzN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWI1OWEzYmQxYzZmODAzMmRjNmFlMWRjN2UxMGE2N2VhOGNkMTU3OTY3ZTQyMGY1YTNiMTg5YmUwZGU3NzI2ZWMmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.vFQcJvYG1qm89NKZ1dykKAkiuamarcIuV8cTu1PQjs4]
However, I didn't encounter this problem with the earlier 0.0.1-SNAPSHOT build,
which used Kafka 3.8.1. The current issue appears in version 1.0.0 together
with Kafka 3.9.1.
[!https://private-user-images.githubusercontent.com/19943636/492102239-77420f4c-8dd2-43cb-8330-a62208850937.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTg1MDc4MTcsIm5iZiI6MTc1ODUwNzUxNywicGF0aCI6Ii8xOTk0MzYzNi80OTIxMDIyMzktNzc0MjBmNGMtOGRkMi00M2NiLTgzMzAtYTYyMjA4ODUwOTM3LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTA5MjIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwOTIyVDAyMTgzN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWJiZDQwOTJlM2U1OTZiNTNlMWJiZjRlMTExM2M4ZmRjZDcxMDkxNjg5NDcyMTY1YWJiMTNjZjk5YmFlYTNmNjUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.KlH8E3VkemmTeQiejb-U5_u_pZu67qamnjLuahr1FvA|width=599,height=190!|https://private-user-images.githubusercontent.com/19943636/492102239-77420f4c-8dd2-43cb-8330-a62208850937.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTg1MDc4MTcsIm5iZiI6MTc1ODUwNzUxNywicGF0aCI6Ii8xOTk0MzYzNi80OTIxMDIyMzktNzc0MjBmNGMtOGRkMi00M2NiLTgzMzAtYTYyMjA4ODUwOTM3LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTA5MjIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwOTIyVDAyMTgzN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWJiZDQwOTJlM2U1OTZiNTNlMWJiZjRlMTExM2M4ZmRjZDcxMDkxNjg5NDcyMTY1YWJiMTNjZjk5YmFlYTNmNjUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.KlH8E3VkemmTeQiejb-U5_u_pZu67qamnjLuahr1FvA]
I'm not sure whether this issue is caused by the tiered storage plugin or by
Kafka itself. Could someone help take a look?
> Disk space is not being freed
> -----------------------------
>
> Key: KAFKA-19728
> URL: https://issues.apache.org/jira/browse/KAFKA-19728
> Project: Kafka
> Issue Type: Wish
> Affects Versions: 3.9.1
> Reporter: Jianbin Chen
> Priority: Major
> Attachments: image-2025-09-24-10-38-25-161.png,
> image-2025-09-24-10-38-36-572.png
>
>
> I found that the remoteFetch thread is holding the file, preventing the disk
> space from being freed.
> !image-2025-09-24-10-38-25-161.png!
> However, I didn't encounter this problem with the earlier 0.0.1-SNAPSHOT
> build, which used Kafka 3.8.1. The current issue appears in version 1.0.0
> together with Kafka 3.9.1.
> !image-2025-09-24-10-38-36-572.png!
> I'm not sure whether this issue is caused by the tiered storage plugin or by
> Kafka itself. Could someone help take a look?
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
