[jira] [Commented] (KAFKA-5165) Kafka Logs Cleanup Not happening, Huge File Growth - Windows
[ https://issues.apache.org/jira/browse/KAFKA-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16377373#comment-16377373 ] Vahid Hashemian commented on KAFKA-5165: Have you looked at broker logs to see if it contains any error related to this issue? > Kafka Logs Cleanup Not happening, Huge File Growth - Windows > > > Key: KAFKA-5165 > URL: https://issues.apache.org/jira/browse/KAFKA-5165 > Project: Kafka > Issue Type: Bug >Affects Versions: 0.9.0.1 > Environment: windows, Kafka Server(Version: 0.9.0.1) >Reporter: Manikandan P >Priority: Major > Labels: windows > > We had set the below configuration: Retention hours as 1, Retention bytes as > 150 MB in the server.properties in the Kafka Server(Version: 0.9.0.1). Also > modified other settings as given below. > log.dirs=/tmp/kafka-logs > log.retention.hours=1 > log.retention.bytes=157286400 > log.segment.bytes=1073741824 > log.retention.check.interval.ms=30 > log.cleaner.enable=true > log.cleanup.policy=delete > After checking few days, Size of the Kafka log folder too huge as 13.2 GB. We > have seen that Topic Offset getting updated and ignores the Old data but Log > File doesnt reduce and has all the Old Data and become too huge. Could you > help us to find out why Kafka is not deleting the logs(Physically). Do we > need to change any configuration ? -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KAFKA-5165) Kafka Logs Cleanup Not happening, Huge File Growth - Windows
[ https://issues.apache.org/jira/browse/KAFKA-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16356937#comment-16356937 ] Akash C commented on KAFKA-5165: We are facing a similar issue in 0.11.0.0. Is there a workaround for this? > Kafka Logs Cleanup Not happening, Huge File Growth - Windows > > > Key: KAFKA-5165 > URL: https://issues.apache.org/jira/browse/KAFKA-5165 > Project: Kafka > Issue Type: Bug >Affects Versions: 0.9.0.1 > Environment: windows, Kafka Server(Version: 0.9.0.1) >Reporter: Manikandan P >Priority: Major > > We had set the below configuration: Retention hours as 1, Retention bytes as > 150 MB in the server.properties in the Kafka Server(Version: 0.9.0.1). Also > modified other settings as given below. > log.dirs=/tmp/kafka-logs > log.retention.hours=1 > log.retention.bytes=157286400 > log.segment.bytes=1073741824 > log.retention.check.interval.ms=30 > log.cleaner.enable=true > log.cleanup.policy=delete > After checking few days, Size of the Kafka log folder too huge as 13.2 GB. We > have seen that Topic Offset getting updated and ignores the Old data but Log > File doesnt reduce and has all the Old Data and become too huge. Could you > help us to find out why Kafka is not deleting the logs(Physically). Do we > need to change any configuration ? -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KAFKA-5165) Kafka Logs Cleanup Not happening, Huge File Growth - Windows
[ https://issues.apache.org/jira/browse/KAFKA-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16272524#comment-16272524 ] Zeeshan Haider commented on KAFKA-5165: --- Have you find any solution or workaround for the problem? > Kafka Logs Cleanup Not happening, Huge File Growth - Windows > > > Key: KAFKA-5165 > URL: https://issues.apache.org/jira/browse/KAFKA-5165 > Project: Kafka > Issue Type: Bug >Affects Versions: 0.9.0.1 > Environment: windows, Kafka Server(Version: 0.9.0.1) >Reporter: Manikandan P > > We had set the below configuration: Retention hours as 1, Retention bytes as > 150 MB in the server.properties in the Kafka Server(Version: 0.9.0.1). Also > modified other settings as given below. > log.dirs=/tmp/kafka-logs > log.retention.hours=1 > log.retention.bytes=157286400 > log.segment.bytes=1073741824 > log.retention.check.interval.ms=30 > log.cleaner.enable=true > log.cleanup.policy=delete > After checking few days, Size of the Kafka log folder too huge as 13.2 GB. We > have seen that Topic Offset getting updated and ignores the Old data but Log > File doesnt reduce and has all the Old Data and become too huge. Could you > help us to find out why Kafka is not deleting the logs(Physically). Do we > need to change any configuration ? -- This message was sent by Atlassian JIRA (v6.4.14#64029)
