[
https://issues.apache.org/jira/browse/KAFKA-936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13680450#comment-13680450
]
Senthil Chittibabu commented on KAFKA-936:
------------------------------------------
The application did not crash yet after increasing the max PermGen to 2g.
However the permGen memory is slowly increasing. I can clearly see the
following object instance are created in thousands and ten thousands. And never
gets garbage collected even after force garbage collection by using the
profiler. I believe since these object size are small, you will not see the
application crash for days/weeks if you set the max memory to high number. You
will notice the leak if you watch the following objects in the profiler. Can
you please run your app and watch the following object in the profiler?
kafka.server.FetcherLagMetrics
kafka.consumer.FetchRequestAndResponseMetrics
kafka.consumer.FetchRequestAndResponseStats
kafka.metrics.KafkaTimer
kafka.utils.Pool
BTW, what is your consumer app memory settings?
> Kafka Metrics Memory Leak
> --------------------------
>
> Key: KAFKA-936
> URL: https://issues.apache.org/jira/browse/KAFKA-936
> Project: Kafka
> Issue Type: Bug
> Components: consumer
> Affects Versions: 0.8
> Environment: centos linux, jdk 1.6, jboss
> Reporter: Senthil Chittibabu
> Assignee: Neha Narkhede
> Priority: Critical
>
> I am using kafka_2.8.0-0.8.0-SNAPSHOT version. I am running into
> OutOfMemoryError in PermGen Space. I have set the -XX:MaxPermSize=512m, but I
> still get the same error. I used profiler to trace the memory leak, and found
> the following kafka classes to be the cause for the memory leak. Please let
> me know if you need any additional information to debug this issue.
> kafka.server.FetcherLagMetrics
> kafka.consumer.FetchRequestAndResponseMetrics
> kafka.consumer.FetchRequestAndResponseStats
> kafka.metrics.KafkaTimer
> kafka.utils.Pool
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
