[ https://issues.apache.org/jira/browse/KAFKA-936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13681233#comment-13681233 ]
Senthil Chittibabu commented on KAFKA-936: ------------------------------------------ Yes, I see lot of rebalances (can't rebalance after 4 retries) in the log.. And also I see the below the warning often. Not sure is there any relation with memory leak? 2013-06-11 23:59:59,861 WARN [kafka.consumer.ConsumerFetcherManager$LeaderFinderThread] (UrlWorker-grp_hms.com-1370985065479-bb5e7de1-leader-finder-thread], Failed to find leader for Set([dev--raw-topic,10], [ption at org.I0Itec.zkclient.ZkClient$2.call(ZkClient.java:416) [zkclient-0.2.jar:0.2] at org.I0Itec.zkclient.ZkClient$2.call(ZkClient.java:413) [zkclient-0.2.jar:0.2] at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675) [zkclient-0.2.jar:0.2] at org.I0Itec.zkclient.ZkClient.getChildren(ZkClient.java:413) [zkclient-0.2.jar:0.2] at org.I0Itec.zkclient.ZkClient.getChildren(ZkClient.java:409) [zkclient-0.2.jar:0.2] at kafka.utils.ZkUtils$.getChildrenParentMayNotExist(ZkUtils.scala:438) [kafka_2.8.0-0.8.0-SNAPSHOT.jar:0.8.0 at kafka.utils.ZkUtils$.getAllBrokersInCluster(ZkUtils.scala:75) [kafka_2.8.0-0.8.0-SNAPSHOT.jar:0.8.0-SNAPSH at kafka.consumer.ConsumerFetcherManager$LeaderFinderThread.doWork(ConsumerFetcherManager.scala:62) [kafka_2. at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:51) [kafka_2.8.0-0.8.0-SNAPSHOT.jar:0.8.0-SNAP > Kafka Metrics Memory Leak > -------------------------- > > Key: KAFKA-936 > URL: https://issues.apache.org/jira/browse/KAFKA-936 > Project: Kafka > Issue Type: Bug > Components: consumer > Affects Versions: 0.8 > Environment: centos linux, jdk 1.6, jboss > Reporter: Senthil Chittibabu > Assignee: Neha Narkhede > Priority: Critical > > I am using kafka_2.8.0-0.8.0-SNAPSHOT version. I am running into > OutOfMemoryError in PermGen Space. I have set the -XX:MaxPermSize=512m, but I > still get the same error. I used profiler to trace the memory leak, and found > the following kafka classes to be the cause for the memory leak. Please let > me know if you need any additional information to debug this issue. > kafka.server.FetcherLagMetrics > kafka.consumer.FetchRequestAndResponseMetrics > kafka.consumer.FetchRequestAndResponseStats > kafka.metrics.KafkaTimer > kafka.utils.Pool -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira