vijay bhaskar created KAFKA-3071: ------------------------------------ Summary: Kafka Server 0.8.2 ERROR OOME with siz Key: KAFKA-3071 URL: https://issues.apache.org/jira/browse/KAFKA-3071 Project: Kafka Issue Type: Bug Components: build Affects Versions: 0.8.2.0 Environment: Linux ********* 2.6.32-431.23.3.el6.x86_64 #1 SMP Wed Jul 16 06:12:23 EDT 2014 x86_64 x86_64 x86_64 GNU/Linux Reporter: vijay bhaskar Fix For: 0.8.2.0
[2016-01-06 12:34:18.819-0700] INFO Truncating log hughes-order-status-73 to offset 18. (kafka.log.Log) [2016-01-06 12:34:18.819-0700] INFO Truncating log troubleshoot-completed-125 to offset 3. (kafka.log.Log) [2016-01-06 12:34:19.064-0700] DEBUG Scheduling task highwatermark-checkpoint with initial delay 0 ms and period 5000 ms. (kafka.utils.KafkaScheduler) [2016-01-06 12:34:19.106-0700] DEBUG Scheduling task [__consumer_offsets,0] with initial delay 0 ms and period -1 ms. (kafka.utils.KafkaScheduler) [2016-01-06 12:34:19.106-0700] INFO Loading offsets from [__consumer_offsets,0] (kafka.server.OffsetManager) [2016-01-06 12:34:19.108-0700] INFO Finished loading offsets from [__consumer_offsets,0] in 2 milliseconds. (kafka.server.OffsetManager) [2016-01-06 12:34:27.023-0700] ERROR OOME with size 743364196 (kafka.network.BoundedByteBufferReceive) java.lang.OutOfMemoryError: Java heap space at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57) at java.nio.ByteBuffer.allocate(ByteBuffer.java:331) at kafka.network.BoundedByteBufferReceive.byteBufferAllocate(BoundedByteBufferReceive.scala:80) at kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:63) at kafka.network.Receive$class.readCompletely(Transmission.scala:56) at kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29) at kafka.network.BlockingChannel.receive(BlockingChannel.scala:108) at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:72) at kafka.consumer.SimpleConsumer.kafka$consumer$SimpleConsumer$$sendRequest(SimpleConsumer.scala:69) at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(SimpleConsumer.scala:113) at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply(SimpleConsumer.scala:113) at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply(SimpleConsumer.scala:113) at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply$mcV$sp(SimpleConsumer.scala:112) at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:112) at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:112) at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) at kafka.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:111) at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:97) at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:89) at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60) [2016-01-06 12:34:32.003-0700] ERROR OOME with size 743364196 (kafka.network.BoundedByteBufferReceive) java.lang.OutOfMemoryError: Java heap space at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57) at java.nio.ByteBuffer.allocate(ByteBuffer.java:331) at kafka.network.BoundedByteBufferReceive.byteBufferAllocate(BoundedByteBufferReceive.scala:80) at kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:63) at kafka.network.Receive$class.readCompletely(Transmission.scala:56) at kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29) at kafka.network.BlockingChannel.receive(BlockingChannel.scala:108) at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:80) at kafka.consumer.SimpleConsumer.kafka$consumer$SimpleConsumer$$sendRequest(SimpleConsumer.scala:69) at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(SimpleConsumer.scala:113) at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply(SimpleConsumer.scala:113) at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply(SimpleConsumer.scala:113) at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply$mcV$sp(SimpleConsumer.scala:112) at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:112) at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:112) at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) at kafka.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:111) at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:97) at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:89) at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60) [2016-01-06 12:34:34.994-0700] ERROR OOME with size 743364196 (kafka.network.BoundedByteBufferReceive) java.lang.OutOfMemoryError: Java heap space [2016-01-06 12:34:37.389-0700] ERROR OOME with size 750116719 (kafka.network.BoundedByteBufferReceive) java.lang.OutOfMemoryError: Java heap space [2016-01-06 12:34:37.433-0700] INFO re-registering broker info in ZK for broker 2 (kafka.server.KafkaHealthcheck) [2016-01-06 12:34:37.438-0700] INFO done re-registering broker (kafka.server.KafkaHealthcheck) [2016-01-06 12:34:37.439-0700] INFO Subscribing to /brokers/topics path to watch for new topics (kafka.server.KafkaHealthcheck) [2016-01-06 12:34:37.510-0700] INFO New leader is 1 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener) [2016-01-06 12:34:40.185-0700] ERROR OOME with size 743364196 (kafka.network.BoundedByteBufferReceive) java.lang.OutOfMemoryError: Java heap space -- This message was sent by Atlassian JIRA (v6.3.4#6332)