What's the heartbeat interval that you have set on these consumer configs (if any)? Can you also paste a snippet of your code to show what the consumer code looks like (including the poll and commit calls)?
-Jaikiran On Tuesday 23 August 2016 07:55 PM, Franco Giacosa wrote:
Hi I am experiencing the following issue in kafka 0.9.0.1, I have a consumer, that is in a consumer group alone processing and commiting the offsets and at one point the group does a rebalance (I don't know why) and removes the group. The weird situation is that it seems that the consumer is working as expected and in less than 1 second between commiting the previous offset, processing the current message and commiting that offset it fails. I imagine this has nothing to do with a timeout, but either way we have those times setup pretty high request.timeout.ms=600000, group.max.session.timeout.ms=500000 *KAFKA SERVER.LOG have the following lines around that time* [*2016-08-19 01:09:10,857*] INFO [Group Metadata Manager on Broker 0]: Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.GroupMetadataManager) [*2016-08-19 01:14:46,082*] INFO [GroupCoordinator 0]: Preparing to restabilize group error-group with old generation 43 (kafka.coordinator.GroupCoordinator) [*2016-08-19 01:14:46,083*] INFO [GroupCoordinator 0]: Group error-group generation 43 is dead and removed (kafka.coordinator.GroupCoordinator) [*2016-08-19 01:19:10,857*] INFO [Group Metadata Manager on Broker 0]: Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.GroupMetadataManager) *On the consumer client I can see the following on the log around the same time * *01:14:44.839* [pool-5-thread-3] DEBUG o.a.k.c.c.i.ConsumerCoordinator - Committed offset 132 for partition error-group-topic-4 *01:14:45.258* [pool-5-thread-3] DEBUG o.a.k.c.c.i.ConsumerCoordinator - Committed offset 133 for partition error-group-topic-4 *01:14:45.703* [pool-5-thread-3] DEBUG o.a.k.c.c.i.ConsumerCoordinator - Committed offset 134 for partition error-group-topic-4 *01:14:46.139* [pool-5-thread-3] ERROR o.a.k.c.c.i.ConsumerCoordinator - Error ILLEGAL_GENERATION occurred while committing offsets for group error-group *01:14:46.140* [pool-5-thread-3] DEBUG c.g.e.c.f.m.ConnectorHandler - Consumer Id=error-group : kafka-exception=Commit cannot be completed due to group rebalance org.apache.kafka.clients.consumer.CommitFailedException: Commit cannot be completed due to group rebalance at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:552) ~[kafka-clients-0.9.0.1.jar:na] at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:493) ~[kafka-clients-0.9.0.1.jar:na] at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:665) ~[kafka-clients-0.9.0.1.jar:na] at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:644) ~[kafka-clients-0.9.0.1.jar:na] at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167) ~[kafka-clients-0.9.0.1.jar:na] at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133) ~[kafka-clients-0.9.0.1.jar:na] at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107) ~[kafka-clients-0.9.0.1.jar:na] at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete(ConsumerNetworkClient.java:380) ~[kafka-clients-0.9.0.1.jar:na] at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:274) ~[kafka-clients-0.9.0.1.jar:na] at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:320) ~[kafka-clients-0.9.0.1.jar:na] at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:213) ~[kafka-clients-0.9.0.1.jar:na] at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:193) ~[kafka-clients-0.9.0.1.jar:na] at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:163) ~[kafka-clients-0.9.0.1.jar:na] at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.commitOffsetsSync(ConsumerCoordinator.java:358) ~[kafka-clients-0.9.0.1.jar:na] at org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:968) ~[kafka-clients-0.9.0.1.jar:na]
