Can you query your Kafka broker using Kafka's binaries and check if the consumer group is present? (something like ./kafka-consumer-groups.sh --bootstrap-server $broker:9092 --describe --consumer-group $consumerGroup)
And also check the broker side logs? On Mon, 25 Mar 2024 at 16:19, Juan Pablo Garbora <j...@attuneiot.com> wrote: > got a Storm 2.6.0 with Kafka Spout (setting 32 parallelismHint) and > sometimes I'm getting: > > Is this normal ? > > Error > java.lang.RuntimeException: org.apache.kafka.common.KafkaException: > Unexpected error in commit: The group id does not exist. > at org.apache.storm.utils.Utils$1.run(Utils.java:413) > ~[storm-client-2.6.0.jar:2.6.0] > at java.base/java.lang.Thread.run(Thread.java:1583) [?:?] > Caused by: org.apache.kafka.common.KafkaException: Unexpected error in > commit: The group id does not exist. > at > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:1482) > ~[stormjar.jar:?] > at > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:1376) > ~[stormjar.jar:?] > at > org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:1270) > ~[stormjar.jar:?] > at > org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:1245) > ~[stormjar.jar:?] > at > org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:206) > ~[stormjar.jar:?] > at > org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:169) > ~[stormjar.jar:?] > at > org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:129) > ~[stormjar.jar:?] > at > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.fireCompletion(ConsumerNetworkClient.java:617) > ~[stormjar.jar:?] > at > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.firePendingCompletedRequests(ConsumerNetworkClient.java:427) > ~[stormjar.jar:?] > at > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:312) > ~[stormjar.jar:?] > at > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:230) > ~[stormjar.jar:?] > at > org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:214) > ~[stormjar.jar:?] > at > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.commitOffsetsSync(ConsumerCoordinator.java:1189) > ~[stormjar.jar:?] > at > org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1450) > ~[stormjar.jar:?] > at > org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1397) > ~[stormjar.jar:?] > at > org.apache.storm.kafka.spout.KafkaSpout.pollKafkaBroker(KafkaSpout.java:367) > ~[stormjar.jar:?] > at > org.apache.storm.kafka.spout.KafkaSpout.nextTuple(KafkaSpout.java:287) > ~[stormjar.jar:?] > at > org.apache.storm.executor.spout.SpoutExecutor$2.call(SpoutExecutor.java:187) > ~[storm-client-2.6.0.jar:2.6.0] > at > org.apache.storm.executor.spout.SpoutExecutor$2.call(SpoutExecutor.java:153) > ~[storm-client-2.6.0.jar:2.6.0] > at org.apache.storm.utils.Utils$1.run(Utils.java:398) > ~[storm-client-2.6.0.jar:2.6.0] > ... 1 more >
