Hi,
I am using storm kafka together
here are versions of different components
storm version 0.9.0.1
zookeeper version 3.4.5
Kafka version 0.8.0-beta1
Kafka Spout version storm-kafka-0.9.0-wip16a
Scala version 2.9.2
When I ran storm starter kafka topology, I got the following error.
2599 [Thread-20-spout] ERROR backtype.storm.util - invoke - Async loop died!
java.lang.NoSuchMethodError:
kafka.javaapi.consumer.SimpleConsumer.<init>(Ljava/lang/String;III)V
at
storm.kafka.DynamicPartitionConnections.register(DynamicPartitionConnections.java:33)
at storm.kafka.PartitionManager.<init>(PartitionManager.java:49)
at storm.kafka.StaticCoordinator.<init>(StaticCoordinator.java:24)
at storm.kafka.KafkaSpout.open(KafkaSpout.java:73)
at backtype.storm.daemon.executor$fn__1136$fn__1151.invoke(executor.clj:504)
at backtype.storm.util$async_loop$fn__458.invoke(util.clj:401)
at clojure.lang.AFn.run(AFn.java:24)
at java.lang.Thread.run(Thread.java:619)
When I looked at the storm-Kafka code, the above constructor get called with 4
parameters while kafka javaapi simpleconsumer expects 5 parameters. Seems like
there is version mismatch between kafka and storm-kafka.
Have anyone encounter this issue? any workaround or resolution...
Thanks,
Saurabh.