I think you should write your own implementation for fetching data from kafka using kafka-api and not use the kafka-storm. It is easier and better that way. You can refer the above repo for reference.
On Mon, Feb 17, 2014 at 12:06 PM, Aniket Alhat <[email protected]>wrote: > > Hi Saurabh, > Sorry I could not identify the exact cause of this, in mean time you can > checkout this thing *[kafka-storm-redis]* > https://github.com/pict2014/storm-redis > I hope this satisfies your requirement temporarily. > > > On Mon, Feb 17, 2014 at 5:28 AM, Saurabh Agarwal (BLOOMBERG/ 731 LEXIN) < > [email protected]> wrote: > >> >> Hi, >> >> I am using storm kafka together >> >> here are versions of different components >> storm version 0.9.0.1 >> zookeeper version 3.4.5 >> Kafka version 0.8.0-beta1 >> Kafka Spout version storm-kafka-0.9.0-wip16a >> Scala version 2.9.2 >> >> When I ran storm starter kafka topology, I got the following error. >> >> 2599 [Thread-20-spout] ERROR backtype.storm.util - invoke - Async loop >> died! >> java.lang.NoSuchMethodError: >> kafka.javaapi.consumer.SimpleConsumer.<init>(Ljava/lang/String;III)V >> at >> storm.kafka.DynamicPartitionConnections.register(DynamicPartitionConnections.java:33) >> at storm.kafka.PartitionManager.<init>(PartitionManager.java:49) >> at storm.kafka.StaticCoordinator.<init>(StaticCoordinator.java:24) >> at storm.kafka.KafkaSpout.open(KafkaSpout.java:73) >> at >> backtype.storm.daemon.executor$fn__1136$fn__1151.invoke(executor.clj:504) >> at backtype.storm.util$async_loop$fn__458.invoke(util.clj:401) >> at clojure.lang.AFn.run(AFn.java:24) >> at java.lang.Thread.run(Thread.java:619) >> >> >> When I looked at the storm-Kafka code, the above constructor get called >> with 4 parameters while kafka javaapi simpleconsumer expects 5 parameters. >> Seems like there is version mismatch between kafka and storm-kafka. >> >> Have anyone encounter this issue? any workaround or resolution... >> >> >> Thanks, >> Saurabh. > > > > > -- > > *Aniket Alhatlinkedin.com/in/aniketalhat > <http://linkedin.com/in/aniketalhat>* > *+91 976 603 9317* > -- *Abhishek Bhattacharjee* *Pune Institute of Computer Technology*
