I agree with Vineet’s sentiment. If you want to forge ahead, you might want to have a look at the example topology’s in storm-cassandra-cql: https://github.com/hmsonline/storm-cassandra-cql/tree/master/src/test/java/com/hmsonline/trident/cql/example <https://github.com/hmsonline/storm-cassandra-cql/tree/master/src/test/java/com/hmsonline/trident/cql/example>
They are very simple. You can see descriptions in the README: https://github.com/hmsonline/storm-cassandra-cql/ <https://github.com/hmsonline/storm-cassandra-cql/> Combine a couple lines from those examples, with a couple lines from a kafka spout example (replacing the static spouts): http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.1/bk_user-guide/content/ch_storm-using-ingest-connectors.html <http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.1.1/bk_user-guide/content/ch_storm-using-ingest-connectors.html> And you should be good to go. If not, we also have a ton of examples in our book: http://www.amazon.com/Storm-Blueprints-Distributed-Real-time-Computation/dp/178216829X/ <http://www.amazon.com/Storm-Blueprints-Distributed-Real-time-Computation/dp/178216829X/> -brian --- Brian O'Neill Chief Technology Officer Health Market Science The Science of Better Results 2700 Horizon Drive • King of Prussia, PA • 19406 M: 215.588.6024 • @boneill42 <http://www.twitter.com/boneill42> • healthmarket <http://healthmarketscience.com/>science <http://healthmarketscience.com/>.com <http://healthmarketscience.com/> This information transmitted in this email message is for the intended recipient only and may contain confidential and/or privileged material. If you received this email in error and are not the intended recipient, or the person responsible to deliver it to the intended recipient, please contact the sender at the email above and delete this email and any attachments and destroy any copies thereof. Any review, retransmission, dissemination, copying or other use of, or taking any action in reliance upon, this information by persons or entities other than the intended recipient is strictly prohibited. > On Mar 3, 2015, at 4:19 AM, Vineet Mishra <[email protected]> wrote: > > Key, > > These frameworks are designed to have business value use case with them and > without having the knowledge of coding and framework architecture I don't > think its a smart way to move forward. > > Adding up, these tech. stack are not so hard to code or understand as it > doesn't involve high level of design implementation. > It you would like to run the benchmarking for the solution you could consult > some thirdparty client to leverage your usecase! > > > On Tue, Mar 3, 2015 at 2:13 PM, kay <[email protected] > <mailto:[email protected]>> wrote: > Hi Vineet, > > Thank you very much for your advice, but the problem is that I've > never worked with java, scala. And all these tutorials looks like > http://knowyourmeme.com/memes/how-to-draw-an-owl > <http://knowyourmeme.com/memes/how-to-draw-an-owl> for me. I really hope > that there is a simple working example somewhere which shows how to > read data from kafka and save it into sample cassandra table. > > Regards. > > On Tue, Mar 3, 2015 at 9:18 AM, Vineet Mishra <[email protected] > <mailto:[email protected]>> wrote: > > I guess you can create your own topology with the reference link below. > > > > https://storm.apache.org/documentation/Tutorial.html > > <https://storm.apache.org/documentation/Tutorial.html> > > > > Moreover Cassandra will just serve you as persistence layer which you can > > customize in your code as well. > > > > You can probably go with the default implementation of the Storm Topology > > and make your data persistence in according to what you need for storage as > > Cassandra, Hbase, Redis or anything as per your call. > > > > On Tue, Mar 3, 2015 at 1:34 PM, kay <[email protected] > > <mailto:[email protected]>> wrote: > >> > >> Hi Vineet, > >> > >> All ports are opened. It seems that these examples try to create their > >> own local storm cluster. What I need is working example which I can > >> alter for my needs. > >> > >> Regards. > >> > >> On Tue, Mar 3, 2015 at 8:46 AM, Vineet Mishra <[email protected] > >> <mailto:[email protected]>> > >> wrote: > >> > Hi Kay, > >> > > >> > It seems like your daemon connectivity is lacking, or perhaps the port > >> > is > >> > not opened for zookeeper connectivity. > >> > Ensure that all the worker and supervisor are up with access on the > >> > specific > >> > port. > >> > > >> > you can Telnet from the machines to check the connectivity! > >> > > >> > > >> > > >> > On Mon, Mar 2, 2015 at 7:52 PM, kay <[email protected] > >> > <mailto:[email protected]>> wrote: > >> >> > >> >> Hello storm users, > >> >> > >> >> I would like to run a sample kafka-storm-cassandra chain. > >> >> > >> >> Kafka topic should contain simple numbers (10-50 items per second), > >> >> Storm should read this data and put it into the Cassandra cluster. > >> >> > >> >> I've already configured Kafka, Storm and Cassandra clusters. They work > >> >> well. Storm word-count example works well too (I was able to build > >> >> example with maven). > >> >> > >> >> The rest examples just failed: > >> >> https://github.com/Parsely/streamparse > >> >> <https://github.com/Parsely/streamparse> example failed with the > >> >> following message: > >> >> http://pastebin.com/7eMn38BK <http://pastebin.com/7eMn38BK> > >> >> > >> >> https://github.com/hmsonline/storm-cassandra > >> >> <https://github.com/hmsonline/storm-cassandra> example failed on TESTS: > >> >> http://pastebin.com/vCUyKREJ <http://pastebin.com/vCUyKREJ> > >> >> If I skip tests and try to upload jar into the storm cluster - it can > >> >> not find the main class: > >> >> storm jar storm-cassandra-0.4.0-rc5-SNAPSHOT.jar > >> >> com.hmsonline.storm.cassandra.example.CassandraReachTopology > >> >> production-topology remote > >> >> http://pastebin.com/9uTCYSy8 <http://pastebin.com/9uTCYSy8> > >> >> > >> >> Could someone provide me with the sample kafka-storm-cassandra > >> >> implementation (just read data from kafka and put it into cassandra > >> >> table)? It would be great if it will be based on python code. I use > >> >> Ubuntu 14.04, OpenJDK 7 for kafka, storm and CLI tests run environment > >> >> (I hope it is not a problem). Cassandra runs under the Oracle Java 7. > >> >> > >> >> Thanks in advance. > >> > > >> > > > > > >
