Hi Vineet, 1) Now I am looking out for some prominent use case of Storm, I am having some logs generated with me and I want to parse these logs in distributed real time environment so as to gain better hold and understanding of Storm. Log collection and analysis can be one of the use cases of storm. 2) One quick question along with the same, do I need to use Kafka in this case? As I read some where that Kafka is integrated in Storm from 0.9.2 release. With storm you can write your own spouts that can read log files and emit to downstream bolts. Although storm provides a framework to write custom spouts or bolts, in your use case it is recommended to use kafka. Where you write your log files to kafka topic and use storm's KafkaSpout to read the topic and send the data onto downstream bolts.
-Harsha On Sat, Dec 27, 2014, at 04:55 AM, Vineet Mishra wrote: > Hi, > > I am looking out for some way for Stream Processing through Storm, > although I have just tried with the Storm(storm-core-0.9.2) to just > create a topology which consist of some spouts and bolts in my local > environment, > > Spouts are emitting sequential numbers, i.e 1,2,3,4. . . Bolts and > receiving those numbers and output if its a prime number, i.e > 3,5,7. . . > > 1) Now I am looking out for some prominent use case of Storm, I am > having some logs generated with me and I want to parse these logs > in distributed real time environment so as to gain better hold and > understanding of Storm. > > 2) One quick question along with the same, do I need to use Kafka in > this case? As I read some where that Kafka is integrated in Storm > from 0.9.2 release. > > Looking out for a way to get started, any suggestions would be > appreciated. > > Thanks in advance!
