Re: Storm vs Spark Streaming Tech Evaluation

Very nice post :) Storm is very good in terms of the capabilities it has. The only thing is they could have provided API in Scala as well as Python. Also, when debugging, understanding clojure code is bit hard. They should have written code using functional programming language like Scala. On Wed,

Re: Not able to see my application Logs in workerLogs

Thanks Javier for suggestion . Let me try this. Thanks Ankur On Wed, Oct 21, 2015 at 5:41 AM, Javier Gonzalez wrote: > Configure your cluster.xml to debug level for your own packages, set storm > debug to true, and retry. > On Oct 20, 2015 3:37 PM, "Ankur Garg" wrote: > >> Any idea ppl . >> >>

parralelize readings on a single file by many splouts

Hi, Please I want to know what is the best approach to parralelize readings on a single file by many splouts... Cordialement, TUENO FOTSO STEVE JEFFREY Élève Ingénieur 5GI ENSP +237 676 57 17 28 https://play.google.com/store/apps/details?id=com.polytech.remotecomputer http://github.com/stuenofotso

Re: Not able to see my application Logs in workerLogs

Configure your cluster.xml to debug level for your own packages, set storm debug to true, and retry. On Oct 20, 2015 3:37 PM, "Ankur Garg" wrote: > Any idea ppl . > > Even though application is running and my spouts and bolts are functioning > , worker logs are stuck and nothing is getting printe

Security Best Practices?

Is there any "data at rest" in Storm? Should we encrypt tuples as they are emitted and decrypt them as they are received? Also, what about intra-supervisor communication? We're reading data from RabbitMQ from a Spout and writing to Oracle DB via a Bolt. Both use SSL/TLS. We need to ensure all

Re: Storm vs Spark Streaming Tech Evaluation

Very Nice post Satish . Thanks for sharing :) . On Wed, Oct 21, 2015 at 12:33 AM, P. Taylor Goetz wrote: > Hi Satish, > > Great series of blog posts. Thanks for sharing! > > -Taylor > > On Oct 19, 2015, at 4:24 AM, Satish Mittal > wrote: > > Hi All, > > The data platform team at Inmobi recently

Re: Not able to see my application Logs in workerLogs

Any idea ppl . Even though application is running and my spouts and bolts are functioning , worker logs are stuck and nothing is getting printed there . On Tue, Oct 20, 2015 at 8:42 PM, Ankur Garg wrote: > Hi , > > I have deployed my topology in remote cluster . > > Inside the open and prepar

Re: Storm vs Spark Streaming Tech Evaluation

Hi Satish, Great series of blog posts. Thanks for sharing! -Taylor > On Oct 19, 2015, at 4:24 AM, Satish Mittal wrote: > > Hi All, > > The data platform team at Inmobi recently performed an extensive evaluation > exercise in the process of finalizing the real-time Stream processing stack >

Re: Storm vs Spark Streaming Tech Evaluation

In the first blog post, you mentioned Inmobi considered Storm, Spark Streaming, Samza, and Flink. Flink is promising but is relatively new. What about Samza? Would you share the reason why it is not considered for evaluation? Thanks, BH On Mon, Oct 19, 2015 at 6:24 AM, Satish Mittal wrote: > Hi

Not able to see my application Logs in workerLogs

Hi , I have deployed my topology in remote cluster . Inside the open and prepare method for my spouts and bolts , I launch a separate application (Spring Application) which runs on a different port (just like zookeeper etc) and I get the instance of this application for use in my Spouts and bolt

Re: Storm vs Spark Streaming Tech Evaluation

Gentlemen: I would interested as far as the type of streaming for the data ingestion used for both types of Big Data platforms, I would also be interested in the size and topology of the Linux clusters and the sizing of the nodes. Please advise. Best,

Application Hangs inside Spout and Bolts

Hi , In my spout I am starting a spring boot application which basically initialises all the beans and classes . Whenever I start the topology in remote cluster , the moment this spring application runs inside the open method of my Spout , I see that the topology hangs and I see no errors and no