Re: Initialization code.

2014-05-19 Thread Susheel Kumar Gadalay
You have to use bolts prepare method or spouts init method. A worker can be executing multiple instances of different bolts/spouts. On 5/19/14, Gaurav Sehgal gsehgal@gmail.com wrote: I need to do some initialization before the worker goes ahead and spawns the different the threads, as I

Re: [VOTE] Storm Logo Contest - Round 1

2014-05-19 Thread Viral Bajaria
#9 : 3 pts #10: 2 pts On Thu, May 15, 2014 at 9:28 AM, P. Taylor Goetz ptgo...@gmail.com wrote: Votes cast by PPMC members are considered binding, but voting is open to anyone.

Understanding ACKing mechanism

2014-05-19 Thread P Ghosh
I have a topology, that looks like *All Bolts emits Fields id, json* *Spout emits only id* *All bolts/spout uses the stream ComponentName_stream name while emitting* *Topology Definition* *==* builder.setSpout(citySpout, citySpout,10);

Test timed out (5000ms)

2014-05-19 Thread Sergey Pichkurov
Hello, Storm community. I trying to write unit test with storm.version :0.9.1-incubating storm-kafka-0.8-plus: 0.4.0 My topology have one Kafka spout and one storing bolt which has Spring inside(context initialized in prepare() method). When I running test with Testing.completeTopology(),

Does Esper work with Storm 0.9.x version

2014-05-19 Thread Nishu
My application is using storm 0.9.0 version. I am trying to integrate Esper with it but it doesn't work with that. But when I tested Esper with storm 0.8.1 and 0.8.2 version, then it works fine. The example https://github.com/tomdz/storm-esper is also based on storm 0.8.1. Anyone have idea

How to catch exceptions from a Spout

2014-05-19 Thread Alexis Sukrieh
Hi there, First of all, as this is my first message to the list, I'd like to thank you all for Storm, this project is impressive and is very interesting. I'm glad I found it for the new project I'm working on! It's a pleasure to learn how to master it. Here comes my first questions. I've built

Storm with video/audio streams

2014-05-19 Thread Suparno Datta
Hi, I just started playing around with storm a few days back. I worked with some basic examples using the twitter streaming api. I was wondering If storm can also be used with live video/audio streaming api ( the youtube streaming api for example). I wanted to develop a app which does

Re: [VOTE] Storm Logo Contest - Round 1

2014-05-19 Thread Bryan Stone
#1 - 5 pts Bryan Stone Staff Cloud Architect Cloud Platform Lead 6723 Odyssey Drive Huntsville, AL 35806 (256) 924-3976 // direct (256) 724-0113 // cell www.synapse-wireless.com http://www.synapse-wireless.com/ On 5/15/14, 11:28 AM, P. Taylor Goetz ptgo...@gmail.com wrote: This is a call to

Re: [VOTE] Storm Logo Contest - Round 1

2014-05-19 Thread Bilal Al Fartakh
#5 -3pt #6 -2pt 2014-05-19 14:25 GMT+01:00 Derek Dagit der...@yahoo-inc.com: #1 - 1pt. #2 - 1pt. #9 - 2pts. #10 - 1pts. There is a lot to like in these entries. It was tough to narrow it down. -- Derek On 5/15/14, 11:28, P. Taylor Goetz wrote: This is a call to vote on selecting

Re: Test timed out (5000ms)

2014-05-19 Thread Derek Dagit
https://git.corp.yahoo.com/storm/storm/blob/master-security/storm-core/src/clj/backtype/storm/testing.clj#L167 Try changing this. The time-out was added to prevent the case when a test would hang indefinitely. Five seconds was thought to be more than enough time to let tests pass. If it

Notify workers when a worker crashes

2014-05-19 Thread Florian Duros
Hi, I have a trident topology built with storm.0.9.0.1. When a worker crashes, I need to inform the other workers of this crash and to do some computations after. Does trident include a mechanism to notify the workers and the associated partitions? Thanks, Florian Duros

Re: Storm with video/audio streams

2014-05-19 Thread Michael Rose
No reason why you couldn't do it, but as far as I know it hasn't been done before. You can send any kind of serializable data into a topology. You'd probably need to emit frames from the spout. Michael Rose (@Xorlev https://twitter.com/xorlev) Senior Platform Engineer, FullContact

Re: Externalize storm.yaml file

2014-05-19 Thread P Ghosh
Use soft links. Prasun Sent from Galaxy Nexus On May 14, 2014 6:50 AM, Neha Jain neha_sj...@persistent.co.in wrote: Hello, I have created a storm cluster on Amazon EC2 machines. The requirement we have is to save Storm configuration file to Amazon S3. There would be a bucket in S3

Re: Test timed out (5000ms)

2014-05-19 Thread Sergey Pichkurov
I think that 5 sec is not always enought for Spring init. Your link is not resolving. *Pichkurov Sergey, Java Developer* On Mon, May 19, 2014 at 5:18 PM, Derek Dagit der...@yahoo-inc.com wrote: https://git.corp.yahoo.com/storm/storm/blob/master-

Re: Test timed out (5000ms)

2014-05-19 Thread Derek Dagit
https://github.com/apache/incubator-storm/blob/master/storm-core/src/clj/backtype/storm/testing.clj#L187 Corrected link. -- Derek On 5/19/14, 10:10, Sergey Pichkurov wrote: I think that 5 sec is not always enought for Spring init. Your link is not resolving. *Pichkurov Sergey, Java

Re: Test timed out (5000ms)

2014-05-19 Thread Sergey Pichkurov
Thank you. I will be better if this property can be configurable. *Pichkurov Sergey, Java Developer* On Mon, May 19, 2014 at 6:47 PM, Derek Dagit der...@yahoo-inc.com wrote: https://github.com/apache/incubator-storm/blob/master/ storm-core/src/clj/backtype/storm/testing.clj#L187

Will bolt's finalize() be called if we rebalance to 0

2014-05-19 Thread Raja Cherukuri
I have a bolt that has loaded a native library thru JNI's loadlibrary(...). As my topology is running all the time, as I have a newer version of that OS's native library, is it possible to a) simply rebalance the bolt to '0' , b) then deploy the native library. c) If the bolt's finalize() method

Re: Performance metrics in storm

2014-05-19 Thread padma priya chitturi
Hi Michael, Is the graphite available on windows? On Sat, May 17, 2014 at 2:29 AM, Michael G. Noll michael+st...@michael-noll.com wrote: To add to what Jason and Otis already shared, here is an article I wrote a while back (shameless plug):

Re: [VOTE] Storm Logo Contest - Round 1

2014-05-19 Thread abhishek.priya
#11 - 3 pts #6- 2 pts Sent from Windows Mail From: Uditha Bandara Wijerathna Sent: ‎Sunday‎, ‎May‎ ‎18‎, ‎2014 ‎4‎:‎28‎ ‎AM To: user@storm.incubator.apache.org Cc: d...@storm.incubator.apache.org On Thu, May 15, 2014 at 9:58 PM, P. Taylor Goetz ptgo...@gmail.com wrote: This

Re: Kafka Spout 0.8-plus stops consuming messages after a while

2014-05-19 Thread Tao, Jing
I finally found the root cause. Turns out the spout was reading a message exceeded the max message size. After increasing the message size in SpoutConfig, it worked. It would have been nice if the Spout threw an error or exception in such cases. Jing On May 16, 2014, at 12:09 PM, Tao, Jing

Re: [VOTE] Storm Logo Contest - Round 1

2014-05-19 Thread Neville Li
#11 - 3 pts. #1 - 2 pts. On Mon, May 19, 2014 at 3:17 PM, Binh Nguyen Van binhn...@gmail.com wrote: #9 - 4 pts. #8 - 2 pts. On Mon, May 19, 2014 at 9:57 AM, abhishek.pr...@gmail.com wrote: #11 - 3 pts #6- 2 pts Sent from Windows Mail *From:* Uditha Bandara Wijerathna