Re: Peformance Metrices

Many thanks Manu. Is the implementation available online? --RegardsWalid From: Manu Zhang To: d...@storm.apache.org; Walid Aljoby ; User Sent: Thursday, July 21, 2016 9:21 AM Subject: Re: Peformance Metrices Hi Walid, I think Benchmarking Streaming Computation Engines at Yahoo! ha

Re: Peformance Metrices

Thank you Jungtaek. Do you know how can I get the implementation of microbenchmarking?Is it available online? Thank you --WA From: Jungtaek Lim To: d...@storm.apache.org; Walid Aljoby ; User Sent: Thursday, July 21, 2016 9:39 AM Subject: Re: Peformance Metrices If you're not focuse

Re: Peformance Metrices

If you're not focused to comparison of streaming frameworks, check out this micro-benchmark result. http://hortonworks.com/blog/microbenchmarking-storm-1-0-performance/ Hope this helps. Thanks, Jungtaek Lim (HeartSaVioR) 2016년 7월 21일 (목) 오전 10:22, Manu Zhang 님이 작성: > Hi Walid, > > I think Benc

Re: Peformance Metrices

Hi Walid, I think Benchmarking Streaming Computation Engines at Yahoo! has the latest storm metrics data although it's 0.10.0 and 0.11.0-SNAPSHOT. You may also check out their Hadoop Summit Talk

Re: Trident HBaseState query and update ordering

Arun, Thank you for your prompt reply and helpful information. I just want to quickly clarify: Setting topology.max.spout.pending to 1 allows only one batch at a time to be processed anywhere in the topology. So as long as Batch 1 has not yet reached the end of the whole topology, Batch 2 will

Re: Is there a reason storm has a default of 4 ports?

It's not recommended to run more than one topology on the same server cluster as it can make it difficult to monitor and optimize. I usually only use one slot (JVM) per node. I remember reading somewhere where that is recommended too. On Wed, Jul 20, 2016 at 7:22 AM, Navin Ipe wrote: > From what

Re: Is there a reason storm has a default of 4 ports?

>From what I know, you can figure out how much memory your application needs and allocate the memory as shown below. The below code allocates 2GiB of memory for each worker of the topology. Config stormConfig = new Config(); stormConfig.put(Config.TOPOLOGY_WORKER_CHILDOPTS, "-Xmx2g"); On Tue, Jul

Peformance Metrices

Hi Everyone, Anyone can please recommend common communication metrics like (latency and throughput), which can be work with storm version 1.0.1? Thank you.. --RegardsWA

Re: Doesn't every supervisor have a default 4 slots?

Update: As of now, setting the ports manually in each supervisor and restarting the supervisors and nimbus made it work. It doesn't seem to work if you simply expect the default 4 nodes to get used. On Tue, Jul 19, 2016 at 1:00 PM, Navin Ipe wrote: > setNumWorkers is already set to 1 for all top