Re: ExecutorSummary get_stats returns null

the executors stats for each spout/bolt if I query the REST API directly, but prefer not to do this. Jack Jack On Mon, Jul 20, 2015 at 3:35 PM, Manu Zhang owenzhang1...@gmail.com wrote: Hi Jack, Could you check if there are any executors up ? Thanks, Manu Zhang On Tue, Jul 21

Re: ExecutorSummary get_stats returns null

Hi Jack, Could you check if there are any executors up ? Thanks, Manu Zhang On Tue, Jul 21, 2015 at 1:30 AM, Jack jack.in.teh@gmail.com wrote: I'm trying to get ExecutorStats from ExecutorSummary but it always returns null. Is there some sort of configuration I need to set before I can

Re: ExecutorSummary get_stats returns null

with your wordcount benchmark with 4 workers, 4 spouts, 4 splits, 4 counts and 2 ack executor bolts. I set the polling interval to 5 seconds and total running time to 3 minutes. Jack Jack On Mon, Jul 20, 2015 at 6:09 PM, Manu Zhang owenzhang1...@gmail.com wrote: Jack, Which Storm

Re: Will storm 2.0 be completely rewritten in java?

Hi Renjie, AFAIK, Clojure codes will be migrated to Java in Storm 2.0 and you may check out the master branch of version 2.0.0-SNAPSHOT. Thanks, Manu Zhang On Thu, Jun 16, 2016 at 10:31 AM Renjie Liu <liurenjie2...@gmail.com> wrote: > Hi, storm dev team: > I want to ask wheth

Re: Is ganglia like visualvm ?

Hi Sam, Generally, Ganglia gives usage of CPU, Memory, Disk and Network of the whole cluster while visual VM shows CPU and Memory metrics per JVM. If the topology is the only running job on your cluster, Ganglia will let you know whether your topology has fully utilized the resources of the

Re: Merging to Multiple Branches

maybe use scripts like https://github.com/apache/spark/blob/master/dev/merge_spark_pr.py to automatically do so On Sat, May 21, 2016 at 1:48 AM Aaron.Dossett wrote: > Is there a best practice for merging a PR to multiple branches? I have > struggled with that in the

Re: storm-sql

out is sql with storm-core & windowing. I'm > > wondering its value for handling individual tuple via sql, but with > > windowing it would be decent. > > > > If you're interested to contribute this area and would like to cooperate > or > > share the load, please let me kno

Re: Peformance Metrices

Hi Walid, I think Benchmarking Streaming Computation Engines at Yahoo! has the latest storm metrics data although it's 0.10.0 and 0.11.0-SNAPSHOT. You may also check out their Hadoop Summit Talk

Re: Storm Benchmarks

...@gmail.com <+ptgo...@gmail.com> can help here. On Mon, Jul 18, 2016 at 9:10 PM Walid Aljoby <walid_alj...@yahoo.com> wrote: > Hi Manu Zhang, > > Thank you for your prompt replies. > > I am using Apache storm 1.0.1. So I don't whether it is feasible to > change the v

Re: Storm Benchmarks

Hey Walid, storm-benchmark only supports storm 0.9.x for now. Which storm version do you want to run against ? Regards, Manu Zhang On Mon, Jul 18, 2016 at 7:37 PM Walid Aljoby <walid_alj...@yahoo.com.invalid> wrote: > Thank you. > You mean that it could not be run with new versi

storm-sql

are umbrella jiras for two-phase SQL support. Thanks, Manu Zhang

Re: Found multiple defaults.yaml resources

Hi Walid, It probably means you build your application jar with storm-core included which is already on the storm classpath. Try making storm-core as "provided" dependency. Thanks, Manu Zhang On Sat, Jul 23, 2016 at 8:32 PM Walid Aljoby <walid_alj...@yahoo.com.invalid> wrote:

Re: storm 1.0.1 nimbus ha status

place to get the current status and upcoming features of storm. Thanks, Manu Zhang On Thu, Jul 21, 2016 at 10:54 PM Renjie Liu <liurenjie2...@gmail.com> wrote: > Hi, all: > I want to ask the status of storm nimbus ha in v1.0.1. I found the design > document but I can not find a tuto

Re: error comes when set topology.acker.executors as 0

there any other method to improve the throuput when > using trident > > 2016-08-17 11:05 GMT+08:00 Manu Zhang <owenzhang1...@gmail.com>: > > > Hi, > > > > Trident must have ackers to work. You can't set topology.acker.executors > as > > 0. > > >

Re: error comes when set topology.acker.executors as 0

Hi, Trident must have ackers to work. You can't set topology.acker.executors as 0. Thanks, Manu On Wed, Aug 17, 2016 at 10:50 AM 杨浩 wrote: > I want to improve the throughput of Storm, and I > set topology.acker.executors as 0, then program runs into error. I write > storm

Re: Max supervisor slots

Do you have more required slots than available ? Topologies do not share slots in storm. Manu On Tue, Sep 6, 2016 at 5:50 PM Walid Aljoby <walid_alj...@yahoo.com.invalid> wrote: > Hi Manu, > Number of workers is only two per topology. > Thanks--WA From: Manu Zhang <owenz

Re: Max supervisor slots

Hi Walid, What's the number of workers you set for each topology ? Manu On Tue, Sep 6, 2016 at 3:44 PM Walid Aljoby wrote: > Hi Everyone, > I have a question please about the maximum typologies that can be > processed by Apache storm production cluster? >

Re: Question regarding design of the Trident (operations)

I think we have 'aggregate' in Trident, where the function output fields replace the input fields. Thanks, Manu Zhang On Tue, Aug 30, 2016 at 4:17 PM Jungtaek Lim <kabh...@gmail.com> wrote: > Hi devs, > > While implementing some features of Storm SQL on top of Trident, I realized

Re: How does Storm's OutputCollector work?

Hi T.I., Answered your question on StackOverflow. Hope that helps. Thanks, Manu On Mon, Sep 12, 2016 at 11:36 AM Tech Id wrote: > Hi, > > Can someone help provide a better understanding of Storm's OutputCollector? > A question for the same can be found at > >

Re: Flux exception while upgrading to Storm 1.0.2

Hi, Could you share your maven file ? When running `mvn package`, you should see what and which version of jar files are included ? That may give you a hint. Thanks, Manu On Tue, Sep 13, 2016 at 6:50 AM S G wrote: > From the >

Re: Trident Storm kafka spout reading repeated messages

Hi, You set startOffsetTime to "earliest" so that it will always read from the beginning of Kafka. You may try "latest". Thanks, Manu Zhang pramod niralakeri <pramod.niralak...@gmail.com>于2016年9月19日周一 下午1:07写道： > Hi Storm Team, i have deployed storm topology

Re: error comes when set topology.acker.executors as 0

program to update > the realtime result. We don't care so much about real-time and stability, > we want the program to process the high throughput. > > 2016-08-17 12:16 GMT+08:00 Manu Zhang <owenzhang1...@gmail.com>: > > > Hi Hao, > > > > A few questions >

Re: Can you help on this about performance of topology

Hi Sam, Could you share you topology ? More background information will help us to understand your problem. And what kind of performance do you want to achieve, low latency or high throughput ? Cheers, Manu Zhang On Thu, Nov 17, 2016 at 5:34 AM sam mohel <sammoh...@gmail.com> wrote: &g

Re: How does the control flow in a Trident Topology work?

Hi Li, Here is an old Chinese article on Trident <http://www.cnblogs.com/hseagle/p/3490635.html> that explains the procedure with some images. I think you read Chinese, right ? The article is actually one in a series which may help you more to understand Trident. Cheers, Manu Zhang On Th

Re: [DISCUSS] Prioritizing works in progress

, Manu Zhang On Tue, Dec 20, 2016 at 3:19 PM Jungtaek Lim <kabh...@gmail.com> wrote: > Hi devs, > > I'm seeing lots of huge works in parallel, and we individual are busy > regarding each work so common works (review, release, documentation, etc.) > have been not made in progre

Storm 1.0.7 released ?

Hi all, I found a 1.0.7 release tag but there are no release notes or published maven artifacts. What’s the status of Storm 1.0.7 ? Thanks, Manu Zhang

[jira] [Commented] (STORM-297) Storm Performance cannot be scaled up by adding more CPU cores

[ https://issues.apache.org/jira/browse/STORM-297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639778#comment-14639778 ] Manu Zhang commented on STORM-297: -- [~jia.fu] This jira is resolved. You can get help

[jira] [Created] (STORM-1575) TwitterSampleSpout throws NPE on close

Manu Zhang created STORM-1575: - Summary: TwitterSampleSpout throws NPE on close Key: STORM-1575 URL: https://issues.apache.org/jira/browse/STORM-1575 Project: Apache Storm Issue Type: Bug

[jira] [Commented] (STORM-1772) Create topologies for measuring performance

[ https://issues.apache.org/jira/browse/STORM-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15288091#comment-15288091 ] Manu Zhang commented on STORM-1772: --- Thanks, very good suggestions. Maybe not a proper place to ask

[jira] [Commented] (STORM-1772) Create topologies for measuring performance

[ https://issues.apache.org/jira/browse/STORM-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15277540#comment-15277540 ] Manu Zhang commented on STORM-1772: --- Hi [~roshan_naik], Do you mean [https://github.com/intel-hadoop

[jira] [Commented] (STORM-1435) Build a single jar with dependency for StormSQL dependency

[ https://issues.apache.org/jira/browse/STORM-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391290#comment-15391290 ] Manu Zhang commented on STORM-1435: --- Why is storm-kafka "provided" for storm-sql-kafka, whi

[jira] [Commented] (STORM-1433) StormSQL Phase II

[ https://issues.apache.org/jira/browse/STORM-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15387194#comment-15387194 ] Manu Zhang commented on STORM-1433: --- [~wheat9] nice work. I'm very interested in contributing

[jira] [Commented] (STORM-1433) StormSQL Phase II

[ https://issues.apache.org/jira/browse/STORM-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436162#comment-15436162 ] Manu Zhang commented on STORM-1433: --- Yes, I'm interested. I'm familiar with Storm/Trident but new

[jira] [Assigned] (STORM-1459) Allow not specifying producer properties in read-only Kafka table in StormSQL

[ https://issues.apache.org/jira/browse/STORM-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manu Zhang reassigned STORM-1459: - Assignee: Manu Zhang > Allow not specifying producer properties in read-only Kafka ta

[jira] [Commented] (STORM-1433) StormSQL Phase II

[ https://issues.apache.org/jira/browse/STORM-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436248#comment-15436248 ] Manu Zhang commented on STORM-1433: --- Ok, I'd love to work on STORM-1459, could you assign it to me

[jira] [Created] (STORM-2080) storm-submit-tools license check failure

Manu Zhang created STORM-2080: - Summary: storm-submit-tools license check failure Key: STORM-2080 URL: https://issues.apache.org/jira/browse/STORM-2080 Project: Apache Storm Issue Type: Bug

[jira] [Commented] (STORM-2077) KafkaSpout doesn't retry failed tuples

[ https://issues.apache.org/jira/browse/STORM-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457702#comment-15457702 ] Manu Zhang commented on STORM-2077: --- [~tobiasmaier], have you turned on acker ? > KafkaSpout does

[jira] [Commented] (STORM-1444) Support EXPLAIN statement in StormSQL

[ https://issues.apache.org/jira/browse/STORM-1444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15482839#comment-15482839 ] Manu Zhang commented on STORM-1444: --- I wonder whether this has native support in Calcite. > Supp