Storm 1.0.7 released ?

Hi all, I found a 1.0.7 release tag but there are no release notes or published maven artifacts. What’s the status of Storm 1.0.7 ? Thanks, Manu Zhang

Re: [DISCUSS] Prioritizing works in progress

, Manu Zhang On Tue, Dec 20, 2016 at 3:19 PM Jungtaek Lim wrote: > Hi devs, > > I'm seeing lots of huge works in parallel, and we individual are busy > regarding each work so common works (review, release, documentation, etc.) > have been not made in progress for several month

Re: Can you help on this about performance of topology

Hi Sam, Could you share you topology ? More background information will help us to understand your problem. And what kind of performance do you want to achieve, low latency or high throughput ? Cheers, Manu Zhang On Thu, Nov 17, 2016 at 5:34 AM sam mohel wrote: > Please .Is there any h

Re: How does the control flow in a Trident Topology work?

Hi Li, Here is an old Chinese article on Trident <http://www.cnblogs.com/hseagle/p/3490635.html> that explains the procedure with some images. I think you read Chinese, right ? The article is actually one in a series which may help you more to understand Trident. Cheers, Manu Zhang On Th

Re: Trident Storm kafka spout reading repeated messages

Hi, You set startOffsetTime to "earliest" so that it will always read from the beginning of Kafka. You may try "latest". Thanks, Manu Zhang pramod niralakeri 于2016年9月19日周一 下午1:07写道： > Hi Storm Team, i have deployed storm topology in cluster, working all fine, > only

Re: Flux exception while upgrading to Storm 1.0.2

Hi, Could you share your maven file ? When running `mvn package`, you should see what and which version of jar files are included ? That may give you a hint. Thanks, Manu On Tue, Sep 13, 2016 at 6:50 AM S G wrote: > From the > https://github.com/apache/storm/tree/1.0.x-branch/external/storm-k

Re: How does Storm's OutputCollector work?

Hi T.I., Answered your question on StackOverflow. Hope that helps. Thanks, Manu On Mon, Sep 12, 2016 at 11:36 AM Tech Id wrote: > Hi, > > Can someone help provide a better understanding of Storm's OutputCollector? > A question for the same can be found at > > http://stackoverflow.com/questions

[jira] [Commented] (STORM-1444) Support EXPLAIN statement in StormSQL

[ https://issues.apache.org/jira/browse/STORM-1444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15482839#comment-15482839 ] Manu Zhang commented on STORM-1444: --- I wonder whether this has native suppor

Re: Max supervisor slots

Do you have more required slots than available ? Topologies do not share slots in storm. Manu On Tue, Sep 6, 2016 at 5:50 PM Walid Aljoby wrote: > Hi Manu, > Number of workers is only two per topology. > Thanks--WA From: Manu Zhang > To: Walid Aljoby ; User ; > "

Re: Max supervisor slots

Hi Walid, What's the number of workers you set for each topology ? Manu On Tue, Sep 6, 2016 at 3:44 PM Walid Aljoby wrote: > Hi Everyone, > I have a question please about the maximum typologies that can be > processed by Apache storm production cluster? > Although the number of slots per super

[jira] [Commented] (STORM-2077) KafkaSpout doesn't retry failed tuples

[ https://issues.apache.org/jira/browse/STORM-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15457702#comment-15457702 ] Manu Zhang commented on STORM-2077: --- [~tobiasmaier], have you turned on a

[jira] [Created] (STORM-2080) storm-submit-tools license check failure

Manu Zhang created STORM-2080: - Summary: storm-submit-tools license check failure Key: STORM-2080 URL: https://issues.apache.org/jira/browse/STORM-2080 Project: Apache Storm Issue Type: Bug

Re: Question regarding design of the Trident (operations)

I think we have 'aggregate' in Trident, where the function output fields replace the input fields. Thanks, Manu Zhang On Tue, Aug 30, 2016 at 4:17 PM Jungtaek Lim wrote: > Hi devs, > > While implementing some features of Storm SQL on top of Trident, I realized > t

[jira] [Assigned] (STORM-1459) Allow not specifying producer properties in read-only Kafka table in StormSQL

[ https://issues.apache.org/jira/browse/STORM-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manu Zhang reassigned STORM-1459: - Assignee: Manu Zhang > Allow not specifying producer properties in read-only Kafka table

[jira] [Commented] (STORM-1433) StormSQL Phase II

[ https://issues.apache.org/jira/browse/STORM-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15436248#comment-15436248 ] Manu Zhang commented on STORM-1433: --- Ok, I'd love to work on STORM-1459,

[jira] [Commented] (STORM-1433) StormSQL Phase II

[ https://issues.apache.org/jira/browse/STORM-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15436162#comment-15436162 ] Manu Zhang commented on STORM-1433: --- Yes, I'm interested. I'm famil

Re: error comes when set topology.acker.executors as 0

the realtime result. We don't care so much about real-time and stability, > we want the program to process the high throughput. > > 2016-08-17 12:16 GMT+08:00 Manu Zhang : > > > Hi Hao, > > > > A few questions > > > > - Which version of storm are you

Re: error comes when set topology.acker.executors as 0

her method to improve the throuput when > using trident > > 2016-08-17 11:05 GMT+08:00 Manu Zhang : > > > Hi, > > > > Trident must have ackers to work. You can't set topology.acker.executors > as > > 0. > > > > Thanks, > > Manu > >

Re: error comes when set topology.acker.executors as 0

Hi, Trident must have ackers to work. You can't set topology.acker.executors as 0. Thanks, Manu On Wed, Aug 17, 2016 at 10:50 AM 杨浩 wrote: > I want to improve the throughput of Storm, and I > set topology.acker.executors as 0, then program runs into error. I write > storm using trident, please

Re: storm-sql

> > wondering its value for handling individual tuple via sql, but with > > windowing it would be decent. > > > > If you're interested to contribute this area and would like to cooperate > or > > share the load, please let me know. > > > > Thanks,

storm-sql

d are umbrella jiras for two-phase SQL support. Thanks, Manu Zhang

[jira] [Commented] (STORM-2007) DRPC requests that take a long time to process fail with 500 error code

[ https://issues.apache.org/jira/browse/STORM-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15394861#comment-15394861 ] Manu Zhang commented on STORM-2007: --- [~ppoulosk], which version of storm are you se

[jira] [Commented] (STORM-1435) Build a single jar with dependency for StormSQL dependency

[ https://issues.apache.org/jira/browse/STORM-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15391290#comment-15391290 ] Manu Zhang commented on STORM-1435: --- Why is storm-kafka "provided" for s

Re: Found multiple defaults.yaml resources

Hi Walid, It probably means you build your application jar with storm-core included which is already on the storm classpath. Try making storm-core as "provided" dependency. Thanks, Manu Zhang On Sat, Jul 23, 2016 at 8:32 PM Walid Aljoby wrote: > > Hi Everyone, > I got this

Re: storm 1.0.1 nimbus ha status

the best place to get the current status and upcoming features of storm. Thanks, Manu Zhang On Thu, Jul 21, 2016 at 10:54 PM Renjie Liu wrote: > Hi, all: > I want to ask the status of storm nimbus ha in v1.0.1. I found the design > document but I can not find a tutorial about how to co

[jira] [Commented] (STORM-1433) StormSQL Phase II

[ https://issues.apache.org/jira/browse/STORM-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387194#comment-15387194 ] Manu Zhang commented on STORM-1433: --- [~wheat9] nice work. I'm very inte

Re: Peformance Metrices

Hi Walid, I think Benchmarking Streaming Computation Engines at Yahoo! has the latest storm metrics data although it's 0.10.0 and 0.11.0-SNAPSHOT. You may also check out their Hadoop Summit Talk

Re: Storm Benchmarks

ptgo...@gmail.com <+ptgo...@gmail.com> can help here. On Mon, Jul 18, 2016 at 9:10 PM Walid Aljoby wrote: > Hi Manu Zhang, > > Thank you for your prompt replies. > > I am using Apache storm 1.0.1. So I don't whether it is feasible to > change the version of storm insi

Re: Storm Benchmarks

Hey Walid, storm-benchmark only supports storm 0.9.x for now. Which storm version do you want to run against ? Regards, Manu Zhang On Mon, Jul 18, 2016 at 7:37 PM Walid Aljoby wrote: > Thank you. > You mean that it could not be run with new version of Apache storm? > Regard

Re: Will storm 2.0 be completely rewritten in java?

Hi Renjie, AFAIK, Clojure codes will be migrated to Java in Storm 2.0 and you may check out the master branch of version 2.0.0-SNAPSHOT. Thanks, Manu Zhang On Thu, Jun 16, 2016 at 10:31 AM Renjie Liu wrote: > Hi, storm dev team: > I want to ask whether storm 2.0 will be completely rew

[jira] [Commented] (STORM-1575) TwitterSampleSpout throws NPE on close

[ https://issues.apache.org/jira/browse/STORM-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15317695#comment-15317695 ] Manu Zhang commented on STORM-1575: --- Could any committers look at this ? I'

Re: Merging to Multiple Branches

maybe use scripts like https://github.com/apache/spark/blob/master/dev/merge_spark_pr.py to automatically do so On Sat, May 21, 2016 at 1:48 AM Aaron.Dossett wrote: > Is there a best practice for merging a PR to multiple branches? I have > struggled with that in the past, probably due to short

[jira] [Commented] (STORM-1772) Create topologies for measuring performance

[ https://issues.apache.org/jira/browse/STORM-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15288091#comment-15288091 ] Manu Zhang commented on STORM-1772: --- Thanks, very good suggestions. Maybe not a pr

[jira] [Commented] (STORM-1772) Create topologies for measuring performance

[ https://issues.apache.org/jira/browse/STORM-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277540#comment-15277540 ] Manu Zhang commented on STORM-1772: --- Hi [~roshan_naik], Do you mean [h

Re: Is ganglia like visualvm ?

Hi Sam, Generally, Ganglia gives usage of CPU, Memory, Disk and Network of the whole cluster while visual VM shows CPU and Memory metrics per JVM. If the topology is the only running job on your cluster, Ganglia will let you know whether your topology has fully utilized the resources of the clust

BYLAWS link incorrent in DEVELOPER.md

Hi committers, FYI, The BYLAWS link <https://github.com/apache/storm/blob/master/DEVELOPER.md#approve-a-pull-request> in DEVELOPER.md document is incorrect and returns 404. Thanks, Manu Zhang

[jira] [Updated] (STORM-1575) TwitterSampleSpout throws NPE on close

[ https://issues.apache.org/jira/browse/STORM-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manu Zhang updated STORM-1575: -- Affects Version/s: 2.0.0 1.0.0 > TwitterSampleSpout throws NPE on cl

[jira] [Created] (STORM-1575) TwitterSampleSpout throws NPE on close

Manu Zhang created STORM-1575: - Summary: TwitterSampleSpout throws NPE on close Key: STORM-1575 URL: https://issues.apache.org/jira/browse/STORM-1575 Project: Apache Storm Issue Type: Bug

Re: java.lang.OutOfMemoryError: Direct buffer memory

It could be other issues that trigger these netty connection problems and finally OOM. Could you check your supervisor log and nimbus log as well ? On Thu, Dec 17, 2015 at 3:46 PM, ght230 wrote: > Hi : > > I ran a simple wordcount topology on storm0.9.6, found 2 abnormal behaviors > 1. Netty rec

[jira] [Commented] (STORM-297) Storm Performance cannot be scaled up by adding more CPU cores

[ https://issues.apache.org/jira/browse/STORM-297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639778#comment-14639778 ] Manu Zhang commented on STORM-297: -- [~jia.fu] This jira is resolved. You can get hel

Re: ExecutorSummary get_stats returns null

t1 > 181047 [main] WARN storm.benchmark.metrics.BasicMetricsCollector - > executor stats not found for component: bolt1 > 181047 [main] WARN storm.benchmark.metrics.BasicMetricsCollector - > executor stats not found for component: bolt1 > 181047 [main] WARN storm.benchmark.metrics.Basic

Re: ExecutorSummary get_stats returns null

your wordcount benchmark with 4 > workers, 4 spouts, 4 splits, 4 counts and 2 ack executor bolts. I set the > polling interval to 5 seconds and total running time to 3 minutes. > > Jack > > Jack > > On Mon, Jul 20, 2015 at 6:09 PM, Manu Zhang > wrote: > > > Jack, >

Re: ExecutorSummary get_stats returns null

e executors stats for each spout/bolt if I > query the REST API directly, but prefer not to do this. > > Jack > > Jack > > On Mon, Jul 20, 2015 at 3:35 PM, Manu Zhang > wrote: > > > Hi Jack, > > > > Could you check if there are any executors up ? > >

Re: ExecutorSummary get_stats returns null

Hi Jack, Could you check if there are any executors up ? Thanks, Manu Zhang On Tue, Jul 21, 2015 at 1:30 AM, Jack wrote: > I'm trying to get ExecutorStats from ExecutorSummary but it always returns > null. Is there some sort of configuration I need to set before I can get > t

Re: Aeolus 0.1 available

Hi Matthias, The project looks interesting. Any detailed performance data compared with latest storm versions (0.9.3 / 0.9.4) ? Thanks, Manu Zhang On Tue, May 26, 2015 at 11:52 PM, Matthias J. Sax < mj...@informatik.hu-berlin.de> wrote: > Dear Storm community, > > we would li