Re: Verification about my observation for current State implementation

2018-02-20 Thread Arun Iyer
correction: task count remains the same (executor count can vary). On 2/20/18, 11:20 AM, "Arun Iyer on behalf of Arun Mahadevan" <ai...@hortonworks.com on behalf of ar...@apache.org> wrote: >Hi Jungtaek, > > >1. Right now users need to vary the database/tabl

Re: [VOTE] Release Apache Storm 1.2.0 (rc4)

2018-02-09 Thread Arun Iyer
+1 (binding) - Downloaded and built the source distribution - Downloaded the binary distributions - Validated MD5 - Complied starter topologies from binary distribution - Ran ExclamationTopology and RollingTopWords - Checked the metrics from Storm UI - Check logs via log viewer - Listed and

Re: [Discuss] Release Storm 1.2.0

2017-11-16 Thread Arun Iyer
Hi Taylor, Is it https://github.com/apache/storm/pull/2203 ? I think it would be great to get this in 1.2 release. Can we try to address the issues in a week or so and get this in? Thanks, Arun On 11/17/17, 7:13 AM, "P. Taylor Goetz" wrote: >The original idea for the 1.2

Re: [Discussion]: Storm Improvemement Proposal (SIP) to discuss changes

2017-06-09 Thread Arun Iyer
I am for documenting and upfront design reviews, but maybe we should keep it less formal and make it part of the JIRA to start with. Do we have any upcoming features for which we would like to see a proposal? May be start with a couple of proposals and see it works out before making it formal.

Re: [DISCUSS] Move non-connectors modules to out of external

2017-03-24 Thread Arun Iyer
+1 Makes sense to move the non-connectors to top level and keep only the connectors under “connectors” folder. On 3/24/17, 12:00 PM, "Jungtaek Lim" wrote: >(Sent this yesterday but can't find this from storm-dev mbox... sending it >again) > >Hi dev, > >I'd like to start

Re: STORM JIRA being spammed - CANNOT comment on JIRA (as a result of the counter spam measures)

2016-05-12 Thread Arun Iyer
Please add me to committer list. id: arunmahadevan On 5/13/16, 9:19 AM, "Arun Iyer" <ai...@hortonworks.com> wrote: >Right now not able to comment or create JIRAs. Please add me too. > > > >On 5/13/16, 4:47 AM, "Jungtaek Lim" <kabh...@gmail.com>

Re: STORM JIRA being spammed - CANNOT comment on JIRA (as a result of the counter spam measures)

2016-05-12 Thread Arun Iyer
Right now not able to comment or create JIRAs. Please add me too. On 5/13/16, 4:47 AM, "Jungtaek Lim" wrote: >I can't access admin page for STORM project, too. >Maybe I'm also not part of committers/PMCs list, or admin page is not >accessible by role but grant access for

Re: Trident pipelining and transactional properties

2016-02-11 Thread Arun Iyer
Hi Felix, What you have described is correct. The commits are ordered i.e batch 1, batch 2 etc in that order, even if batch 2 tuples completes processing before batch 1 (with pipelining). - Arun On 2/9/16, 4:55 AM, "Felix Dreissig" wrote: >Thanks for your quick replies, Bobby

Re: Sum of values of current minute

2016-01-03 Thread Arun Iyer
Hi Daniela, Windowing support was recently added to storm master. I think a time based tumbling window of 1 min duration is what you are looking for. Take a look at the windowing docs [1] and the example topology [2]. You also need to set ‘topology.message.timeout.secs’ more than 1 min and

Re: How to get number of tasks from TopologyContext

2015-12-16 Thread Arun Iyer
TopologyContext.getComponentTasks returns the list of task ids for the component (not executor ids). You could just try printing the output of getComponentTasks in the prepare method after doing 'setNumTasks’ (with task > parallelism) while building the topology. Worked for me. - Arun On

Re: How to rotate file incase of storm worker fails?

2015-09-10 Thread Arun Iyer
Sachin, STORM-969 makes use of tick tuple to periodically ack and flush the tuples so the scenario you mentioned would not happen. The tickTupleInterval is configurable. - Arun On 9/9/15, 11:47 PM, "Sachin Pasalkar" wrote: >Hi, > >I was looking at code where