New Metrics2 error in documentation

2018-05-24 Thread Alessio Pagliari
Hello, While trying the new Metrics2 in Storm 1.2.1, I noticed an error in the online documentation (http://storm.apache.org/releases/1.2.1/metrics_v2.html ): > > CSV Reporter (org.apache.storm.metrics2.reporters.CsvReporter): Reports

Re: Resource Aware Scheduler Kills Nimbus

2018-02-19 Thread Alessio Pagliari
Hi Wuyang, This is a nice question, I didn’t find anything that computes it automatically, yet. By now you have to test your topology tuning the resource requirements until you don’t find pleasing values. Cheers, Alessio > On 10 Feb 2018, at 21:42, Wuyang Zhang

Re: Display ackers executors

2018-07-20 Thread Alessio Pagliari
> <https://fubariteblue-ni.blue.ygrid.yahoo.com:4443/api/v1/topology/cb_reporting_cow_updates-612-1531172361/component/__acker?sys=true> > > > > >> On Jul 19, 2018, at 11:50 AM, Alessio Pagliari > <mailto:pagli...@i3s.unice.fr>> wrote: >> >> Thank you Ethan, I tota

Re: Display ackers executors

2018-07-19 Thread Alessio Pagliari
st, > Ethan > >> On Jul 19, 2018, at 11:04 AM, Alessio Pagliari wrote: >> >> Hello everybody, >> >> I cannot find a way to show in the UI or retrieve through REST APIs the >> placement of the acker executors. Is there a way to get this information? I

Display ackers executors

2018-07-19 Thread Alessio Pagliari
Hello everybody, I cannot find a way to show in the UI or retrieve through REST APIs the placement of the acker executors. Is there a way to get this information? I remember that in some topologies in the past I was able to see them in the UI with the name ‘__acker’, but now I can’t understand

Re: Storm throughput

2018-04-04 Thread Alessio Pagliari
ple benchmark topologies that I found online, I enabled the option setDebug(true); printing an output message for each tuple was slowing me down, now I’m able to reach a spout emission rate of ~4.5M tuples per second. Thank you all for the support. -- Alessio Pagliari Scale Team, PhD Stud

Re: Running multiple topologies

2018-04-12 Thread Alessio Pagliari
, -- Alessio Pagliari Scale Team, PhD Student Université Côte d’Azur, CNRS, I3S > On 12 Apr 2018, at 20:51, Ethan Li <ethanopensou...@gmail.com> wrote: > > Hi Daniel, > > I am not sure if I understand your questions correctly. But will the resource > aware scheduler hel

Storm benchmarks: UI stat updates

2018-04-20 Thread Alessio Pagliari
where I can deepen this aspect. Thank you, -- Alessio Pagliari Scale/Signet Team, PhD Student Université Côte d’Azur, CNRS, I3S Website: http://www.i3s.unice.fr/~pagliari/ <http://www.i3s.unice.fr/~pagliari/>

Storm throughput

2018-03-30 Thread Alessio Pagliari
Hi everybody, I’m trying to do some preliminary tests with storm, to understand how far it can go. Now I’m focusing on trying to understand which is his maximum throughput in terms of tuples per second. I saw the benchmark done by the guys at Hortonworks (ref:

Re: Storm throughput

2018-03-30 Thread Alessio Pagliari
4-6vCores > >Jacob Johansen > >On Fri, Mar 30, 2018 at 9:18 AM, Alessio Pagliari ><pagli...@i3s.unice.fr> >wrote: > >> Hi everybody, >> >> I’m trying to do some preliminary tests with storm, to understand how >far >> it can go. Now I’m focus

Modifying tasks number during scheduling

2018-09-19 Thread Alessio Pagliari
Hi guys, I was playing a bit with a Custom Scheduler to understand how it works. I was wondering, is there a way to change the number of tasks for a certain component from the Scheduler class? Like for example if during the scheduling I'd like to increase or decrease the number of the spouts?