Community over Code EU 2024 Travel Assistance Applications now open!

P. We look forward to greeting many of you in Bratislava, Slovakia in June, 2024! Kind Regards, Chris (On behalf of the Travel Assistance Committee) When replying, please reply to travel-assista...@apache.org -- *Julien Nioche * Director digitalpebble.com <http://www.digitalpebble.com/>

Docker images

ou can find it at https://github.com/apache/storm-docker. Massive thanks to Richard Zowalla for taking care of most of the work with the transition and publishing of the images. All the best, -- *Julien Nioche * digitalpebble.com <http://www.digitalpebble.com/>

Re: Nightlies and Snapshot artifacts of Storm

port > possible issues early. > > We might need to fine-tune these artifacts uploaded to nightlies.ao to > include a commit hash or similar (good thing for 1st time contributors, > I guess ;-) ) or keep a history of (for example) 7 builds, but as a > first step, we are fine now. &

CVE-2023-43123: Apache Storm: Local Information Disclosure Vulnerability in Storm-core on Unix-Like systems due temporary files

Severity: low Affected versions: - Apache Storm 2.0.0 before 2.6.0 Description: On unix-like systems, the temporary directory is shared between all user. As such, writing to this directory using APIs that do not explicitly set the file/directory permissions can lead to information disclosure.

[ANNOUNCE] Apache Storm 2.6.0 Released

The Apache Storm community is pleased to announce the release of Apache Storm version 2.6.0. Apache Storm is a distributed, fault-tolerant, and high-performance realtime computation system that provides strong guarantees on the processing of data. You can read more about Apache Storm on the projec

Re: [DISCUSS] Call for PMC Members and Contributors

Hi, As mentioned previously, I would like to volunteer to support the project as a PMC Member/Committer Thanks Julien On Wed, 1 Mar 2023 at 05:09, P. Taylor Goetz wrote: > Thank you both for your willingness to help the project. > > Stay tuned. > > -Taylor > > > On Feb 25, 2023, at 10:15 AM,

Re: [DISCUSSION] Apache Storm and moving to the Attic

Hi, I'd be happy to get involved. I haven't delved deep into Storm's code but have been using it for years and my project StormCrawler relies heavily on it. I have been a committer on several Apache projects but not been active in any of them for a while. I know that there are loads of StormCrawle

Re: Storm Log4j update to 2.17.1

Hi Ashley There isn't, according to https://github.com/apache/storm/pull/3427#issuecomment-1006010073 Julien On Thu, 13 Jan 2022 at 19:35, wrote: > Is there an ETA for upgrading log4j to 2.17.1 for Storm? > > > > > > Thanks, > > > > *Ashley Dingman* > > Sr. Systems Operations Engineer > > Well

Re: Cannot access Storm UI from Docker container with official image on Docker Hub

Hi Shashi, The UI needs to run as a service alongside the ones you already have in your docker-compose. Try adding something like this: * ui:image: stormcontainer_name: uicommand: storm ui depends_on: - nimbuslinks: - nimbusrestart: always ports: - 80

Re: Kryo errors after upgrading to Storm 2.0

. We had more issues with storm 2, > mostly because of way how we are using and configured it and we ended with > staying with Storm 1.2.3. > I wonder why only we observed this issue. Like you, we also have custom > kryo serializers used. > > Best regards, > Michal > > ---

Re: Worker never starts

Hi Srikanth 1. Where exactly can we configure the worker nodes? because I am not able > to identify any worker node related configurations in *storm.yaml *file > attached. > > > See if this link > https://storm.apache.org/releases/2.1.0/Setting-up-a-Storm-cluster.html can > help you with it. You n

Re: Kryo errors after upgrading to Storm 2.0

Hi, I am observing the same issues as Michal did back in June. My code works fine with Storm 1.x but the workers crash constantly with Storm 2.x Some exceptions look like *com.esotericsoftware.kryo.KryoException: Buffer underflow. at com.esotericsoftware.kryo.io.Input.require(Input.java:199)

Re: Recordings of Storm 2.0 talks at the Bay Area Hadoop Meetup last week.

Thanks Roshan! On Tue, 5 Nov 2019 at 23:31, Roshan Naik wrote: > > 1- Raising the performance bar for stream processing with Apache Storm 2.0 > - Roshan Naik, (Uber) > > Discussion of performance improvements as well as the new 2.0 architecture > for messaging subsystem, threading model & back p

Re: 2.0 release?

gt;> >> >> We have been running our integration tests on master nightly, but that is >> a compatibility mode where we are running older topologies on newer >> nimbus+supervisors and everything has been going more or less fine. Some >> random failures that we ar

2.0 release?

Hi, How close are we to having a 2.0.0 release? Are there any blockers? Thanks Julien -- *Open Source Solutions for Text Engineering* http://www.digitalpebble.com http://digitalpebble.blogspot.com/ #digitalpebble

Re: Worker profiling on 1.2.1

Done, see https://github.com/apache/storm/pull/2607 On 27 March 2018 at 11:17, Julien Nioche wrote: > Hi Jungtaek > > I had to move to a different server and can't reproduce the same issue > anymore. I can now see the 'start' option on the UI. > > I had to m

Re: Worker profiling on 1.2.1

network tab, and find the request which path is like > '/api/v1/topology/:id/component/:component'. > > http://storm.apache.org/releases/1.2.1/STORM-UI-REST-API.html > > And which OS does Storm is running on? > > Thanks, > Jungtaek Lim (HeartSaVioR) > > 2018년

Re: Worker profiling on 1.2.1

tions to enable java profilers via the > topology.worker.childopts when submitting the topology. > > -Roshan > > Sent from Yahoo Mail for iPhone > <https://overview.mail.yahoo.com/?.src=iOS> > > > On Monday, March 19, 2018, 4:29 AM, Julien Nioche < > lists.d

Worker profiling on 1.2.1

Hi, I am using Storm 1.2.1 and want to profile my workers. I've set *worker.profiler.enabled* to true in the config and the UI's showing the values below so everything should be fine. I've modified the childopts so that it works with Oracle Java 9 and flight.bash works when I run it manually. wor

Re: Setting number of tasks against executors via Flux

See https://github.com/apache/storm/pull/2139/files On 14 February 2017 at 09:28, anshu shukla wrote: > +1 > > On Fri, Aug 26, 2016 at 4:48 PM, Nathan Trevivian > wrote: > >> Hi all, >> >> I've been using Flux to configure my topologies, but have noticed that it >> doesn't let you specify the

Re: Visualizing Storm Metrics

Hi, I usually store the metrics in Elasticsearch with the MetricsConsumer from StormCrawler ( https://github.com/DigitalPebble/storm-crawler/tree/master/external/elasticsearch) and visualise with Kibana and/or Grafana. Julien On 19 April 2017 at 21:28, preethini v wrote: > Hi, > > Can anyone h

Re: Is there a Storm hosted/cloud solution somewhere available?

Hi André Microsoft provide Storm as a service on their HDInsight platform https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-storm-overview HTH Julien On 23 January 2017 at 10:42, André Martin wrote: > Dear Storm users, > I was wondering if there is a cloud hosted storm solution somew

Storm-related interview on Linux.com

Hi, FYI, Linux.com have just published an interview [1] I gave on StormCrawler in advance of the presentation I'll be giving at ApacheCon [2] in November. Anyone going to ApacheCon in the Storm community, feel free to find me there and have a chat. Have a nice day Juli

Re: Storm monitoring

Hi, I had written a MetricsConsumer for CloudWatch some time ago. The code would need reworking a bit, I might release it if I find the time. For StormCrawler topologies, our Elasticsearch module

Re: tune up storm

Hi Joshua https://www.manning.com/books/storm-applied has a section on tuning which you might find useful. Julien On 23 May 2016 at 08:44, fanxi...@travelsky.com wrote: > Hi All, > > Is there any recommended articles or books about tuning up performance of > Storm? > > Tried hard in google b

Re: Spout Thread Waiting

tormcrawler <http://stackoverflow.com/questions/tagged/stormcrawler> on StackOverflow. HTH Julien > > 2016-05-09 22:27 GMT+02:00 Julien Nioche : > >> Hi Adrien >> >> Did you set a value to max spout pending? Could it be that you have >> reached the max nu

Re: Spout Thread Waiting

Hi Adrien Did you set a value to max spout pending? Could it be that you have reached the max number of tuples in process? Do you see acks or fails happen during that period? Great to hear that you are using StormCrawler BTW Julien On 9 May 2016 at 20:48, Adrien Carreira wrote: > I think the

Re: thread safe output collector

etz > wrote: > >> IIRC there was discussion about making it thread safe, but I don't >> believe it was implemented. >> >> -Taylor >> >> On Apr 28, 2016, at 3:52 AM, Julien Nioche >> wrote: >> >> Hi Stephen >> >> I asked

Re: thread safe output collector

Hi Stephen I asked the same question in February but did not get a reply https://mail-archives.apache.org/mod_mbox/storm-user/201602.mbox/%3cca+-fm0urpf3fuerozywpzmxu-kdbgf-zj3wbyr8evsaqjc6...@mail.gmail.com%3E Anyone who could confirm this? Thanks On 27 April 2016 at 14:05, Steven Lewis wrot

Re: storm ui, execute latency of multi-lang

Hi Xiang For your question #2, assuming ShellBolt is used, the execute method just creates the message to send and stores it before exiting, hence the low latency shown on the UI - see https://github.com/apache/storm/blob/master/storm-core/src/jvm/org/apache/storm/task/ShellBolt.java#L148 You cou

Re: external/storm-elasticsearch - upgrade requested

FYI there is an ES module in StormCrawler [ https://github.com/DigitalPebble/storm-crawler/tree/master/external/elasticsearch], its components are quite specific to storm-crawler apart from the MetricsComsumer

Re: Is SpoutOutputCollector thread-safe?

Is that true of all OutputCollectors or just SpoutOutputCollector? Is http://storm.apache.org/documentation/Troubleshooting.html#nullpointerexception-from-deep-inside-storm still an issue with 0.10.0 and above? Couldn't find any referenc