Storm 1.0.x needs DNS?

It appears nimbus *host name* is used when supervisor attempts to download topology artifacts. Details on http://stackoverflow.com/questions/36654714/error-running-topology-in-production-cluster-with-apache-storm-1-0-0-topology-d Is there any workaround/config that can be manipulated to make storm

Re: Storm 1.0.x needs DNS?

d is that your node can resolve > it's own hostname > In /etc/hosts : > hostname-of-node @ipofnode > > > 2016-06-02 13:05 GMT+02:00 Alberto São Marcos : > >> It appears nimbus *host name* is used when supervisor attempts to >> download topology artifacts. >>

Re: Usage of G1 Garbage collector

indeed, helpful thanks! On Fri, Jun 3, 2016 at 9:31 PM, Spico Florin wrote: > than you very much for sharing these. i hope that others will contribute. > regards, > florin > > > On Friday, June 3, 2016, Stephen Powis wrote: > >> Here's the flags we're using: >> >> -Xms3G -Xmx3G -XX:MaxPermSize=

Re: Too many connections error while using storm-JDBC

I dont think is possible to use the same datasource across topologies/bolts how would u share such a resource across multiple jvms and threads? On Wed, Jun 8, 2016 at 2:49 PM, Jacob Johansen wrote: > In the HikariCPConnectionProvider you need to set the connection pool > smaller or in your MySQL

Re: How to guarantee exactly-once on Kafka messages processing

Trying to do "exactly once" in distributed systems is not the easiest or safest path Francisco. Making the downstream workflow idempotent is usually a lot easier and prolly a much robust solution. On Wed, Jun 8, 2016 at 3:02 PM, Francisco Lopes wrote: > Hello, > > I'm new to Storm/Trident and I

Re: How to guarantee exactly-once on Kafka messages processing

t ensures that state updates are ordered among batches. >> > > I'm wondering though where does Trident these internal txids. Would it be > in memory? Or Zookeeper, maybe? > > Regards, > Francisco > > > On Thu, Jun 9, 2016 at 6:23 AM, Alberto São Marcos > wrote: >

Can WindowedBolt's window-length be changed in runtime?

Like the title states, can one change the window bolt length/count in runtime? Already tried to do it using BaseWindowedBolt API but a NPE is thrown. The property *Map windowConfiguration *is transient and not available in runtime. Is there any way to update the window length/count configuration p

Re: Can WindowedBolt's window-length be changed in runtime?

Thks Satish. On Thu, Jun 23, 2016 at 7:22 PM, Satish Duggana wrote: > No, you can not change windowing configuration at runtime. > > Thanks, > Satish. > > On Thu, Jun 23, 2016 at 11:36 PM, Alberto São Marcos < > alberto@gmail.com> wrote: > >> Like the tit

Re: Can WindowedBolt's window-length be changed in runtime?

ggana wrote: > Hi Alberto, > What is the use case for changing window duration/count at runtime? > > Thanks, > Satish. > > On Thu, Jun 23, 2016 at 11:56 PM, Alberto São Marcos < > alberto@gmail.com> wrote: > >> Thks Satish. >> >> On Thu, Jun

Re: Connection refused during topology deployment

check if this helps http://stackoverflow.com/a/37577370/1864065 On Wed, Jun 29, 2016 at 2:52 AM, Jacob Johansen wrote: > actually, I'm not sure because the one i was having issues with was > 1.0.1, Just realized you were using 10.0.0 > > heres my setup > https://github.com/JacobJohansen/ansible-

Re: Saving raw data in Cassandra before any processing

bolt On Tue, Aug 9, 2016 at 11:59 AM, Bastien DINE wrote: > Hi all, > > > > I’ve RabbitMQ spouts and I want to save all the raw data in Cassandra > before processing those data. > > Can I do this into the spouts or is this better to have a specific bolt > after the spouts for that task ? > > > >

Re: [SURVEY] What version of Storm are you using?

1.0.0 On Wed, Aug 17, 2016 at 4:11 PM, P. Taylor Goetz wrote: > On the Storm developer list, there are a number of discussions regarding > ending support for various older versions of Storm. In order to make an > informed decision I’d like to get an idea of what versions the user > community is

Re: Nimbus Leader Issue - 1 nimbus ok?

Can you run a cluster with one nimbus? Yes you can. Check your network. On Thu, Sep 8, 2016 at 8:29 PM, Joaquin Menchaca wrote: > Can you run a cluster with one nimbus? I am stuck at the moment, maybe > doing something dumb. > > I am getting: > > org.apache.storm.utils.NimbusLeaderNotFoundExcep

Re: [SURVEY] Which external modules (connector) do you use actively?

Storm JMS On Tue, Sep 13, 2016 at 5:30 PM, Kevin Conaway wrote: > We use the Kafka spout on Storm 0.10.0. > > We also make use of the Graphite metrics consumer library from Verisign. > > On Tue, Sep 13, 2016 at 4:57 AM, Jungtaek Lim wrote: > >> Hi users, >> >> We're making some efforts to Storm

Re: Syncing multiple streams to compute final result from a bolt

I would dump the *Bolt-A* results in a shared-data-store/queue and have a separate workflow with another spout and Bolt-B draining from there On Tue, Sep 20, 2016 at 9:20 AM, Harsh Choudhary wrote: > Hi > > I am thinking of doing the following. > > Spout subscribed to Kafka and get JSONs. Spout