Hi Can, We are having the same problem. We haven't figured out an exact solution yet. But we are thinking of using an external data store or Zookeeper to store configurations that can change dynamically and change the behavior of the topology. But in this case also we are not solving the problem of adding new workers etc to the topology.
Thanks, Supun.. On Tue, Mar 4, 2014 at 12:28 PM, Can Gencer <[email protected]> wrote: > Hi, > > Bit of a storm newbie here, and we are considering using storm to run some > realtime data analytics. My question is, is there a way to update Storm > topologies programatically? The reason for this is that some of the > elements in the topology would need to be generated on runtime, based on > user input. > > What I understand is that the way to update a topology is to kill the old > one, compile the new one and run the new jar file using storm jar and > StormSubmitter.submitTopology will upload the jar file to the server. > > Instead, I would like to build the topology, and send it to the server > directly all within a separate application, I'm wondering if there's any > way to do this? Not sure how this would even be possible, as the topology > can contain arbitrary Java classes (though the topology changes would not > introduce any new classes), but any help/ideas would be much appreciated. > > Regards, > Can > -- Supun Kamburugamuva Member, Apache Software Foundation; http://www.apache.org E-mail: [email protected]; Mobile: +1 812 369 6762 Blog: http://supunk.blogspot.com
