Anton Alfred created STORM-3776:
-----------------------------------

             Summary: Ability to change the configuration of a topology without 
restarting
                 Key: STORM-3776
                 URL: https://issues.apache.org/jira/browse/STORM-3776
             Project: Apache Storm
          Issue Type: New Feature
          Components: storm-core
            Reporter: Anton Alfred


Have gone through this issue of Autoscale 
https://issues.apache.org/jira/browse/STORM-594.

We are trying a simpler approach for scaling in and out.

We create a topic in Kafka and would want to start processing the messages in 
the topology by having one worker.

As the lag in topic in Kafka increases, we want to be able to intimate Storm 
nimbus to change the topology workers and the number of executors in the bolts. 
Once this is done the topology should detect this change and scale out without 
needing a restart. Once we monitor the Kafka lag coming down, we want to send 
the scale in signal to the Storm nimbus to change back.

Currently due to no support for dynamic changes, we are forced to restart the 
topology when configuration changes...

 

 

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to