Hi, I am running storm (forked from apache storm master) using a local server. My nimbus, supervisor and zookeeper are on the same machine. I have one spout which is a version of the WordCountTopology. I also have 2 bolts to split sentences and count unique words. The spout and bolts start with 1 executor and one task.
The topology runs fine and executes as expected in local mode (using maven). However, when i run it with the local server setup described above, the re-balance API does not seem to work. I'm re-balancing my topology to use 2 executors fr the spout and bolt. There is no error and the logs look like the API is trying to re-balance. But there is no change in the number of executors. I've attached the sceen shots of my UI tool and commands to re-balance. Please help. FYI: The one red flag for me is, there is no re-balance log file in the log directory (all other components have a log file) and I've seen the re-balance log being created before. Thanks, Harsha *Contact Details: * Harsha Balasubramanian Graduate Student at University of Toronto Masters in Computer Science Email: [email protected] LinkedIn : ca.linkedin.com/in/harshabala/
c:\storm\bin>c:\Python27\python storm rebalance SentenceSplit-WordCount -e TestSpout=2 Running: c:\java\bin\java -client -Dstorm.options= -Dstorm.home=c:\storm -Dstorm.log.dir=c:\storm\logs -Djava.library.path=c:/java/lib -Dstorm.conf.file= -cp c:\storm\lib -4.0.jar;c:\storm\lib\carbonite-1.4.0.jar;c:\storm\lib\chill-java-0.3.5.jar;c:\storm\lib\clj-stacktrace-0.2.7.jar;c:\storm\lib\clj-time-0.8.0.jar;c:\storm\lib\clojure-1.5 ar;c:\storm\lib\clout-1.0.1.jar;c:\storm\lib\commons-codec-1.6.jar;c:\storm\lib\commons-exec-1.1.jar;c:\storm\lib\commons-fileupload-1.2.1.jar;c:\storm\lib\commons-io-2.4 ;c:\storm\lib\commons-lang-2.5.jar;c:\storm\lib\commons-logging-1.1.3.jar;c:\storm\lib\compojure-1.1.3.jar;c:\storm\lib\core.incubator-0.1.0.jar;c:\storm\lib\crypto-equal 1.0.0.jar;c:\storm\lib\crypto-random-1.2.0.jar;c:\storm\lib\disruptor-2.10.1.jar;c:\storm\lib\hadoop-auth-2.4.0.jar;c:\storm\lib\hiccup-0.3.6.jar;c:\storm\lib\httpclient- 3.jar;c:\storm\lib\httpcore-4.3.2.jar;c:\storm\lib\java.classpath-0.2.2.jar;c:\storm\lib\javax.servlet-2.5.0.v201103041518.jar;c:\storm\lib\jetty-client-7.6.13.v20130916. c:\storm\lib\jetty-continuation-7.6.13.v20130916.jar;c:\storm\lib\jetty-http-7.6.13.v20130916.jar;c:\storm\lib\jetty-io-7.6.13.v20130916.jar;c:\storm\lib\jetty-security-7 3.v20130916.jar;c:\storm\lib\jetty-server-7.6.13.v20130916.jar;c:\storm\lib\jetty-servlet-7.6.13.v20130916.jar;c:\storm\lib\jetty-servlets-7.6.13.v20130916.jar;c:\storm\l etty-util-7.6.13.v20130916.jar;c:\storm\lib\jgrapht-core-0.9.0.jar;c:\storm\lib\jline-2.11.jar;c:\storm\lib\joda-time-2.3.jar;c:\storm\lib\json-simple-1.1.jar;c:\storm\li yo-2.21.jar;c:\storm\lib\log4j-over-slf4j-1.6.6.jar;c:\storm\lib\logback-classic-1.0.13.jar;c:\storm\lib\logback-core-1.0.13.jar;c:\storm\lib\math.numeric-tower-0.0.1.jar storm\lib\minlog-1.2.jar;c:\storm\lib\ns-tracker-0.2.2.jar;c:\storm\lib\objenesis-1.2.jar;c:\storm\lib\reflectasm-1.07-shaded.jar;c:\storm\lib\ring-anti-forgery-1.0.0.jar storm\lib\ring-core-1.1.5.jar;c:\storm\lib\ring-devel-1.3.0.jar;c:\storm\lib\ring-jetty-adapter-1.3.0.jar;c:\storm\lib\ring-servlet-1.3.0.jar;c:\storm\lib\servlet-api-2.5 ;c:\storm\lib\slf4j-api-1.7.5.jar;c:\storm\lib\snakeyaml-1.11.jar;c:\storm\lib\storm-core-0.10.0-SNAPSHOT.jar;c:\storm\lib\tools.cli-0.2.4.jar;c:\storm\lib\tools.logging- 3.jar;c:\storm\lib\tools.macro-0.1.0.jar;c:\storm\lib\tools.namespace-0.2.4.jar;c:\storm\conf;c:\storm\bin backtype.storm.command.rebalance SentenceSplit-WordCount -e Tes ut=2 2155 [main] INFO backtype.storm.thrift - Connecting to Nimbus at localhost:6627 2320 [main] INFO backtype.storm.utils.StormBoundedExponentialBackoffRetry - The baseSleepTimeMs [2000] the maxSleepTimeMs [60000] the maxRetries [5] 2450 [main] INFO backtype.storm.command.rebalance - Topology SentenceSplit-WordCount is rebalancing
