Is it possible to run 3 zookeeper processes with one storm supervisor on the
same server? How can I get Storm to recognize the three zookeepers?
The zookeepers are up and running, but I’m unable to get nimbus and supervisor
started.
Here is my storm.yaml file:
nimbus.host: “localhost"
storm.local.dir: "/apps/apache-storm/data"
ui.host: “localhost"
ui.port: 18888
storm.zookeeper.servers:
- “localhost"
- “localhost"
- “localhost”
storm.zookeeper.port:
- 2181
- 2182
- 2183
supervisor.slots.ports:
- 6700
- 6701
- 6702
- 6703
- 6704
- 6705
- 6706
supervisor.childopts: "-Xmx1g -XX:MaxPermSize=256m -Xss256k -XX:+PrintGCDetails
-XX:+PrintGCTimeStamps -verbose:gc
-Xloggc:/apps/opt/logs/gc-storm-supervisor.log"
worker.childopts: "-Xmx3g -Xms2g -XX:+UseG1GC -XX:MaxGCPauseMillis=50
-XX:InitiatingHeapOccupancyPercent=30 -XX:G1ReservePercent=20
-Xloggc:/apps/opt/logs/gc-worker-%ID%.log -verbose:gc -XX:+PrintGCDateStamps
-XX:+PrintGCTimeStamps -XX:+PrintGCDetails -XX:+PrintAdaptiveSizePolicy
-XX:-TraceClassUnloading -XX:-ClassUnloading -XX:ConcGCThreads=4
-XX:GCLogFileSize=3m -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10
-Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.ssl=false
-Dcom.sun.management.jmxremote.authenticate=false
-Dcom.sun.management.jmxremote.port=1%ID%"
nimbus log:
jdmpadm@denjdmswt204 bin]$ Exception in thread "main"
java.lang.IllegalArgumentException: Field storm.zookeeper.port must be an
Integer within type range.
at backtype.storm.ConfigValidation$2.validateField(ConfigValidation.java:102)
at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93)
at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28)
at backtype.storm.config$validate_configs_with_schemas.invoke(config.clj:117)
at backtype.storm.config$read_storm_config.invoke(config.clj:122)
at backtype.storm.command.config_value$_main.invoke(config_value.clj:22)
at clojure.lang.AFn.applyToHelper(AFn.java:161)
at clojure.lang.AFn.applyTo(AFn.java:151)
at backtype.storm.command.config_value.main(Unknown Source)
Thanks
Carmen