Now I am running storm-starter on mac to submit topology to nimbus remotely, it
end up with the connection error
storm jar target/storm-starter-0.0.1-SNAPSHOT-jar-with-dependencies.jar
storm.starter.ExclamationTopology exclamation-topology
Running: java -client -Dstorm.options=
-Dstorm.home=/workspace/tools/storm-0.9.0.1
-Djava.library.path=/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home
-Dstorm.conf.file= -cp
/workspace/tools/storm-0.9.0.1/storm-console-logging-0.9.0.1.jar:/workspace/tools/storm-0.9.0.1/storm-core-0.9.0.1.jar:/workspace/tools/storm-0.9.0.1/storm-netty-0.9.0.1.jar:/workspace/tools/storm-0.9.0.1/lib/asm-4.0.jar:/workspace/tools/storm-0.9.0.1/lib/carbonite-1.5.0.jar:/workspace/tools/storm-0.9.0.1/lib/clj-stacktrace-0.2.2.jar:/workspace/tools/storm-0.9.0.1/lib/clj-time-0.4.1.jar:/workspace/tools/storm-0.9.0.1/lib/clojure-1.4.0.jar:/workspace/tools/storm-0.9.0.1/lib/clojure-complete-0.2.3.jar:/workspace/tools/storm-0.9.0.1/lib/clout-1.0.1.jar:/workspace/tools/storm-0.9.0.1/lib/commons-codec-1.4.jar:/workspace/tools/storm-0.9.0.1/lib/commons-exec-1.1.jar:/workspace/tools/storm-0.9.0.1/lib/commons-fileupload-1.2.1.jar:/workspace/tools/storm-0.9.0.1/lib/commons-io-1.4.jar:/workspace/tools/storm-0.9.0.1/lib/commons-lang-2.5.jar:/workspace/tools/storm-0.9.0.1/lib/commons-logging-1.1.1.jar:/workspace/tools/storm-0.9.0.1/lib/compojure-1.1.3.jar:/workspace/tools/storm-0.9.0.1/lib/core.incubator-0.1.0.jar:/workspace/tools/storm-0.9.0.1/lib/curator-client-1.0.1.jar:/workspace/tools/storm-0.9.0.1/lib/curator-framework-1.0.1.jar:/workspace/tools/storm-0.9.0.1/lib/disruptor-2.10.1.jar:/workspace/tools/storm-0.9.0.1/lib/guava-13.0.jar:/workspace/tools/storm-0.9.0.1/lib/hiccup-0.3.6.jar:/workspace/tools/storm-0.9.0.1/lib/httpclient-4.1.1.jar:/workspace/tools/storm-0.9.0.1/lib/httpcore-4.1.jar:/workspace/tools/storm-0.9.0.1/lib/jetty-6.1.26.jar:/workspace/tools/storm-0.9.0.1/lib/jetty-util-6.1.26.jar:/workspace/tools/storm-0.9.0.1/lib/jgrapht-0.8.3.jar:/workspace/tools/storm-0.9.0.1/lib/jline-0.9.94.jar:/workspace/tools/storm-0.9.0.1/lib/joda-time-2.0.jar:/workspace/tools/storm-0.9.0.1/lib/json-simple-1.1.jar:/workspace/tools/storm-0.9.0.1/lib/junit-3.8.1.jar:/workspace/tools/storm-0.9.0.1/lib/jzmq-2.1.0.jar:/workspace/tools/storm-0.9.0.1/lib/kryo-2.17.jar:/workspace/tools/storm-0.9.0.1/lib/libthrift7-0.7.0-2.jar:/workspace/tools/storm-0.9.0.1/lib/log4j-over-slf4j-1.6.6.jar:/workspace/tools/storm-0.9.0.1/lib/logback-classic-1.0.6.jar:/workspace/tools/storm-0.9.0.1/lib/logback-core-1.0.6.jar:/workspace/tools/storm-0.9.0.1/lib/math.numeric-tower-0.0.1.jar:/workspace/tools/storm-0.9.0.1/lib/minlog-1.2.jar:/workspace/tools/storm-0.9.0.1/lib/mockito-all-1.9.5.jar:/workspace/tools/storm-0.9.0.1/lib/netty-3.6.3.Final.jar:/workspace/tools/storm-0.9.0.1/lib/objenesis-1.2.jar:/workspace/tools/storm-0.9.0.1/lib/reflectasm-1.07-shaded.jar:/workspace/tools/storm-0.9.0.1/lib/ring-core-1.1.5.jar:/workspace/tools/storm-0.9.0.1/lib/ring-devel-0.3.11.jar:/workspace/tools/storm-0.9.0.1/lib/ring-jetty-adapter-0.3.11.jar:/workspace/tools/storm-0.9.0.1/lib/ring-servlet-0.3.11.jar:/workspace/tools/storm-0.9.0.1/lib/servlet-api-2.5-20081211.jar:/workspace/tools/storm-0.9.0.1/lib/servlet-api-2.5.jar:/workspace/tools/storm-0.9.0.1/lib/slf4j-api-1.6.5.jar:/workspace/tools/storm-0.9.0.1/lib/snakeyaml-1.11.jar:/workspace/tools/storm-0.9.0.1/lib/tools.cli-0.2.2.jar:/workspace/tools/storm-0.9.0.1/lib/tools.logging-0.2.3.jar:/workspace/tools/storm-0.9.0.1/lib/tools.macro-0.1.0.jar:/workspace/tools/storm-0.9.0.1/lib/tools.nrepl-0.2.3.jar:/workspace/tools/storm-0.9.0.1/lib/zookeeper-3.3.3.jar:target/storm-starter-0.0.1-SNAPSHOT-jar-with-dependencies.jar:/Users/sali/.storm:/workspace/tools/storm-0.9.0.1/bin
-Dstorm.jar=target/storm-starter-0.0.1-SNAPSHOT-jar-with-dependencies.jar
storm.starter.ExclamationTopology exclamation-topology
Exception in thread "main" java.lang.RuntimeException:
org.apache.thrift7.transport.TTransportException: java.net.ConnectException:
Connection refused
at
backtype.storm.utils.NimbusClient.getConfiguredClient(NimbusClient.java:21)
at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:70)
at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:41)
at storm.starter.ExclamationTopology.main(ExclamationTopology.java:59)
Caused by: org.apache.thrift7.transport.TTransportException:
java.net.ConnectException: Connection refused
at org.apache.thrift7.transport.TSocket.open(TSocket.java:183)
at
org.apache.thrift7.transport.TFramedTransport.open(TFramedTransport.java:81)
at
backtype.storm.security.auth.SimpleTransportPlugin.connect(SimpleTransportPlugin.java:66)
at
backtype.storm.security.auth.ThriftClient.<init>(ThriftClient.java:46)
at backtype.storm.utils.NimbusClient.<init>(NimbusClient.java:30)
at backtype.storm.utils.NimbusClient.<init>(NimbusClient.java:26)
at
backtype.storm.utils.NimbusClient.getConfiguredClient(NimbusClient.java:19)
... 3 more
Caused by: java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:382)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:241)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:228)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:431)
at java.net.Socket.connect(Socket.java:527)
at org.apache.thrift7.transport.TSocket.open(TSocket.java:178)
... 9 more
I assume it is having the trouble to connect the ubuntu nimbus, where about to
config the connect socket?
thanks
Alec
On Jun 20, 2014, at 3:20 PM, Sa Li <[email protected]> wrote:
> I thought i miss some message to type here, my nimbus is not in my mac, it
> is running on an ubuntu server, the zookeeper and nimbus all on 10.100.70.10,
> my mac is accessing the nimbus remotely, so I believe I actually don’t need
> launch zookeeper on my mac.
>
> thanks
>
> Alec
> On Jun 20, 2014, at 2:53 PM, Toni Menzel <[email protected]> wrote:
>
>> Sali, check with
>> https://groups.google.com/forum/#!topic/storm-user/zcc6OSXX9mg (sounds
>> similar).
>> Maybe its the same issue?
>>
>> Also make sure you use the "-with-dependencies" jars when publishing to a
>> cluster.
>>
>> Toni
>>
>> Toni Menzel | rebaze GmbH
>> [email protected] | +49 171 65 202 84
>> http://www.rebaze.com | twitter @rebazeio | LinkedIn Profile
>>
>>
>>
>> On Fri, Jun 20, 2014 at 11:29 PM, Sa Li <[email protected]> wrote:
>> Dear all,
>>
>> I download and build storm-starter on mac, now I am running
>> exclamationTopology but getting the error
>>
>> storm jar target/storm-starter-0.0.1-SNAPSHOT.jar
>> storm.starter.ExclamationTopology exclamation-topology
>> Exception in thread "main" expected '<document start>', but found
>> BlockMappingStart
>> in 'reader', line 7, column 1:
>> storm.zookeeper.port: 2181
>> ^
>>
>> at
>> org.yaml.snakeyaml.parser.ParserImpl$ParseDocumentStart.produce(ParserImpl.java:225)
>> at org.yaml.snakeyaml.parser.ParserImpl.peekEvent(ParserImpl.java:158)
>> at org.yaml.snakeyaml.parser.ParserImpl.checkEvent(ParserImpl.java:143)
>> at org.yaml.snakeyaml.composer.Composer.getSingleNode(Composer.java:108)
>> at
>> org.yaml.snakeyaml.constructor.BaseConstructor.getSingleData(BaseConstructor.java:120)
>> at org.yaml.snakeyaml.Yaml.loadFromReader(Yaml.java:481)
>> at org.yaml.snakeyaml.Yaml.load(Yaml.java:424)
>> at backtype.storm.utils.Utils.findAndReadConfigFile(Utils.java:121)
>> at backtype.storm.utils.Utils.readStormConfig(Utils.java:161)
>> at backtype.storm.config$read_storm_config.invoke(config.clj:101)
>> at backtype.storm.command.config_value$_main.invoke(config_value.clj:7)
>> at clojure.lang.AFn.applyToHelper(AFn.java:161)
>> at clojure.lang.AFn.applyTo(AFn.java:151)
>> at backtype.storm.command.config_value.main(Unknown Source)
>> Running: java -client -Dstorm.options=
>> -Dstorm.home=/workspace/tools/storm-0.9.0.1 -Djava.library.path=
>> -Dstorm.conf.file= -cp
>> /workspace/tools/storm-0.9.0.1/storm-console-logging-0.9.0.1.jar:/workspace/tools/storm-0.9.0.1/storm-core-0.9.0.1.jar:/workspace/tools/storm-0.9.0.1/storm-netty-0.9.0.1.jar:/workspace/tools/storm-0.9.0.1/lib/asm-4.0.jar:/workspace/tools/storm-0.9.0.1/lib/carbonite-1.5.0.jar:/workspace/tools/storm-0.9.0.1/lib/clj-stacktrace-0.2.2.jar:/workspace/tools/storm-0.9.0.1/lib/clj-time-0.4.1.jar:/workspace/tools/storm-0.9.0.1/lib/clojure-1.4.0.jar:/workspace/tools/storm-0.9.0.1/lib/clojure-complete-0.2.3.jar:/workspace/tools/storm-0.9.0.1/lib/clout-1.0.1.jar:/workspace/tools/storm-0.9.0.1/lib/commons-codec-1.4.jar:/workspace/tools/storm-0.9.0.1/lib/commons-exec-1.1.jar:/workspace/tools/storm-0.9.0.1/lib/commons-fileupload-1.2.1.jar:/workspace/tools/storm-0.9.0.1/lib/commons-io-1.4.jar:/workspace/tools/storm-0.9.0.1/lib/commons-lang-2.5.jar:/workspace/tools/storm-0.9.0.1/lib/commons-logging-1.1.1.jar:/workspace/tools/storm-0.9.0.1/lib/compojure-1.1.3.jar:/workspace/tools/storm-0.9.0.1/lib/core.incubator-0.1.0.jar:/workspace/tools/storm-0.9.0.1/lib/curator-client-1.0.1.jar:/workspace/tools/storm-0.9.0.1/lib/curator-framework-1.0.1.jar:/workspace/tools/storm-0.9.0.1/lib/disruptor-2.10.1.jar:/workspace/tools/storm-0.9.0.1/lib/guava-13.0.jar:/workspace/tools/storm-0.9.0.1/lib/hiccup-0.3.6.jar:/workspace/tools/storm-0.9.0.1/lib/httpclient-4.1.1.jar:/workspace/tools/storm-0.9.0.1/lib/httpcore-4.1.jar:/workspace/tools/storm-0.9.0.1/lib/jetty-6.1.26.jar:/workspace/tools/storm-0.9.0.1/lib/jetty-util-6.1.26.jar:/workspace/tools/storm-0.9.0.1/lib/jgrapht-0.8.3.jar:/workspace/tools/storm-0.9.0.1/lib/jline-0.9.94.jar:/workspace/tools/storm-0.9.0.1/lib/joda-time-2.0.jar:/workspace/tools/storm-0.9.0.1/lib/json-simple-1.1.jar:/workspace/tools/storm-0.9.0.1/lib/junit-3.8.1.jar:/workspace/tools/storm-0.9.0.1/lib/jzmq-2.1.0.jar:/workspace/tools/storm-0.9.0.1/lib/kryo-2.17.jar:/workspace/tools/storm-0.9.0.1/lib/libthrift7-0.7.0-2.jar:/workspace/tools/storm-0.9.0.1/lib/log4j-over-slf4j-1.6.6.jar:/workspace/tools/storm-0.9.0.1/lib/logback-classic-1.0.6.jar:/workspace/tools/storm-0.9.0.1/lib/logback-core-1.0.6.jar:/workspace/tools/storm-0.9.0.1/lib/math.numeric-tower-0.0.1.jar:/workspace/tools/storm-0.9.0.1/lib/minlog-1.2.jar:/workspace/tools/storm-0.9.0.1/lib/mockito-all-1.9.5.jar:/workspace/tools/storm-0.9.0.1/lib/netty-3.6.3.Final.jar:/workspace/tools/storm-0.9.0.1/lib/objenesis-1.2.jar:/workspace/tools/storm-0.9.0.1/lib/reflectasm-1.07-shaded.jar:/workspace/tools/storm-0.9.0.1/lib/ring-core-1.1.5.jar:/workspace/tools/storm-0.9.0.1/lib/ring-devel-0.3.11.jar:/workspace/tools/storm-0.9.0.1/lib/ring-jetty-adapter-0.3.11.jar:/workspace/tools/storm-0.9.0.1/lib/ring-servlet-0.3.11.jar:/workspace/tools/storm-0.9.0.1/lib/servlet-api-2.5-20081211.jar:/workspace/tools/storm-0.9.0.1/lib/servlet-api-2.5.jar:/workspace/tools/storm-0.9.0.1/lib/slf4j-api-1.6.5.jar:/workspace/tools/storm-0.9.0.1/lib/snakeyaml-1.11.jar:/workspace/tools/storm-0.9.0.1/lib/tools.cli-0.2.2.jar:/workspace/tools/storm-0.9.0.1/lib/tools.logging-0.2.3.jar:/workspace/tools/storm-0.9.0.1/lib/tools.macro-0.1.0.jar:/workspace/tools/storm-0.9.0.1/lib/tools.nrepl-0.2.3.jar:/workspace/tools/storm-0.9.0.1/lib/zookeeper-3.3.3.jar:target/storm-starter-0.0.1-SNAPSHOT.jar:/Users/sali/.storm:/workspace/tools/storm-0.9.0.1/bin
>> -Dstorm.jar=target/storm-starter-0.0.1-SNAPSHOT.jar
>> storm.starter.ExclamationTopology exclamation-topology
>> Exception in thread "main" expected '<document start>', but found
>> BlockMappingStart
>> in 'reader', line 7, column 1:
>> storm.zookeeper.port: 2181
>> ^
>>
>> at
>> org.yaml.snakeyaml.parser.ParserImpl$ParseDocumentStart.produce(ParserImpl.java:225)
>> at org.yaml.snakeyaml.parser.ParserImpl.peekEvent(ParserImpl.java:158)
>> at org.yaml.snakeyaml.parser.ParserImpl.checkEvent(ParserImpl.java:143)
>> at org.yaml.snakeyaml.composer.Composer.getSingleNode(Composer.java:108)
>> at
>> org.yaml.snakeyaml.constructor.BaseConstructor.getSingleData(BaseConstructor.java:120)
>> at org.yaml.snakeyaml.Yaml.loadFromReader(Yaml.java:481)
>> at org.yaml.snakeyaml.Yaml.load(Yaml.java:424)
>> at backtype.storm.utils.Utils.findAndReadConfigFile(Utils.java:121)
>> at backtype.storm.utils.Utils.readStormConfig(Utils.java:161)
>> at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:62)
>> at backtype.storm.StormSubmitter.submitTopology(StormSubmitter.java:41)
>> at storm.starter.ExclamationTopology.main(ExclamationTopology.java:59)
>>
>>
>> Seems this is the problem of zookeeper, I installed zookeeper even almost
>> all pages of install storm on mac didn’t mention this step. Now I start
>> zookeeper
>>
>> zkServer start
>> JMX enabled by default
>> Using config: /usr/local/etc/zookeeper/zoo.cfg
>> Starting zookeeper …STARTED
>>
>>
>> That didn’t help, here is the storm installation on mac
>> -rw-r--r--@ 1 sali wheel 29410 5 Dec 2013 CHANGELOG.md
>> -rw-r--r--@ 1 sali wheel 12710 5 Dec 2013 LICENSE.html
>> -rw-r--r--@ 1 sali wheel 6893 5 Dec 2013 README.markdown
>> -rw-r--r--@ 1 sali wheel 8 5 Dec 2013 RELEASE
>> drwxr-xr-x@ 8 sali wheel 272 5 Dec 2013 bin
>> drwxr-xr-x@ 3 sali wheel 102 5 Dec 2013 conf
>> drwxr-xr-x@ 56 sali wheel 1904 5 Dec 2013 lib
>> drwxr-xr-x@ 3 sali wheel 102 5 Dec 2013 logback
>> drwxr-xr-x@ 5 sali wheel 170 18 Jun 17:17 logs
>> drwxr-xr-x@ 4 sali wheel 136 5 Dec 2013 public
>> -rw-r--r--@ 1 sali wheel 2492 5 Dec 2013
>> storm-console-logging-0.9.0.1.jar
>> -rw-r--r--@ 1 sali wheel 5358081 5 Dec 2013 storm-core-0.9.0.1.jar
>> -rw-r--r--@ 1 sali wheel 44319 5 Dec 2013 storm-netty-0.9.0.1.jar
>>
>>
>> The config storm.yaml on mac is
>>
>> storm.zookeeper.servers:
>> - "10.100.70.10"
>> # - "server2"
>> #
>>
>> storm.zookeeper.port: 2181
>>
>> nimbus.host: "10.100.70.10"
>>
>> storm.local.dir: "/workspace/tools/stormtmp"
>>
>> java.library.path:
>> "/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home"
>>
>> supervisor.slots.ports:
>>
>> - 6700
>> - 6701
>> - 6702
>> - 6703
>>
>>
>>
>> I can’t figure out what the problem is to getting this weird error.
>>
>>
>> Thanks
>>
>> Alec
>>
>>
>>
>
