storm jar /root/SOIM/target/SOIMTopology-1.0-SNAPSHOT.jar
Microland.SOIM.SOIMTopology SOIMTopology
Running: /usr/java/jdk1.7.0_65/bin/java -client -Dstorm.options=
-Dstorm.home=/root/apache-storm-0.9.2-incubating
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file=
-cp
/root/apache-storm-0.9.2-incubating/lib/json-simple-1.1.jar:/root/apache-storm-0.9.2-incubating/lib/core.incubator-0.1.0.jar:/root/apache-storm-0.9.2-incubating/lib/asm-4.0.jar:/root/apache-storm-0.9.2-incubating/lib/commons-io-2.4.jar:/root/apache-storm-0.9.2-incubating/lib/httpclient-4.3.3.jar:/root/apache-storm-0.9.2-incubating/lib/jline-2.11.jar:/root/apache-storm-0.9.2-incubating/lib/tools.logging-0.2.3.jar:/root/apache-storm-0.9.2-incubating/lib/logback-classic-1.0.6.jar:/root/apache-storm-0.9.2-incubating/lib/commons-logging-1.1.3.jar:/root/apache-storm-0.9.2-incubating/lib/ring-core-1.1.5.jar:/root/apache-storm-0.9.2-incubating/lib/ring-devel-0.3.11.jar:/root/apache-storm-0.9.2-incubating/lib/curator-client-2.4.0.jar:/root/apache-storm-0.9.2-incubating/lib/clj-stacktrace-0.2.4.jar:/root/apache-storm-0.9.2-incubating/lib/clj-time-0.4.1.jar:/root/apache-storm-0.9.2-incubating/lib/commons-lang-2.5.jar:/root/apache-storm-0.9.2-incubating/lib/zookeeper-3.4.5.jar:/root/apache-storm-0.9.2-incubating/lib/compojure-1.1.3.jar:/root/apache-storm-0.9.2-incubating/lib/joda-time-2.0.jar:/root/apache-storm-0.9.2-incubating/lib/chill-java-0.3.5.jar:/root/apache-storm-0.9.2-incubating/lib/clout-1.0.1.jar:/root/apache-storm-0.9.2-incubating/lib/kryo-2.21.jar:/root/apache-storm-0.9.2-incubating/lib/snakeyaml-1.11.jar:/root/apache-storm-0.9.2-incubating/lib/minlog-1.2.jar:/root/apache-storm-0.9.2-incubating/lib/storm-core-0.9.2-incubating.jar:/root/apache-storm-0.9.2-incubating/lib/jgrapht-core-0.9.0.jar:/root/apache-storm-0.9.2-incubating/lib/slf4j-api-1.6.5.jar:/root/apache-storm-0.9.2-incubating/lib/hiccup-0.3.6.jar:/root/apache-storm-0.9.2-incubating/lib/netty-3.6.3.Final.jar:/root/apache-storm-0.9.2-incubating/lib/curator-framework-2.4.0.jar:/root/apache-storm-0.9.2-incubating/lib/guava-13.0.jar:/root/apache-storm-0.9.2-incubating/lib/log4j-over-slf4j-1.6.6.jar:/root/apache-storm-0.9.2-incubating/lib/commons-fileupload-1.2.1.jar:/root/apache-storm-0.9.2-incubating/lib/servlet-api-2.5.jar:/root/apache-storm-0.9.2-incubating/lib/reflectasm-1.07-shaded.jar:/root/apache-storm-0.9.2-incubating/lib/jetty-util-6.1.26.jar:/root/apache-storm-0.9.2-incubating/lib/objenesis-1.2.jar:/root/apache-storm-0.9.2-incubating/lib/tools.cli-0.2.4.jar:/root/apache-storm-0.9.2-incubating/lib/ring-jetty-adapter-0.3.11.jar:/root/apache-storm-0.9.2-incubating/lib/commons-codec-1.6.jar:/root/apache-storm-0.9.2-incubating/lib/clojure-1.5.1.jar:/root/apache-storm-0.9.2-incubating/lib/netty-3.2.2.Final.jar:/root/apache-storm-0.9.2-incubating/lib/math.numeric-tower-0.0.1.jar:/root/apache-storm-0.9.2-incubating/lib/carbonite-1.4.0.jar:/root/apache-storm-0.9.2-incubating/lib/disruptor-2.10.1.jar:/root/apache-storm-0.9.2-incubating/lib/commons-exec-1.1.jar:/root/apache-storm-0.9.2-incubating/lib/tools.macro-0.1.0.jar:/root/apache-storm-0.9.2-incubating/lib/jetty-6.1.26.jar:/root/apache-storm-0.9.2-incubating/lib/httpcore-4.3.2.jar:/root/apache-storm-0.9.2-incubating/lib/servlet-api-2.5-20081211.jar:/root/apache-storm-0.9.2-incubating/lib/ring-servlet-0.3.11.jar:/root/apache-storm-0.9.2-incubating/lib/logback-core-1.0.6.jar:/root/SOIM/target/SOIMTopology-1.0-SNAPSHOT.jar:/root/.storm:/root/apache-storm-0.9.2-incubating/bin
-Dstorm.jar=/root/SOIM/target/SOIMTopology-1.0-SNAPSHOT.jar
Microland.SOIM.SOIMTopology SOIMTopology
404 [main] INFO backtype.storm.StormSubmitter - Uploading topology jar
/root/SOIM/target/SOIMTopology-1.0-SNAPSHOT.jar to assigned location:
storm-local/nimbus/inbox/stormjar-b867da73-26e6-474d-9e80-3d4690adbfa3.jar
421 [main] INFO backtype.storm.StormSubmitter - Successfully uploaded
topology jar to assigned location:
storm-local/nimbus/inbox/stormjar-b867da73-26e6-474d-9e80-3d4690adbfa3.jar
Regards,
PaVan…
From: Supun Kamburugamuva [mailto:[email protected]]
Sent: 01 September 2014 20:04
To: [email protected]
Subject: Re: REMOTE MODE STORM DEV
Do you get any errors in the console when deploying the topology? You can also
check supervisor logs for errors.
Thanks,
Supun..
On Mon, Sep 1, 2014 at 8:03 AM, Pavan Jakati G <[email protected]> wrote:
Hi Team ,
We have create a topology which run fine in local mode but fail to action when
in remote mode . Do we need make any changes to Spout and Bolt to make it run
in remote mode ?. Our code has similar lines as shown here in these links .
Guidance would be appreciated . Thanks.
REFERENCE LINK:
http://mail-archives.apache.org/mod_mbox/storm-user/201404.mbox/%3CCAJq5PB5pDjYemyf3m+rVyjPzN3_t9_-d8nF-7rWEJVhNXB=y...@mail.gmail.com%3E
MAIN FUNCTION
http://mail-archives.apache.org/mod_mbox/storm-user/201404.mbox/raw/%3CCAJq5PB5pDjYemyf3m+rVyjPzN3_t9_-d8nF-7rWEJVhNXB=y...@mail.gmail.com%3E/2
SPOUT
http://mail-archives.apache.org/mod_mbox/storm-user/201404.mbox/raw/%3CCAJq5PB5pDjYemyf3m+rVyjPzN3_t9_-d8nF-7rWEJVhNXB=y...@mail.gmail.com%3E/3
BOLT
http://mail-archives.apache.org/mod_mbox/storm-user/201404.mbox/raw/%3CCAJq5PB5pDjYemyf3m+rVyjPzN3_t9_-d8nF-7rWEJVhNXB=y...@mail.gmail.com%3E/4
Regards
PaVan ..
Stay Hungry . Stay Foolish J
The information contained in this transmission may contain privileged and
confidential information of Microland Limited, including information protected
by privacy laws. It is intended only for the use of Microland Limited. If you
are not the intended recipient, you are hereby notified that any review,
dissemination, distribution, or duplication of this communication is strictly
prohibited. If you are not the intended recipient, please contact the sender by
reply email and destroy all copies of the original message.
--
Supun Kamburugamuva
Member, Apache Software Foundation; http://www.apache.org
E-mail: [email protected]; Mobile: +1 812 369 6762
Blog: http://supunk.blogspot.com
2014-09-02 05:24:29 o.a.c.f.s.ConnectionStateManager [INFO] State change:
CONNECTED
2014-09-02 05:24:29 o.a.c.f.s.ConnectionStateManager [WARN] There are no
ConnectionStateListeners registered.
2014-09-02 05:24:29 b.s.d.supervisor [INFO] Starting supervisor with id
5aff0823-014a-4f51-961f-f0083f117145 at host localhost
2014-09-02 05:24:30 b.s.d.supervisor [INFO] Removing code for storm id
SOIMTopology-1-1409597312
2014-09-02 05:24:30 b.s.d.supervisor [INFO] Shutting down and clearing state
for id 1531af9a-1afe-4831-bc06-32ed5748438f. Current supervisor time:
1409635470. State: :timed-out, Heartbeat:
#backtype.storm.daemon.common.WorkerHeartbeat{:time-secs 1409597983, :storm-id
"SOIMTopology-1-1409597312", :executors #{[2 2] [3 3] [-1 -1] [1 1]}, :port
6703}
2014-09-02 05:24:30 b.s.d.supervisor [INFO] Shutting down
5aff0823-014a-4f51-961f-f0083f117145:1531af9a-1afe-4831-bc06-32ed5748438f
2014-09-02 05:24:30 b.s.util [INFO] Error when trying to kill 5493. Process is
probably already dead.
2014-09-02 05:24:30 b.s.d.supervisor [INFO] Shut down
5aff0823-014a-4f51-961f-f0083f117145:1531af9a-1afe-4831-bc06-32ed5748438f
2014-09-02 05:24:30 b.s.d.supervisor [INFO] Launching worker with assignment
#backtype.storm.daemon.supervisor.LocalAssignment{:storm-id
"SOIMTopology-1-1409597312", :executors ([3 3] [2 2] [1 1])} for this
supervisor 5aff0823-014a-4f51-961f-f0083f117145 on port 6703 with id
05288cad-68e5-4762-934a-a56a99e549c2
2014-09-02 05:24:30 b.s.event [ERROR] Error when processing event
java.io.FileNotFoundException: File
'storm-local/supervisor/stormdist/SOIMTopology-1-1409597312/stormconf.ser' does
not exist
at org.apache.commons.io.FileUtils.openInputStream(FileUtils.java:299)
~[commons-io-2.4.jar:2.4]
at
org.apache.commons.io.FileUtils.readFileToByteArray(FileUtils.java:1763)
~[commons-io-2.4.jar:2.4]
at
backtype.storm.config$read_supervisor_storm_conf.invoke(config.clj:212)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.daemon.supervisor$fn__6420.invoke(supervisor.clj:469)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.MultiFn.invoke(MultiFn.java:241) ~[clojure-1.5.1.jar:na]
at
backtype.storm.daemon.supervisor$sync_processes$iter__6285__6289$fn__6290.invoke(supervisor.clj:264)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.LazySeq.sval(LazySeq.java:42) ~[clojure-1.5.1.jar:na]
at clojure.lang.LazySeq.seq(LazySeq.java:60) ~[clojure-1.5.1.jar:na]
at clojure.lang.RT.seq(RT.java:484) ~[clojure-1.5.1.jar:na]
at clojure.core$seq.invoke(core.clj:133) ~[clojure-1.5.1.jar:na]
at clojure.core$dorun.invoke(core.clj:2780) ~[clojure-1.5.1.jar:na]
at clojure.core$doall.invoke(core.clj:2796) ~[clojure-1.5.1.jar:na]
at
backtype.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:252)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.AFn.applyToHelper(AFn.java:161) [clojure-1.5.1.jar:na]
at clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.5.1.jar:na]
at clojure.core$apply.invoke(core.clj:619) ~[clojure-1.5.1.jar:na]
at clojure.core$partial$fn__4190.doInvoke(core.clj:2396)
~[clojure-1.5.1.jar:na]
at clojure.lang.RestFn.invoke(RestFn.java:397) ~[clojure-1.5.1.jar:na]
at backtype.storm.event$event_manager$fn__2378.invoke(event.clj:39)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_65]
2014-09-02 05:24:30 b.s.util [INFO] Halting process: ("Error when processing an
event")
