Hi All,
Supervisor in our clustered environment is dying frequently because of the
following error. Any idea what can be causing this issue.
2015-04-06 18:13:51 o.a.c.f.s.ConnectionStateManager [INFO] State change:
CONNECTED
2015-04-06 18:13:51 o.a.c.f.s.ConnectionStateManager [WARN] There are no
ConnectionStateListeners registered.
2015-04-06 18:13:51 b.s.d.supervisor [INFO] Starting supervisor with id
cb16a155-09a7-433f-b417-edb9b0bb51c4 at host <hostname>
2015-04-06 18:13:52 b.s.d.supervisor [INFO] Shutting down and clearing state
for id 60fadbdc-2cfe-451a-bb81-e52e20955197. Current supervisor time:
1428324232. State: :disallowed, Heartbeat:
#backtype.storm.daemon.common.WorkerHeartbeat{:time-secs 1427453846, :storm-id
"CommonStreamTopology-19-1427356292", :executors #{[3 3] [5 5] [-1 -1] [1 1]},
:port 6703}
2015-04-06 18:13:52 b.s.d.supervisor [INFO] Shutting down
cb16a155-09a7-433f-b417-edb9b0bb51c4:60fadbdc-2cfe-451a-bb81-e52e20955197
2015-04-06 18:13:52 b.s.event [ERROR] Error when processing event
java.io.IOException: . doesn't exist.
at
org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:157)
~[commons-exec-1.1.jar:1.1]
at
org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:147)
~[commons-exec-1.1.jar:1.1]
at backtype.storm.util$exec_command_BANG_.invoke(util.clj:378)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.util$ensure_process_killed_BANG_.invoke(util.clj:394)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at
backtype.storm.daemon.supervisor$shutdown_worker.invoke(supervisor.clj:175)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at
backtype.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:240)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.AFn.applyToHelper(AFn.java:161) [clojure-1.5.1.jar:na]
at clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.5.1.jar:na]
at clojure.core$apply.invoke(core.clj:619) ~[clojure-1.5.1.jar:na]
at clojure.core$partial$fn__4190.doInvoke(core.clj:2396)
~[clojure-1.5.1.jar:na]
at clojure.lang.RestFn.invoke(RestFn.java:397) ~[clojure-1.5.1.jar:na]
at backtype.storm.event$event_manager$fn__2378.invoke(event.clj:39)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_67]
2015-04-06 18:13:52 b.s.util [INFO] Halting process: ("Error when processing an
event")
2015-04-06 18:26:05 o.a.z.ZooKeeper [INFO] Client
environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
Thanks,
Rakesh
