More often than not, these errors are the result of worker shutdown which might have happened for some other reason entirely. You will have to go through your error logs and search for the exception before worker shutdown kicks in.
On Sun, Feb 28, 2016 at 11:38 AM, Abdelkader Lattab <[email protected]> wrote: > Dear all > > My topology that runs on a single machine of 16 cores, consists of 12 > bolts and one Spout and a parallelism of 8. It runs fine for about 24 hours > then crashes. The log file is shown below. Please help > > 30711068 [refresh-connections-timer] ERROR backtype.storm.daemon.worker - > Error when processing event > org.apache.storm.zookeeper.KeeperException$ConnectionLossException: > KeeperErrorCode = ConnectionLoss for /assignments/fast-topology-1-1456407947 > at > org.apache.storm.zookeeper.KeeperException.create(KeeperException.java:99) > ~[storm-core-0.9.5.jar:0.9.5] > at > org.apache.storm.zookeeper.KeeperException.create(KeeperException.java:51) > ~[storm-core-0.9.5.jar:0.9.5] > at org.apache.storm.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045) > ~[storm-core-0.9.5.jar:0.9.5] > at org.apache.storm.zookeeper.ZooKeeper.exists(ZooKeeper.java:1073) > ~[storm-core-0.9.5.jar:0.9.5] > at > org.apache.storm.curator.framework.imps.ExistsBuilderImpl$2.call(ExistsBuilderImpl.java:168) > ~[storm-core-0.9.5.jar:0.9.5] > at > org.apache.storm.curator.framework.imps.ExistsBuilderImpl$2.call(ExistsBuilderImpl.java:161) > ~[storm-core-0.9.5.jar:0.9.5] > at > org.apache.storm.curator.RetryLoop.callWithRetry(RetryLoop.java:107) > ~[storm-core-0.9.5.jar:0.9.5] > at > org.apache.storm.curator.framework.imps.ExistsBuilderImpl.pathInForeground(ExistsBuilderImpl.java:157) > ~[storm-core-0.9.5.jar:0.9.5] > at > org.apache.storm.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:148) > ~[storm-core-0.9.5.jar:0.9.5] > at > org.apache.storm.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:36) > ~[storm-core-0.9.5.jar:0.9.5] > at sun.reflect.GeneratedMethodAccessor43.invoke(Unknown Source) > ~[na:na] > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > ~[na:1.7.0_80] > at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_80] > at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93) > ~[clojure-1.5.1.jar:na] > at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28) > ~[clojure-1.5.1.jar:na] > at backtype.storm.zookeeper$get_version.invoke(zookeeper.clj:156) > ~[storm-core-0.9.5.jar:0.9.5] > at > backtype.storm.cluster$mk_distributed_cluster_state$reify__2073.get_version(cluster.clj:111) > ~[storm-core-0.9.5.jar:0.9.5] > at > backtype.storm.cluster$mk_storm_cluster_state$reify__2530.assignment_version(cluster.clj:287) > ~[storm-core-0.9.5.jar:0.9.5] > at sun.reflect.GeneratedMethodAccessor53.invoke(Unknown Source) > ~[na:na] > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > ~[na:1.7.0_80] > at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_80] > at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93) > ~[clojure-1.5.1.jar:na] > at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28) > ~[clojure-1.5.1.jar:na] > at > backtype.storm.daemon.worker$mk_refresh_connections$this__6899.invoke(worker.clj:261) > ~[storm-core-0.9.5.jar:0.9.5] > at > backtype.storm.daemon.worker$mk_refresh_connections$this__6899.invoke(worker.clj:259) > ~[storm-core-0.9.5.jar:0.9.5] > at > backtype.storm.timer$schedule_recurring$this__1807.invoke(timer.clj:99) > ~[storm-core-0.9.5.jar:0.9.5] > at > backtype.storm.timer$mk_timer$fn__1790$fn__1791.invoke(timer.clj:50) > ~[storm-core-0.9.5.jar:0.9.5] > at backtype.storm.timer$mk_timer$fn__1790.invoke(timer.clj:42) > [storm-core-0.9.5.jar:0.9.5] > at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na] > at java.lang.Thread.run(Thread.java:745) [na:1.7.0_80] > 30711070 [refresh-connections-timer] ERROR backtype.storm.util - Halting > process: ("Error when processing an event") > java.lang.RuntimeException: ("Error when processing an event") > at backtype.storm.util$exit_process_BANG_.doInvoke(util.clj:325) > [storm-core-0.9.5.jar:0.9.5] > at clojure.lang.RestFn.invoke(RestFn.java:423) [clojure-1.5.1.jar:na] > at > backtype.storm.daemon.worker$mk_halting_timer$fn__6774.invoke(worker.clj:176) > [storm-core-0.9.5.jar:0.9.5] > at > backtype.storm.timer$mk_timer$fn__1790$fn__1791.invoke(timer.clj:68) > [storm-core-0.9.5.jar:0.9.5] > at backtype.storm.timer$mk_timer$fn__1790.invoke(timer.clj:42) > [storm-core-0.9.5.jar:0.9.5] > at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na] > at java.lang.Thread.run(Thread.java:745) [na:1.7.0_80] > > > CONFIDENTIALITY NOTICE: > This email and any attachments transmitted with it are confidential and > intended for the use of individual or entity to which it is addressed. If > you have received this email in error, please delete it immediately and > inform the sender. Unless you are the intended recipient, you may not use, > disclose, copy or distribute this email or any attachments included. The > contents of the emails including any attachments may be subjected to > copyrights law, In such case the contents may not be copied, adapted, > distributed or transmitted without the consent of the copyright owner. > -- Regards, Abhishek Agarwal
