Hi,
I am running a Storm Topology in local mode and I get the following error
after a while (couple of seconds). Apparently is it related to zookeeper,
but I have no idea why this should happen. I do appreciate if anyone could
point to a possible direction that could solve this error.
By the way my topology configuration is as follows. And One of the bolts
holding an array of size around 2GB .
Config conf = new Config();
conf.setDebug(true);
conf.put(Config.TOPOLOGY_WORKER_CHILDOPTS , "Xmx6G");
conf.setMaxSpoutPending(2000); // maximum number of pending messages at
spout
conf.setNumWorkers(2);
conf.put(Config.NIMBUS_CHILDOPTS, "Xmx3G");
conf.put(Config.STORM_ZOOKEEPER_CONNECTION_TIMEOUT, "120000");
conf.setMaxTaskParallelism(10);
MainStormToplogy.logger.error("***** Running in Local Mode");
LocalCluster cluster = new LocalCluster();
cluster.submitTopology("CityFlowTopology", conf,
builder.createTopology());
thanks,
/Shahab
org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for
/assignments/MyTopologyName-1-1394461448
[java] at
org.apache.zookeeper.KeeperException.create(KeeperException.java:90)
[java] at
org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[java] at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815)
[java] at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:843)
[java] at
com.netflix.curator.framework.imps.ExistsBuilderImpl$2.call(ExistsBuilderImpl.java:145)
[java] at
com.netflix.curator.framework.imps.ExistsBuilderImpl$2.call(ExistsBuilderImpl.java:138)
[java] at
com.netflix.curator.RetryLoop.callWithRetry(RetryLoop.java:85)
[java] at
com.netflix.curator.framework.imps.ExistsBuilderImpl.pathInForeground(ExistsBuilderImpl.java:134)
[java] at
com.netflix.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:125)
[java] at
com.netflix.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:34)
[java] at sun.reflect.GeneratedMethodAccessor16.invoke(Unknown
Source)
[java] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[java] at java.lang.reflect.Method.invoke(Method.java:606)
[java] at
clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93)
[java] at
clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28)
[java] at
backtype.storm.zookeeper$exists_node_QMARK_.invoke(zookeeper.clj:77)
[java] at
backtype.storm.zookeeper$get_data.invoke(zookeeper.clj:100)
[java] at
backtype.storm.cluster$mk_distributed_cluster_state$reify__1996.get_data(cluster.clj:82)
[java] at
backtype.storm.cluster$mk_storm_cluster_state$reify__2415.assignment_info(cluster.clj:233)
[java] at sun.reflect.GeneratedMethodAccessor35.invoke(Unknown
Source)
[java] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[java] at java.lang.reflect.Method.invoke(Method.java:606)
[java] at
clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93)
[java] at
clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28)
[java] at
backtype.storm.daemon.worker$mk_refresh_connections$this__4293.invoke(worker.clj:220)
[java] at
backtype.storm.daemon.worker$mk_refresh_connections$this__4293.invoke(worker.clj:218)
[java] at
backtype.storm.timer$schedule_recurring$this__1776.invoke(timer.clj:69)
[java] at
backtype.storm.timer$mk_timer$fn__1759$fn__1760.invoke(timer.clj:33)
[java] at
backtype.storm.timer$mk_timer$fn__1759.invoke(timer.clj:26)
[java] at clojure.lang.AFn.run(AFn.java:24)
[java] at java.lang.Thread.run(Thread.java:744)
