I am running Storm 0.9.6 on a two-node cluster: one nimbus/ui server
and one supervisor server.
I am getting the error below, and I cannot install topologies. The
error happens over and over.
I have tried:
* Resetting the zookeeper cluster
* Wiping out the content of the storm local directory
* Verifying zookeeper and storm configuration
I am running another group, this one (our development server) is a
single server with all three Storm apps running. Its logs are clean,
very clean, and the topologies launch just fine. The settings there
are almost identical.
Any ideas?
2016-08-26T19:30:41.316+0000 b.s.d.nimbus [INFO] Starting Nimbus
server...
2016-08-26T19:30:41.890+0000 b.s.d.nimbus [ERROR] Error when
processing event
java.lang.RuntimeException: java.io.StreamCorruptedException: invalid
stream header: 1F8B0800
at
backtype.storm.serialization.DefaultSerializationDelegate.deserialize(DefaultSerializationDelegate.java:56)
~[storm-core-0.9.6.jar:0.9.6]
at
backtype.storm.utils.Utils.deserialize(Utils.java:89)
~[storm-core-0.9.6.jar:0.9.6]
at
backtype.storm.cluster$maybe_deserialize.invoke(cluster.clj:212)
~[storm-core-0.9.6.jar:0.9.6]
at
backtype.storm.cluster$mk_storm_cluster_state$reify__2370.supervisor_info(cluster.clj:328)
~[storm-core-0.9.6.jar:0.9.6]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
Method) ~[na:1.8.0_92]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[na:1.8.0_92]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[na:1.8.0_92]
at java.lang.reflect.Method.invoke(Method.java:498)
~[na:1.8.0_92]
at
clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93)
~[clojure-1.5.1.jar:na]
at
clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28)
~[clojure-1.5.1.jar:na]
at
backtype.storm.daemon.nimbus$all_supervisor_info$fn__3765.invoke(nimbus.clj:277)
~[storm-core-0.9.6.jar:0.9.6]
at clojure.core$map$fn__4207.invoke(core.clj:2487)
~[clojure-1.5.1.jar:na]
at clojure.lang.LazySeq.sval(LazySeq.java:42)
~[clojure-1.5.1.jar:na]
at clojure.lang.LazySeq.seq(LazySeq.java:60)
~[clojure-1.5.1.jar:na]
at clojure.lang.RT.seq(RT.java:484)
~[clojure-1.5.1.jar:na]
at clojure.core$seq.invoke(core.clj:133)
~[clojure-1.5.1.jar:na]
at clojure.core$apply.invoke(core.clj:617)
~[clojure-1.5.1.jar:na]
at clojure.core$mapcat.doInvoke(core.clj:2514)
~[clojure-1.5.1.jar:na]
at clojure.lang.RestFn.invoke(RestFn.java:423)
~[clojure-1.5.1.jar:na]
at
backtype.storm.daemon.nimbus$all_supervisor_info.invoke(nimbus.clj:275)
~[storm-core-0.9.6.jar:0.9.6]
at
backtype.stormdaemon.nimbus$all_scheduling_slots.invoke(nimbus.clj:288)
~[storm-core-0.9.6.jar:0.9.6]
at
backtype.storm.daemon.nimbus$compute_new_topology__GT_executor__GT_node_PLUS_port.invoke(nimbus.clj:580)
~[storm-core-0.9.6.jar:0.9.6]
at
backtype.storm.daemon.nimbus$mk_assignments.doInvoke(nimbus.clj:662)
~[storm-core-0.9.6.jar:0.9.6]
at clojure.lang.RestFn.invoke(RestFn.java:410)
~[clojure-1.5.1.jar:na]
: at clojure.lang.RestFn.invoke(RestFn.java:410)
~[clojure-1.5.1.jar:na]
at
backtype.storm.daemon.nimbus$fn__4261$exec_fn__1104__auto____4262$fn__4267$fn__4268.invoke(nimbus.clj:909)
~[storm-core-0.9.6.jar:0.9.6]
at
backtype.storm.daemon.nimbus$fn__4261$exec_fn__1104__auto____4262$fn__4267.invoke(nimbus.clj:908)
~[storm-core-0.9.6.jar:0.9.6]
at
backtype.storm.timer$schedule_recurring$this__1647.invoke(timer.clj:99)
~[storm-core-0.9.6.jar:0.9.6]
at
backtype.storm.timer$mk_timer$fn__1630$fn__1631.invoke(timer.clj:50)
~[storm-core-0.9.6.jar:0.9.6]
at
backtype.storm.timer$mk_timer$fn__1630.invoke(timer.clj:42)
[storm-core-0.9.6.jar:0.9.6]
at clojure.lang.AFn.run(AFn.java:24)
[clojure-1.5.1.jar:na]
at java.langThread.run(Thread.java:745) [na:1.8.0_92]
Caused by: java.io.StreamCorruptedException: invalid stream header:
1F8B0800
at
java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:808)
~[na:1.8.0_92]
at
java.io.ObjectInputStream.(ObjectInputStream.java:301) ~[na:1.8.0_92]
at
backtype.storm.serialization.DefaultSerializationDelegate.deserialize(DefaultSerializationDelegate.java:51)
~[storm-core-0.9.6.jar:0.9.6]
:2016-08-26T19:30:41.892+0000 b.s.util [ERROR] Halting process:
("Error when processing an event")
java.lang.RuntimeException: ("Error when processing an event")
at
backtype.storm.util$exit_process_BANG_.doInvoke(util.clj:325)
[storm-core-0.9.6.jar:0.9.6]
at clojure.lang.RestFn.invoke(RestFn.java:423)
[clojure-1.5.1.jar:na]
at
backtype.storm.daemon.nimbus$nimbus_data$fn__3687.invoke(nimbus.clj:76)
[storm-core-0.9.6.jar:0.96]
at
backtype.storm.timer$mk_timer$fn__1630$fn__1631.invoke(timer.clj:68)
[storm-core-0.9.6.jar:0.9.6]
at
backtype.storm.timer$mk_timer$fn__1630.invoke(timer.clj:42)
[storm-core-0.9.6.jar:0.9.6]
at clojure.lang.AFn.run(AFn.java:24)
[clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_92]
2016-08-26T19:30:41.893+0000 b.s.d.nimbus [INFO] Shutting down master
2016-08-26T19:30:50.136+0000 o.a.s.z.ZooKeeper [INFO] Client
environment:zookee
