Hi! I'm having trouble running Nimbus following a systems upgrade of my
Ubuntu 14.04 server yesterday. I've tried using Java 8 from Oracle with
no luck, so I've reverted back to OpenJDK 7. The error that keeps
showing up is quoted below.
We've tried re-installing the Storm distribution but are set on using
1.0.2 unless it proves broken.
Zookeeper has had its state under /var/lib/zookeeper/ deleted, as well
as the storm-local state on all supervisor nodes and the Nimbus node.
I observe that the problem occurs as the Nimbus server connects to
Zookeeper - the supervisor nodes may be running or shut down, and the
exception will still occur.
As I understand it, some kind of data object about to be serialized and
expected to be in ZIP format either isn't zipped or isn't there at all.
Could this be a fault in the JAR files? Or have we forgotten some state
to zero out? We've emptied our /tmp directories as well.
Exception in Nimbus log:
2016-10-28 09:04:55.615 o.a.s.zookeeper [INFO] active-topology-ids []
local-topology-ids [] diff-topology []
2016-10-28 09:04:55.616 o.a.s.zookeeper [INFO] Accepting leadership, all
active topology found localy.
2016-10-28 09:05:01.367 o.a.s.d.nimbus [ERROR] Error when processing event
java.lang.RuntimeException: java.lang.RuntimeException:
java.util.zip.ZipException: Not in GZIP format
at
org.apache.storm.serialization.GzipThriftSerializationDelegate.deserialize(GzipThriftSerializationDelegate.java:53)
at org.apache.storm.utils.Utils.deserialize(Utils.java:145)
at
org.apache.storm.cluster$maybe_deserialize.invoke(cluster.clj:224)
at
org.apache.storm.cluster$mk_storm_cluster_state$reify__3761.supervisor_info(cluster.clj:407)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93)
at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28)
at
org.apache.storm.daemon.nimbus$all_supervisor_info$fn__6483.invoke(nimbus.clj:426)
at clojure.core$map$fn__4553.invoke(core.clj:2624)
at clojure.lang.LazySeq.sval(LazySeq.java:40)
at clojure.lang.LazySeq.seq(LazySeq.java:49)
at clojure.lang.RT.seq(RT.java:507)
at clojure.core$seq__4128.invoke(core.clj:137)
at clojure.core$apply.invoke(core.clj:630)
at clojure.core$mapcat.doInvoke(core.clj:2660)
at clojure.lang.RestFn.invoke(RestFn.java:423)
at
org.apache.storm.daemon.nimbus$all_supervisor_info.invoke(nimbus.clj:424)
at
org.apache.storm.daemon.nimbus$all_scheduling_slots.invoke(nimbus.clj:437)
at
org.apache.storm.daemon.nimbus$compute_new_scheduler_assignments.invoke(nimbus.clj:841)
at
org.apache.storm.daemon.nimbus$mk_assignments.doInvoke(nimbus.clj:912)
at clojure.lang.RestFn.invoke(RestFn.java:410)
at
org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto____7167$fn__7180$fn__7181.invoke(nimbus.clj:1414)
at
org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto____7167$fn__7180.invoke(nimbus.clj:1413)
at
org.apache.storm.timer$schedule_recurring$this__6306.invoke(timer.clj:105)
at
org.apache.storm.timer$mk_timer$fn__6289$fn__6290.invoke(timer.clj:50)
at org.apache.storm.timer$mk_timer$fn__6289.invoke(timer.clj:42)
at clojure.lang.AFn.run(AFn.java:22)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.util.zip.ZipException: Not
in GZIP format
at org.apache.storm.utils.Utils.gunzip(Utils.java:217)
at
org.apache.storm.serialization.GzipThriftSerializationDelegate.deserialize(GzipThriftSerializationDelegate.java:50)
... 30 more
Caused by: java.util.zip.ZipException: Not in GZIP format
at
java.util.zip.GZIPInputStream.readHeader(GZIPInputStream.java:164)
at java.util.zip.GZIPInputStream.<init>(GZIPInputStream.java:78)
at java.util.zip.GZIPInputStream.<init>(GZIPInputStream.java:90)
at org.apache.storm.utils.Utils.gunzip(Utils.java:207)
... 31 more
2016-10-28 09:05:01.398 o.a.s.util [ERROR] Halting process: ("Error when
processing an event")
java.lang.RuntimeException: ("Error when processing an event")
at org.apache.storm.util$exit_process_BANG_.doInvoke(util.clj:341)
at clojure.lang.RestFn.invoke(RestFn.java:423)
at
org.apache.storm.daemon.nimbus$nimbus_data$fn__6397.invoke(nimbus.clj:195)
at
org.apache.storm.timer$mk_timer$fn__6289$fn__6290.invoke(timer.clj:71)
at org.apache.storm.timer$mk_timer$fn__6289.invoke(timer.clj:42)
at clojure.lang.AFn.run(AFn.java:22)
at java.lang.Thread.run(Thread.java:745)