Hey list,

First of all, we've been using Storm at Linkfluence for several years now
and are very happy with it.

We had a bunch of topologies running very well under Storm 0.8.2 until last
week when we switched to storm 0.9.2-incubating. We use the clojure DSL,
and clojure 1.5.1 (only).

Since the change, we have a large topology (about 30 bolts, parallellism=10
or 20 per bolt, total 372 tasks on 10 workers) that fails on startup with
several bolts showing the exception :

java.lang.RuntimeException: java.lang.IllegalStateException: Attempting to
call unbound fn: #'entry-dedup.bolt/dedup__ at
backtype.storm.clojure.ClojureBolt.prepare(ClojureBolt.java:77) at backtype.

This can occur on one or several bolts at random and is not consistent
between restarts.

The topology is indeed quite long to initialize due to several models being
loaded but this was OK in 0.8.2.

Another (shorter) topology works most of the time but shows this behaviour
on some restarts sometimes.

We have a workaround that works most of the time : start the topology in
the INACTIVE state, then wait 200 seconds, then activate it. But this
doesn't really solve our problem because sometimes Storm tries to rebalance
the topologies and restarts the topology without our little trick.

So maybe something changed in storm that introduces a kind of race
condition during initializaion of some bolts on larger topologies ?

Did somebody experience the same issue ?

Thanks


-- 
Philippe

Reply via email to