How did you resolve it? This started being a problem after I added a third field to an output tuple, just a String.
On Thu, Mar 19, 2015 at 4:20 PM Vladimir Protsenko <[email protected]> wrote: > Hi, I've got once the same error when in deserialization was reading the > wrong number of bytes that were sent in serialization code. > > 2015-03-19 19:01 GMT+04:00 Luke Rohde <[email protected]>: > >> Hi, I'm seeing this exception from kryo deep inside storm and I haven't >> been able to figure it out. Forums/docs on kryo seem to mention that this >> can happen if you use a kryo instance in multiple threads concurrently, but >> I'm not doing that (and this appears to be coming from storm). Has anyone >> seen/dealt with this before? The stack trace: >> >> java.lang.RuntimeException: com.esotericsoftware.kryo.KryoException: >> Buffer underflow. >> at >> backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:128) >> ~[storm-core-0.9.3.jar:0.9.3] >> at >> backtype.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:99) >> ~[storm-core-0.9.3.jar:0.9.3] >> at >> backtype.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:80) >> ~[storm-core-0.9.3.jar:0.9.3] >> at >> backtype.storm.daemon.executor$fn__3441$fn__3453$fn__3500.invoke(executor.clj:748) >> ~[storm-core-0.9.3.jar:0.9.3] >> at backtype.storm.util$async_loop$fn__464.invoke(util.clj:463) >> ~[storm-core-0.9.3.jar:0.9.3] >> at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na] >> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_40] >> Caused by: com.esotericsoftware.kryo.KryoException: Buffer underflow. >> at com.esotericsoftware.kryo.io.Input.require(Input.java:156) >> ~[kryo-2.21.jar:na] >> at com.esotericsoftware.kryo.io.Input.readInt(Input.java:337) >> ~[kryo-2.21.jar:na] >> at >> com.esotericsoftware.kryo.util.DefaultClassResolver.readClass(DefaultClassResolver.java:109) >> ~[kryo-2.21.jar:na] >> at com.esotericsoftware.kryo.Kryo.readClass(Kryo.java:610) >> ~[kryo-2.21.jar:na] >> at >> com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:721) >> ~[kryo-2.21.jar:na] >> at >> com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:109) >> ~[kryo-2.21.jar:na] >> at >> com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:18) >> ~[kryo-2.21.jar:na] >> at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:629) >> ~[kryo-2.21.jar:na] >> at >> backtype.storm.serialization.KryoValuesDeserializer.deserializeFrom(KryoValuesDeserializer.java:38) >> ~[storm-core-0.9.3.jar:0.9.3] >> at >> backtype.storm.serialization.KryoTupleDeserializer.deserialize(KryoTupleDeserializer.java:53) >> ~[storm-core-0.9.3.jar:0.9.3] >> at >> backtype.storm.daemon.executor$mk_task_receiver$fn__3364.invoke(executor.clj:398) >> ~[storm-core-0.9.3.jar:0.9.3] >> at >> backtype.storm.disruptor$clojure_handler$reify__1447.onEvent(disruptor.clj:58) >> ~[storm-core-0.9.3.jar:0.9.3] >> at >> backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:125) >> ~[storm-core-0.9.3.jar:0.9.3] >> ... 6 common frames omitted >> >> >
