Hi Chesnay,
I tried with the version 1.7.0 and I had the same error.
2018-11-30 13:13:00,718 INFO
org.apache.flink.runtime.taskmanager.Task -
keyedstats-processor-165 -> map2alert-165 -> Process -> Sink:
sink-level165 (1/4) (a972c963d4ee576a88c9116e946eec62) switched from
RUNNING to FAILED.
java.io.IOException: Exception while applying AggregateFunction in
aggregating state
at
org.apache.flink.runtime.state.heap.HeapAggregatingState.add(HeapAggregatingState.java:107)
at
org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.processElement(WindowOperator.java:391)
at
org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:202)
at
org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:105)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:704)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ArrayIndexOutOfBoundsException: -1
at com.esotericsoftware.kryo.util.IntArray.pop(IntArray.java:157)
at com.esotericsoftware.kryo.Kryo.reference(Kryo.java:822)
at
com.esotericsoftware.kryo.serializers.CollectionSerializer.copy(CollectionSerializer.java:129)
at
com.esotericsoftware.kryo.serializers.CollectionSerializer.copy(CollectionSerializer.java:22)
at com.esotericsoftware.kryo.Kryo.copy(Kryo.java:862)
at
org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.copy(KryoSerializer.java:217)
at
org.apache.flink.api.java.typeutils.runtime.PojoSerializer.copy(PojoSerializer.java:243)
at
org.apache.flink.api.scala.typeutils.TraversableSerializer$$anonfun$copy$1.apply(TraversableSerializer.scala:69)
at
org.apache.flink.api.scala.typeutils.TraversableSerializer$$anonfun$copy$1.apply(TraversableSerializer.scala:69)
at scala.collection.immutable.List.foreach(List.scala:392)
at
org.apache.flink.api.scala.typeutils.TraversableSerializer.copy(TraversableSerializer.scala:69)
at
org.apache.flink.api.scala.typeutils.TraversableSerializer.copy(TraversableSerializer.scala:33)
at
org.apache.flink.api.scala.typeutils.CaseClassSerializer.copy(CaseClassSerializer.scala:101)
at
org.apache.flink.api.scala.typeutils.CaseClassSerializer.copy(CaseClassSerializer.scala:32)
at
org.apache.flink.api.scala.typeutils.TraversableSerializer$$anonfun$copy$1.apply(TraversableSerializer.scala:69)
at
org.apache.flink.api.scala.typeutils.TraversableSerializer$$anonfun$copy$1.apply(TraversableSerializer.scala:69)
at scala.collection.Iterator$class.foreach(Iterator.scala:891)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at
org.apache.flink.api.scala.typeutils.TraversableSerializer.copy(TraversableSerializer.scala:69)
at
org.apache.flink.api.scala.typeutils.TraversableSerializer.copy(TraversableSerializer.scala:33)
at
org.apache.flink.runtime.state.heap.CopyOnWriteStateTable.transform(CopyOnWriteStateTable.java:465)
at
org.apache.flink.runtime.state.heap.CopyOnWriteStateTable.transform(CopyOnWriteStateTable.java:341)
at
org.apache.flink.runtime.state.heap.HeapAggregatingState.add(HeapAggregatingState.java:105)
... 6 more
2018-11-30 13:13:00,719 INFO
org.apache.flink.runtime.taskmanager.Task -
Freeing task resources for keyedstats-processor-165 -> map2alert-165
-> Process -> Sink: sink-level165 (1/4)
(a972c963d4ee576a88c9116e946eec62).
2018-11-30 13:13:00,748 INFO org.apache.flink.runtime.taskmanager.Task
Thanks
On Thu, 29 Nov 2018 at 12:50, Chesnay Schepler <ches...@apache.org> wrote:
> Would it be possible for you to try this with 1.6-SNAPSHOT? This issue may
> have been fixed with https://issues.apache.org/jira/browse/FLINK-10839.
>
> On 29.11.2018 12:11, Felipe Quirce wrote:
>
> Hi
>
> I'm using the flink 1.6.2, and full stack trace is
>
> java.io.IOException: Exception while applying AggregateFunction in
> aggregating state
> 4308 at
> org.apache.flink.runtime.state.heap.HeapAggregatingState.add(HeapAggregatingState.java:107)
> 4309 at
> org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.processElement(WindowOperator.java:391)
> 4310 at
> org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:202)
> 4311 at
> org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:105)
> 4312 at
> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300)
> 4313 at
> org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
> 4314 at
> java.lang.Thread.run(Thread.java:748)
> 4315 Caused by: java.lang.ArrayIndexOutOfBoundsException:
> -1
> 4316 at
> com.esotericsoftware.kryo.util.IntArray.pop(IntArray.java:157)
> 4317 at
> com.esotericsoftware.kryo.Kryo.reference(Kryo.java:822)
> 4318 at
> com.esotericsoftware.kryo.serializers.CollectionSerializer.copy(CollectionSerializer.java:129)
> 4319 at
> com.esotericsoftware.kryo.serializers.CollectionSerializer.copy(CollectionSerializer.java:22)
> 4320 at
> com.esotericsoftware.kryo.Kryo.copy(Kryo.java:862)
> 4321 at
> org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.copy(KryoSerializer.java:217)
> 4322 at
> org.apache.flink.api.java.typeutils.runtime.PojoSerializer.copy(PojoSerializer.java:239)
> 4323 at
> org.apache.flink.api.scala.typeutils.TraversableSerializer$$anonfun$copy$1.apply(TraversableSerializer.scala:69)
> 4324 at
> org.apache.flink.api.scala.typeutils.TraversableSerializer$$anonfun$copy$1.apply(TraversableSerializer.scala:69)
> 4325 at
> scala.collection.immutable.List.foreach(List.scala:392)
> 4326 at
> org.apache.flink.api.scala.typeutils.TraversableSerializer.copy(TraversableSerializer.scala:69)
> 4327 at
> org.apache.flink.api.scala.typeutils.TraversableSerializer.copy(TraversableSerializer.scala:33)
> 4328 at
> org.apache.flink.api.scala.typeutils.CaseClassSerializer.copy(CaseClassSerializer.scala:101)
> 4329 at
> org.apache.flink.api.scala.typeutils.CaseClassSerializer.copy(CaseClassSerializer.scala:32)
> 4330 at
> org.apache.flink.api.scala.typeutils.TraversableSerializer$$anonfun$copy$1.apply(TraversableSerializer.scala:69)
> 4331 at
> org.apache.flink.api.scala.typeutils.TraversableSerializer$$anonfun$copy$1.apply(TraversableSerializer.scala:69)
> 4332 at
> scala.collection.Iterator$class.foreach(Iterator.scala:891)
> 4333 at
> scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
> 4334 at
> scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
> 4335 at
> scala.collection.AbstractIterable.foreach(Iterable.scala:54)
> 4336 at
> org.apache.flink.api.scala.typeutils.TraversableSerializer.copy(TraversableSerializer.scala:69)
> 4337 at
> org.apache.flink.api.scala.typeutils.TraversableSerializer.copy(TraversableSerializer.scala:33)
> 4338 at
> org.apache.flink.runtime.state.heap.CopyOnWriteStateTable.transform(CopyOnWriteStateTable.java:465)
> 4339 at
> org.apache.flink.runtime.state.heap.CopyOnWriteStateTable.transform(CopyOnWriteStateTable.java:341)
> 4340 at
> org.apache.flink.runtime.state.heap.HeapAggregatingState.add(HeapAggregatingState.java:105)
> 4341 ... 6 more
>
> Thanks
>
> On Thu, 29 Nov 2018 at 11:55, Felipe Quirce <pipe....@gmail.com> wrote:
>
>> Hi,
>>
>> I have found a problem during the checkpoint.
>> Could anyone help me or help me to debug it?
>> Exception:
>>
>>> 1804 2018-11-29 11:31:00,448 INFO
>>> org.apache.flink.runtime.executiongraph.ExecutionGraph
>>> - keyedstats-processor-165 -> map2alert-165 -> Process -> Sink:
>>> sink-level165 (1/2) (d860069560a4e3e6a62a450c9e3fa699) switched from
>>> RUNNING to FAILED.
>>> 51805 java.io.IOException: Exception while applying AggregateFunction in
>>> aggregating state
>>> 51806 at
>>> org.apache.flink.runtime.state.heap.HeapAggregatingState.add(HeapAggregatingState.java:107)
>>> 51807 at
>>> org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.processElement(WindowOperator.java:391)
>>> 51808 at
>>> org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:202)
>>> 51809 at
>>> org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:105)
>>> 51810 at
>>> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:300)
>>> 51811 at
>>> org.apache.flink.runtime.taskmanager.Task.run(Task.java:711)
>>> 51812 at
>>> java.lang.Thread.run(Thread.java:748)
>>> 51813 Caused by: java.lang.ArrayIndexOutOfBoundsException
>>>
>>
>> Thanks in Advance,
>>
>
>
