Reo-LEI opened a new issue #3551:
URL: https://github.com/apache/iceberg/issues/3551
Currently I encounter a `KryoException` when I submit a flink job to flink
1.12.x.
```
2021-11-12 18:07:03,976 WARN org.apache.flink.runtime.taskmanager.Task
dw_rt_ods.ods_mysql_cdc_hive_exec_job-IcebergStreamWriter (1/1)#0
[] - database.table-IcebergStreamWriter (1/1)#0
(2377289ed0fedccf9d510099ec769e24) switched from RUNNING to FAILED.
java.lang.RuntimeException: Exception occurred while setting the current key
context.
at
org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.setCurrentKey(StreamOperatorStateHandler.java:322)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.streaming.api.operators.AbstractStreamOperator.setCurrentKey(AbstractStreamOperator.java:532)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.streaming.api.operators.AbstractStreamOperator.setKeyContextElement(AbstractStreamOperator.java:527)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.streaming.api.operators.AbstractStreamOperator.setKeyContextElement1(AbstractStreamOperator.java:514)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:190)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.processElement(StreamTaskNetworkInput.java:204)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.emitNext(StreamTaskNetworkInput.java:174)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:396)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:191)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:617)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:581)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:755)
[flink-dist_2.12-1.12.1.jar:1.12.1]
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:570)
[flink-dist_2.12-1.12.1.jar:1.12.1]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_271]
Caused by: com.esotericsoftware.kryo.KryoException:
java.lang.NullPointerException
Serialization trace:
getters (org.apache.iceberg.flink.RowDataWrapper)
struct (org.apache.iceberg.util.StructProjection)
struct (org.apache.iceberg.util.StructLikeWrapper)
at
com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:82)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at com.esotericsoftware.kryo.Kryo.writeClassAndObject(Kryo.java:599)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.serialize(KryoSerializer.java:316)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.contrib.streaming.state.RocksDBSerializedCompositeKeyBuilder.serializeKeyGroupAndKey(RocksDBSerializedCompositeKeyBuilder.java:157)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.contrib.streaming.state.RocksDBSerializedCompositeKeyBuilder.setKeyAndKeyGroup(RocksDBSerializedCompositeKeyBuilder.java:93)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.setCurrentKey(RocksDBKeyedStateBackend.java:386)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.setCurrentKey(StreamOperatorStateHandler.java:320)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
... 14 more
Caused by: java.lang.NullPointerException
at com.esotericsoftware.kryo.Kryo.getSerializer(Kryo.java:476)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
com.esotericsoftware.kryo.serializers.DefaultArraySerializers$ObjectArraySerializer.write(DefaultArraySerializers.java:345)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
com.esotericsoftware.kryo.serializers.DefaultArraySerializers$ObjectArraySerializer.write(DefaultArraySerializers.java:289)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at com.esotericsoftware.kryo.Kryo.writeClassAndObject(Kryo.java:599)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.serialize(KryoSerializer.java:316)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.contrib.streaming.state.RocksDBSerializedCompositeKeyBuilder.serializeKeyGroupAndKey(RocksDBSerializedCompositeKeyBuilder.java:157)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.contrib.streaming.state.RocksDBSerializedCompositeKeyBuilder.setKeyAndKeyGroup(RocksDBSerializedCompositeKeyBuilder.java:93)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.setCurrentKey(RocksDBKeyedStateBackend.java:386)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
at
org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.setCurrentKey(StreamOperatorStateHandler.java:320)
~[flink-dist_2.12-1.12.1.jar:1.12.1]
... 14 more
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
