openinx opened a new pull request #3857:
URL: https://github.com/apache/iceberg/pull/3857


   The `SerializableTable`  cannot be kyro serializable because it will 
encounter the anonymous lambda registration issues. See the following 
stacktrace: 
   
   ```java
   com.esotericsoftware.kryo.KryoException: java.lang.NullPointerException
   Serialization trace:
   hadoopConf (org.apache.iceberg.hadoop.HadoopFileIO)
   io (org.apache.iceberg.SerializableTable)
   
        at 
com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:82)
        at 
com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
        at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)
        at 
com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)
        at 
com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
        at com.esotericsoftware.kryo.Kryo.writeClassAndObject(Kryo.java:599)
        at 
org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.serialize(KryoSerializer.java:316)
        at 
org.apache.iceberg.flink.TestHelpers.roundTripKryoSerialize(TestHelpers.java:78)
        at 
org.apache.iceberg.flink.TestTableSerialization.testSerializableTableKryoSerialization(TestTableSerialization.java:85)
   Caused by: java.lang.NullPointerException
        at 
com.esotericsoftware.kryo.util.DefaultClassResolver.writeClass(DefaultClassResolver.java:80)
        at com.esotericsoftware.kryo.Kryo.writeClass(Kryo.java:488)
        at 
com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:57)
        ... 35 more
   ```
   
   
![image](https://user-images.githubusercontent.com/5028729/148504196-44c15a99-8c98-4691-a634-f20ce3bba2e0.png)
   
   This patch is trying to expand the anonymous lambda to a deterministic 
defined class to solve this serialize issue.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to