singhpk234 opened a new pull request, #5437:
URL: https://github.com/apache/iceberg/pull/5437

   ### About the change
   
   presently spark queries fails when using S3fileIO & GlueCatalog when being 
used with KryoSerializer ref 
https://github.com/apache/iceberg/issues/5414#issuecomment-1204319969. This 
happens because Immutable map part of S3FileIO properties is not serializable 
with Kryo and seralizers for it not available in Twitter Chill lib as well 
(which also spark uses). This PR attemps to fix this by using java collections 
instead which spark will be able to ser/de as it's serializer is present in 
[Chill 
lib](https://github.com/twitter/chill/blob/develop/chill-java/src/main/java/com/twitter/chill/java/UnmodifiableMapSerializer.java).
 
   
   Solves https://github.com/apache/iceberg/issues/5414
   
   ### Testing Done 
   
   Manaul Test ...
   UT : TODO
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to