rdblue commented on pull request #1532: URL: https://github.com/apache/iceberg/pull/1532#issuecomment-701875823
> The HadoopFileIO contains SerailiableSupplier<Configuration>, so it should be serialized by SerializationUtil and then Writable, therefore satisfy the serialization requirement for MR framework. Where is the `HadoopFileIO` being rebuilt with `SerializableSupplier<Configuration>`? In Spark, we have to check the `FileIO` and replace it with the one that references the `SerializableSupplier`. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
