xushiyan commented on issue #7392: URL: https://github.com/apache/hudi/issues/7392#issuecomment-1348571338
this is due to amzn spark is different from open source spark in some APIs like PartitionedFile. when you use Glue, it's an aws-managed service. as you're using hudi 0.10.0 which is an open source version which can be incompatible with amzn spark. Better use aws provided hudi glue connector 0.10.1. see https://aws.amazon.com/blogs/big-data/part-1-get-started-with-apache-hudi-using-aws-glue-by-implementing-key-design-concepts/ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
