kapjoshi-cisco commented on issue #5636: URL: https://github.com/apache/hudi/issues/5636#issuecomment-1140324033
> @tjtoll + anyone who use AWS Glue > > If you have to use Glue3, then go with Hudi 0.9 that you can get from AWS Marketplace. you don't need to download anything manually since you can get JARs by setting Glue Connection. > > If you have to use higher than Hudi 0.9, then go with Glue2 + Hudi 0.10.1. Here are JARs you need. When you use custom JARs to use Hudi, you have to remove Glue Connection for Hudi. > > * https://repo1.maven.org/maven2/org/apache/spark/spark-avro_2.11/2.4.4/spark-avro_2.11-2.4.4.jar > * https://repo1.maven.org/maven2/org/apache/hudi/hudi-spark-bundle_2.11/0.10.1/ > > **WHY Hudi 0.10.1?** Hudi 0.9 has some bugs I noticed. > > * Metadata Table doesn't work properly. It leaks data > * DELETE_OPERATION fails when syncing metadata to Glue Catalog yeah, this combination works and just to confirm is there no possibility to use 0.11.0 with aws glue as of today? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
