subash-metica commented on issue #9909: URL: https://github.com/apache/hudi/issues/9909#issuecomment-1776916915
Hi @ad1happy2go - Thanks for quick reply. I tried using the [OSS bundle jar](https://mvnrepository.com/artifact/org.apache.hudi/hudi-spark3.3-bundle_2.12/0.13.1) instead of EMR provided one. While doing so, I get `java.lang.ClassNotFoundException: org.apache.spark.sql.adapter.Spark2Adapter` exception. Spark in EMR is 3.4.0 but the uber jar is of version Spark 3.3.2 and I sent the bundle jar as --jars while submitting the job. If I use the EMR bundle jar it starts fine. The problem might be due to conflicting dependencies in the uber jar of Caffeine dependency - I will try to fix it and start again to avoid it but I am not able to use OSS bundle jar. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
