MikeMccree commented on issue #10273: URL: https://github.com/apache/hudi/issues/10273#issuecomment-1852429920
@ad1happy2go After more toying around I managed to get rid of the above exceptions by being specific about the JARS I am submitting along with my spark-submit. The problem now is I am running into the following issue: ``` [SCHEMA_NOT_FOUND] The schema `michael_test` cannot be found. Verify the spelling and correctness of the schema and catalog. If you did not qualify the name with a catalog, verify the current_schema() output, or qualify the name with the correct catalog. ``` Why would I receive the above error when I specify the below in my script: ``` # Specify the database name database_name = "michael_test" 'hoodie.database.name': database_name, 'hoodie.table.name': loggingtablename, 'hoodie.datasource.hive_sync.database': database_name, 'hoodie.datasource.hive_sync.table': loggingtablename, ``` **Again, the above config / script worked perfectly fine on EMR 6.10.0 > Spark 3.3.1 > Hudi 0.12.2** **Is there possibly something buggy with EMR 6.15.0 > Spark 3.4.1 > Hudi 0.14.0 ?** -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
