Hans-Raintree commented on issue #10091: URL: https://github.com/apache/hudi/issues/10091#issuecomment-1810925173
Hey @ad1happy2go, That would work as well, I would have to do two upserts, one for each table, I'm merging into the single table. Thanks for putting in the ticket! The issue with the custom payload as I understand is that I would have to compile my own jars, but I'm using AWS EMR which uses custom jars, ie. "hudi-spark3-bundle_2.12-0.13.1-amzn-0.jar". When I try to run with the standard jars I run into compatibility issues. It would be nice if there was a way to add custom payload/commit callbacks separately without having to build the entire packages. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
