ghrahul commented on issue #11126: URL: https://github.com/apache/hudi/issues/11126#issuecomment-2306407781
Hi @SudhirSaxena , If you are running data ingestion pipeline in an incremental way. You have to just change HUDI Spark bundle and run 1 incremental job in the same table without changing any HUDI properties. HUDI upsert will take care of updating the table properties. For EMR compatibility you have to check with AWS support. I am using emr-6.15.0 along with `hudi-spark3-bundle_2.12-0.14.0-amzn-0.jar` for some use cases. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
