umehrot2 commented on issue #2057: URL: https://github.com/apache/hudi/issues/2057#issuecomment-693146719
@WTa-hash The first one is not really an issue. You are basically trying to run Hudi 0.6.0 on an EMR release which does not officially support it. That is why you face this interface compatibility issue since the hudi jar you built is not compiled with EMR's spark version. For now, like @zherenyu831 mentioned if you really want to use Hudi 0.6.0 on EMR you may have to get around it by shading spark-sql etc. Hudi 0.6.0 will be officially supported in upcoming EMR releases, after which you will not have to build your own 0.6.0 jars and will not run into this issue. As for the second issue with deletes being missed seems like it has been fixed with https://github.com/apache/hudi/pull/2084 . Is there any other question pending to be answered on this issue ? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
