umehrot2 commented on issue #2041: URL: https://github.com/apache/hudi/issues/2041#issuecomment-683604567
@zherenyu831 you are right. EMR has its own customized Spark and has several modifications. The interface you are pointing out here is also modified, and since while building hudi 0.6.0 its not being built against EMR's spark that is why you are getting this error. Now it would be ideal if you wait until hudi 0.6.0 is officially supported on EMR in future releases. But until then, if you really want to still try using it on existing EMR releases there is likely hood of these runtime issues because EMR's hudi is built against EMR's versions of hadoop, hive and spark. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
