yihua commented on PR #8441: URL: https://github.com/apache/hudi/pull/8441#issuecomment-1664337042
> @yihua > > > LGTM since most of the changes update API usage only. Is there any compatibility issue with different Spark, Flink and Hadoop versions? > > So far I have only tested with `Spark3` and `Hadoop3`. And I manually tested the aws hudi features like OCC, GlueSyncTool, CloudWatchMetricsReporter on EMR. > > I can try looking into doing some tests with flink but just curious what combinations of version testing I should do before we land this?( Hadoop, Spark, Flink) Synced offline already sometime before. We should test Spark 2.4, Spark 3.x with Hadoop 2 on S3 to make sure there is no compatibility issue, especially around S3A file system. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
