umehrot2 opened a new pull request #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005 Sending this PR out early to get feedback. Have not yet looked into what changes are required for tests. But in general these changes have been working for us on AWS EMR without any issues so far. This PR implements the following: - Migrates Hudi to Spark 2.4.4 - Migrates Hudi to use spark-avro module instead of the deprecated databricks-avro - Adds support for Decimal/Date types correctly through Hive - Timestamp still needs to be supported as it is blocked on https://issues.apache.org/jira/browse/HUDI-83
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
