thesuperzapper opened a new issue #628: Replace Databricks spark-avro with native spark-avro URL: https://github.com/apache/incubator-hudi/issues/628 I believe that we should bump to Spark 2.4 minimum for the native spark-avro package. Its just going to become problematic the longer we leave it, as Databricks spark-avro has no support for AVRO 1.8 logical types. [But core spark-avro does.](https://github.com/apache/spark/commit/be2238fb502b0f49a8a1baa6da9bc3e99540b40e#diff-c966b53dc6f5acf1a1dfc725d8dea605) This has caused issues: #547 #543 It also seems related to: [HUDI-12](https://issues.apache.org/jira/browse/HUDI-12)
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
