thesuperzapper opened a new issue #628: Replace Databricks spark-avro with 
native spark-avro
URL: https://github.com/apache/incubator-hudi/issues/628
 
 
   I believe that we should bump to Spark 2.4 minimum for the native spark-avro 
package. Its just going to become problematic the longer we leave it, as 
Databricks spark-avro has no support for AVRO 1.8 logical types. [But core 
spark-avro 
does.](https://github.com/apache/spark/commit/be2238fb502b0f49a8a1baa6da9bc3e99540b40e#diff-c966b53dc6f5acf1a1dfc725d8dea605)
   
   This has caused issues: #547 #543
   
   It also seems related to: 
[HUDI-12](https://issues.apache.org/jira/browse/HUDI-12)

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to