vinothchandar commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532360758 @umehrot2 https://github.com/apache/incubator-hudi/pull/903 opened this for shading changes.. FYI.. On bumping up versions, there are few compatibility considerations. - Bumping parquet to 1.8.2 may be ok, since spark 2.2+ have that - Avro however is still 1.7.7 till spark 2.3 spark bundle will only include parquet-avro and use avro jars from the spark installation. Thus simply bumping parquet to 1.8.2 inside Hudi and then using against a spark 2.4 could work. Supporting Decimal on spark 2.3 and earlier might be tricky.. thoughts? Also feel free to open a new PR, since @cdmikechen will take few weeks to circle back, as he mentioned.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
