[GitHub] [incubator-hudi] umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

2019-09-18 Thread GitBox
umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532810711 > @umehrot2 I think balaji has his hands full with the release atm. Do you have bandwidth to try moving to

[GitHub] [incubator-hudi] umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

2019-09-18 Thread GitBox
umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532808342 @vinothchandar At EMR we do not have a use-case to support Spark 2.3 or earlier. We would be offering Hudi

[GitHub] [incubator-hudi] umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

2019-09-17 Thread GitBox
umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532475222 @vinothchandar At the moment, I cannot think of a good way how we can upgrade avro version while still

[GitHub] [incubator-hudi] umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

2019-09-17 Thread GitBox
umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532354352 @vinothchandar @cdmikechen I was able to read and write `Decimal` type correctly by upgrading that

[GitHub] [incubator-hudi] umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

2019-09-16 Thread GitBox
umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532026904 > @umehrot2 Great analysis.. Would upgrading parquet-avro help? Good point @vinothchandar . Upon a

[GitHub] [incubator-hudi] umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

2019-09-16 Thread GitBox
umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532014549 > should we first rebase and resolve the conflicts? For my testing, I had re-based this PR on top of