[GitHub] [spark] gengliangwang commented on issue #26524: [SPARK-29898][SQL] Support Avro Custom Logical Types

2019-12-03 Thread GitBox
gengliangwang commented on issue #26524: [SPARK-29898][SQL] Support Avro Custom Logical Types URL: https://github.com/apache/spark/pull/26524#issuecomment-561297441 @pradomota @edrevo I think the usage of the custom logical type support is complex. In your example, even the column

[GitHub] [spark] gengliangwang commented on issue #26524: [SPARK-29898][SQL] Support Avro Custom Logical Types

2019-11-25 Thread GitBox
gengliangwang commented on issue #26524: [SPARK-29898][SQL] Support Avro Custom Logical Types URL: https://github.com/apache/spark/pull/26524#issuecomment-558298514 > With this extension you can add your custom logical types and map it to the properly SQL type. For example; read a string

[GitHub] [spark] gengliangwang commented on issue #26524: [SPARK-29898][SQL] Support Avro Custom Logical Types

2019-11-22 Thread GitBox
gengliangwang commented on issue #26524: [SPARK-29898][SQL] Support Avro Custom Logical Types URL: https://github.com/apache/spark/pull/26524#issuecomment-557707264 Hi @pradomota , To write Avro files with a schema different from the default mapping, you can use the option