GitHub user gengliangwang opened a pull request:
https://github.com/apache/spark/pull/21935
[SPARK-24773] Avro: support logical timestamp type with different precisions
## What changes were proposed in this pull request?
Support reading Avro logical timestamp type with different precisions
https://avro.apache.org/docs/1.8.2/spec.html#Timestamp+%28millisecond+precision%29
Also support writing Spark Timestamp type to Avro timestamp type with
millisecond precision, which is consistent with the previous behavior of
writing Timestamp type with Avro 1.7.
## How was this patch tested?
Unit test
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gengliangwang/spark avro_timestamp
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21935.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21935
----
commit 3a53f5569fa47cf0fb0e3eadb0f1c134dc1448b0
Author: Gengliang Wang <gengliang.wang@...>
Date: 2018-07-31T18:27:18Z
Avro: support logical timestamp type
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
