Gengliang Wang created SPARK-25160:
--------------------------------------
Summary: Remove sql configuration
spark.sql.avro.outputTimestampType
Key: SPARK-25160
URL: https://issues.apache.org/jira/browse/SPARK-25160
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 2.4.0
Reporter: Gengliang Wang
In the PR for supporting logical timestamp types
[https://github.com/apache/spark/pull/21935,] a SQL configuration
spark.sql.avro.outputTimestampType is added, so that user can specify the
output timestamp precision they want.
With PR [https://github.com/apache/spark/pull/21847,] the output file can be
written with user specified types.
So no need to have such configuration. Otherwise to make it consistent we need
to add configuration for all the Catalyst types that can be converted into
different Avro types.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
