[jira] [Assigned] (SPARK-25160) Remove sql configuration spark.sql.avro.outputTimestampType
[ https://issues.apache.org/jira/browse/SPARK-25160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25160: Assignee: Gengliang Wang > Remove sql configuration spark.sql.avro.outputTimestampType > --- > > Key: SPARK-25160 > URL: https://issues.apache.org/jira/browse/SPARK-25160 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.4.0 >Reporter: Gengliang Wang >Assignee: Gengliang Wang >Priority: Major > Fix For: 2.4.0 > > > In the PR for supporting logical timestamp types > [https://github.com/apache/spark/pull/21935,] a SQL configuration > spark.sql.avro.outputTimestampType is added, so that user can specify the > output timestamp precision they want. > With PR [https://github.com/apache/spark/pull/21847,] the output file can be > written with user specified types. > So no need to have such configuration. Otherwise to make it consistent we > need to add configuration for all the Catalyst types that can be converted > into different Avro types. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-25160) Remove sql configuration spark.sql.avro.outputTimestampType
[ https://issues.apache.org/jira/browse/SPARK-25160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25160: Assignee: Apache Spark > Remove sql configuration spark.sql.avro.outputTimestampType > --- > > Key: SPARK-25160 > URL: https://issues.apache.org/jira/browse/SPARK-25160 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.4.0 >Reporter: Gengliang Wang >Assignee: Apache Spark >Priority: Major > > In the PR for supporting logical timestamp types > [https://github.com/apache/spark/pull/21935,] a SQL configuration > spark.sql.avro.outputTimestampType is added, so that user can specify the > output timestamp precision they want. > With PR [https://github.com/apache/spark/pull/21847,] the output file can be > written with user specified types. > So no need to have such configuration. Otherwise to make it consistent we > need to add configuration for all the Catalyst types that can be converted > into different Avro types. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-25160) Remove sql configuration spark.sql.avro.outputTimestampType
[ https://issues.apache.org/jira/browse/SPARK-25160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25160: Assignee: (was: Apache Spark) > Remove sql configuration spark.sql.avro.outputTimestampType > --- > > Key: SPARK-25160 > URL: https://issues.apache.org/jira/browse/SPARK-25160 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.4.0 >Reporter: Gengliang Wang >Priority: Major > > In the PR for supporting logical timestamp types > [https://github.com/apache/spark/pull/21935,] a SQL configuration > spark.sql.avro.outputTimestampType is added, so that user can specify the > output timestamp precision they want. > With PR [https://github.com/apache/spark/pull/21847,] the output file can be > written with user specified types. > So no need to have such configuration. Otherwise to make it consistent we > need to add configuration for all the Catalyst types that can be converted > into different Avro types. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
