[jira] [Commented] (SPARK-10365) Support Parquet logical type TIMESTAMP_MICROS
[ https://issues.apache.org/jira/browse/SPARK-10365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245082#comment-16245082 ] Apache Spark commented on SPARK-10365: -- User 'cloud-fan' has created a pull request for this issue: https://github.com/apache/spark/pull/19702 > Support Parquet logical type TIMESTAMP_MICROS > - > > Key: SPARK-10365 > URL: https://issues.apache.org/jira/browse/SPARK-10365 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 1.5.0 >Reporter: Cheng Lian > > Didn't assign target version for this ticket because neither the most recent > parquet-mr release (1.8.1) nor the master branch has supported > {{TIMESTAMP_MICROS}} yet. > It would be nice to map Spark SQL {{TimestampType}} to {{TIMESTAMP_MICROS}} > since Parquet {{INT96}} will probably be deprecated and is only used for > compatibility reason for now. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-10365) Support Parquet logical type TIMESTAMP_MICROS
[ https://issues.apache.org/jira/browse/SPARK-10365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162295#comment-16162295 ] Ryan Munro commented on SPARK-10365: It looks like {{TIMESTAMP_MICROS}} is supported in parquet-mr since 1.9.0 PARQUET-393 > Support Parquet logical type TIMESTAMP_MICROS > - > > Key: SPARK-10365 > URL: https://issues.apache.org/jira/browse/SPARK-10365 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 1.5.0 >Reporter: Cheng Lian > > Didn't assign target version for this ticket because neither the most recent > parquet-mr release (1.8.1) nor the master branch has supported > {{TIMESTAMP_MICROS}} yet. > It would be nice to map Spark SQL {{TimestampType}} to {{TIMESTAMP_MICROS}} > since Parquet {{INT96}} will probably be deprecated and is only used for > compatibility reason for now. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org