[
https://issues.apache.org/jira/browse/SPARK-32768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ron DeFreitas updated SPARK-32768:
----------------------------------
Description:
{{Spark 2.3.0 added the spark.sql.parquet.outputTimestampType configuration
option for controlling the underlying datatype used when writing Timestamp
column types into parquet files. This option is helpful for compatibility with
external systems that need to read the output from Spark.}}
{{This was never exposed in the documentation. Fix should be applied to docs
for both the next 3.x release and 2.4.x release.}}
was:
{{Spark 2.3.0 added the spark.sql.parquet.outputTimestampType configuration
option for controlling the underlying datatype used when writing Timestamp
column types into parquet files.}}
{{This was never exposed in the documentation. Fix should be applied to docs
for both the next 3.x release and 2.4.x release.}}
> Add Parquet Timestamp output configuration to docs
> --------------------------------------------------
>
> Key: SPARK-32768
> URL: https://issues.apache.org/jira/browse/SPARK-32768
> Project: Spark
> Issue Type: Documentation
> Components: docs
> Affects Versions: 2.3.0, 2.3.1, 2.3.2, 2.3.3, 2.3.4, 2.4.0, 2.4.1, 2.4.2,
> 2.4.3, 2.4.4, 2.4.5, 2.4.6, 3.0.0
> Reporter: Ron DeFreitas
> Priority: Minor
> Labels: docs-missing, parquet
>
> {{Spark 2.3.0 added the spark.sql.parquet.outputTimestampType configuration
> option for controlling the underlying datatype used when writing Timestamp
> column types into parquet files. This option is helpful for compatibility
> with external systems that need to read the output from Spark.}}
> {{This was never exposed in the documentation. Fix should be applied to docs
> for both the next 3.x release and 2.4.x release.}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
