[
https://issues.apache.org/jira/browse/SPARK-31641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-31641:
--------------------------------
Parent: SPARK-31404
Issue Type: Sub-task (was: Bug)
> Incorrect days conversion by JSON legacy parser
> -----------------------------------------------
>
> Key: SPARK-31641
> URL: https://issues.apache.org/jira/browse/SPARK-31641
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 3.0.0, 3.1.0
> Reporter: Maxim Gekk
> Assignee: Maxim Gekk
> Priority: Major
> Fix For: 3.0.0
>
>
> Spark 2.4.5:
> {code:scala}
> scala> val ds = Seq("{'d': '-141704'}").toDS
> ds: org.apache.spark.sql.Dataset[String] = [value: string]
> scala> val json = spark.read.schema("d date").json(ds)
> json: org.apache.spark.sql.DataFrame = [d: date]
> scala> json.show
> +----------+
> | d|
> +----------+
> |1582-01-01|
> +----------+
> {code}
> Spark 3.1.0-SNAPSHOT:
> {code:scala}
> scala> val ds = Seq("{'d': '-141704'}").toDS
> ds: org.apache.spark.sql.Dataset[String] = [value: string]
> scala> val json = spark.read.schema("d date").json(ds)
> json: org.apache.spark.sql.DataFrame = [d: date]
> scala> json.show
> +----------+
> | d|
> +----------+
> |1582-01-11|
> +----------+
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
