Maxim Gekk created SPARK-31641:
----------------------------------
Summary: Incorrect days conversion by JSON legacy parser
Key: SPARK-31641
URL: https://issues.apache.org/jira/browse/SPARK-31641
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.0.0, 3.1.0
Reporter: Maxim Gekk
Spark 2.4.5:
{code:scala}
scala> val ds = Seq("{'d': '-141704'}").toDS
ds: org.apache.spark.sql.Dataset[String] = [value: string]
scala> val json = spark.read.schema("d date").json(ds)
json: org.apache.spark.sql.DataFrame = [d: date]
scala> json.show
+----------+
| d|
+----------+
|1582-01-01|
+----------+
{code}
Spark 3.1.0-SNAPSHOT:
{code:scala}
scala> val ds = Seq("{'d': '-141704'}").toDS
ds: org.apache.spark.sql.Dataset[String] = [value: string]
scala> val json = spark.read.schema("d date").json(ds)
json: org.apache.spark.sql.DataFrame = [d: date]
scala> json.show
+----------+
| d|
+----------+
|1582-01-11|
+----------+
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
