Michel Lemay created SPARK-14428:
------------------------------------
Summary: [SQL] Allow more flexibility when parsing dates and
timestamps in json datasources
Key: SPARK-14428
URL: https://issues.apache.org/jira/browse/SPARK-14428
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 1.6.1
Reporter: Michel Lemay
Priority: Minor
Reading a json with dates and timestamps is limited to predetermined string
formats or long values.
Date: Int -> number of days since epoch
Timestamps: Long -> number of nanoseconds since epoch
We should be able to set an option on json datasource to parse dates and
timestamps using custom format. Also, we should be able to change the
interpretation of long values to number of milliseconds since epoch.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
