GitHub user sergey-rubtsov opened a pull request:
https://github.com/apache/spark/pull/21363
[SPARK-19228][SQL] Migrate on Java 8 time from FastDateFormat for meet the
ISO8601
## What changes were proposed in this pull request?
Add support for inferring DateType and custom "dateFormat" option.
Fix an old bug with parse string to SQL's timestamp value in microseconds
accuracy.
Add a type-widening rule in findTightestCommonType between DateType and
TimestampType.
## How was this patch tested?
Fix some tests to accord with an internationally agreed way to represent
dates.
Add an end-to-end test case and unit tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sergey-rubtsov/spark master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21363.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21363
----
commit 65179a2bdd1623fb7f4077cdc316de5a7436c49d
Author: sergei.rubtcov <sergei.rubtcov@...>
Date: 2018-05-18T12:13:05Z
[SPARK-19228][SQL] Migrate on Java 8 time from FastDateFormat for meet the
ISO8601 and parsing dates in csv correctly. Add support for inferring DateType
and custom "dateFormat" option.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
