GitHub user adrian-wang opened a pull request:
https://github.com/apache/spark/pull/3732
[SPARK-4508] [SQL] build native date type to conform behavior to Hive
Store daysSinceEpoch as an Int value(4 bytes) to represent DateType,
instead of using java.sql.Date(8 bytes as Long) in catalyst row. This ensures
the same comparison behavior of Hive and Catalyst.
Subsumes #3381
I thinks there are already some tests in JavaSQLSuite, and for python it
will not affect python's datetime class.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/adrian-wang/spark datenative
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/3732.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3732
----
commit b9fbdb53b36b7635e5d3bd6c73c4318665dfb41c
Author: Daoyuan Wang <[email protected]>
Date: 2014-11-20T05:02:52Z
spark native date type
commit 9110ef072bc1aaf4c43bf307ae4e438130863661
Author: Daoyuan Wang <[email protected]>
Date: 2014-11-20T07:17:26Z
api change
commit 2e167a4a8e71e6827d320106fa5727434100958c
Author: Daoyuan Wang <[email protected]>
Date: 2014-11-20T07:18:17Z
remove outdated files
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
