Github user ckadner commented on the pull request:
https://github.com/apache/spark/pull/6242#issuecomment-105704064
Sorry, it took me some time to get back.
Turns out Hive suffers from the same bug
([HIVE-10178](https://issues.apache.org/jira/browse/HIVE-10178)) which causes
the test cases based on `HiveComparisonTest` to fail. The Hive bug was fixed in
_Hive 1.2.0._ and the code (and fix) in Hive's `DateWritable.java` looks
remarkably similar to Spark's `DateUtils`.
@srowen, @davies, I need your guidance:
- how (and how often) do fixes in Hive get consumed by Spark?
- should we move on with this fix in Spark and tweak the
`HiveComparisonTest` to tolerate the discrepancy until Spark consumes Hive
1.2.0 (or another branch/version) that has the
[HIVE-10178](https://issues.apache.org/jira/browse/HIVE-10178) fix?
Thanks in advance!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
