Github user marmbrus commented on the pull request:
https://github.com/apache/spark/pull/3013#issuecomment-61427879
Jenkins compiles with both versions just to make sure that we aren't
breaking backwards compatibility (Hive 12 first). Ideally, we'll set up
another job to run the test for Hive 12 in parallel or at least periodically,
but for now running both would take too much time.
In terms of semantics I think it is too much overhead to try to faithfully
mimic both versions since the primary goal here is metastore compatibility.
Thus, the query tests are based on Hive13 and the golden answers are too. It
is possible to run nearly of the tests with the Hive12 library too, though in
places we act like 13 even though we are compiling with the 12 library. In the
few cases where we can't run a given test with both versions of the library
there is a special blacklist in the shim.
Full Hive 13 decimal support is now merged, so hopefully we can remove all
the special cases from this PR.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
