GitHub user marmbrus opened a pull request:
https://github.com/apache/spark/pull/7814
[SPARK-8064] Build against Hive 1.2.1
This is just to test #7191 on jenkins now that I've done a hacky job of
publishing the custom version of Hive.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/marmbrus/spark pr/7191
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/7814.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #7814
----
commit 72c1c84cd5c28b49b029da68666617e5c2d2b7ba
Author: Steve Loughran <[email protected]>
Date: 2015-07-02T14:29:23Z
SPARK-8064, build against Hive 1.2.1
commit fae29945414729f35eac5586895927849eee5ab1
Author: Steve Loughran <[email protected]>
Date: 2015-07-15T17:31:09Z
SPARK-8064 thrift server switched to Hive 1.2.1, though it doesn't compile
everywhere
commit f61e1149c77ccbb6bd4b758ac7709d2be132a11a
Author: Steve Loughran <[email protected]>
Date: 2015-07-16T12:19:57Z
SPARK-8064 subclass Hive ServerOptionsProcessor to make it public again
commit 4d400f798a61fe4b73255cc731d3ee6059977bcd
Author: Steve Loughran <[email protected]>
Date: 2015-07-16T20:38:23Z
SPARK-8064 everything compiles with some commenting and moving of classes
into a hive package
commit 2d598dfacaf8b5d9d6acff98dc5de88fbf5d77bb
Author: Steve Loughran <[email protected]>
Date: 2015-07-17T14:19:09Z
SPARK-8054 cut pentaho dependency from calcite
commit 87104be7aec9e7c97083bcf30c9c0714ca3fd76c
Author: Steve Loughran <[email protected]>
Date: 2015-07-22T20:23:48Z
SPARK-8064 stop excluding hive shims from dependency (commented out , for
now)
commit 521f278dbea6889b41b92f18ed74b9866ced38bf
Author: Steve Loughran <[email protected]>
Date: 2015-07-22T20:24:10Z
SPARK-8064 fix some style & IDE warnings
commit e6d5bcd83d7a2667e72fa2128c5ca80fd32a405b
Author: Steve Loughran <[email protected]>
Date: 2015-07-22T20:47:56Z
SPARK-8064: SparkSQLCLIDriver drops remote mode support. CLISuite Tests
pass instead of timing out: undetected regression?
commit 79fc4845dbb1d3fee2decc9329f1224f118c58db
Author: Steve Loughran <[email protected]>
Date: 2015-07-22T21:43:10Z
SPARK-8064 move strings used to check for http/bin thrift services up into
constants
commit 3c58c712840f8b407176ef5fd96fdc175a080d84
Author: Steve Loughran <[email protected]>
Date: 2015-07-22T21:46:10Z
SPARK-8064 change thrift binary startup message to "Starting
ThriftBinaryCLIService on port"
commit f2737eef8d77b3a40363d690a353b789a52e271f
Author: Steve Loughran <[email protected]>
Date: 2015-07-23T18:18:19Z
SPARK-8064 (unsuccessful) attempt to get rid of pentaho as a transitive
dependency of hive-exec
commit e08ccbbe0cd5870137cc3e276680598f44c9adb7
Author: Steve Loughran <[email protected]>
Date: 2015-07-23T18:59:08Z
SPARK-8064 successful attempt to get rid of pentaho as a transitive
dependency of hive-exec
commit 2bd5157f7bf53eeafdf50d47b7eaa5ea041c06c7
Author: Steve Loughran <[email protected]>
Date: 2015-07-23T19:00:01Z
SPARK-8064 run-tests.py adds a hadoop-2.6 profile, and changes info
messages to say "w/Hive 1.2.1" in console output
commit 8fefe8f1bdfef49c96ef74a60230b099383b0176
Author: Steve Loughran <[email protected]>
Date: 2015-07-23T19:01:53Z
SPARK-8064: when a CLI suite test fails include the full output text in the
raised exception; this ensures that the stdout/stderr is included in jenkins
reports, so it becomes possible to diagnose the cause.
commit 29de0b010e943fb8f99b88290c52da7b84d349c1
Author: Steve Loughran <[email protected]>
Date: 2015-07-23T21:33:54Z
SPARK-8064: test resilience/assertion improvements. Independent of the rest
of the work; can be backported to earlier versions
commit d3b9f6a59a0f4bd00951fd04221f370230457e68
Author: Steve Loughran <[email protected]>
Date: 2015-07-23T21:34:53Z
SPARK-8064: name of unrecognized file format wasn't appearing in error text
commit 7822980b8e7a707fdf7813a8bb0b1c5d25bf75f3
Author: Steve Loughran <[email protected]>
Date: 2015-07-24T03:08:22Z
SPARK-8064: delicate merge in of the branch vanzin/hive-1.1
commit bf1bf6886f890b1808502e16acbec4d0491c428e
Author: Steve Loughran <[email protected]>
Date: 2015-07-24T16:39:55Z
SPARK-8064 improve diagns on uknown token; fix scalastyle failure
commit d17e817db692962970f05a59ab3f83625275ab2a
Author: Steve Loughran <[email protected]>
Date: 2015-07-24T17:12:33Z
SPARK-8064: HIVE-9039 renamed TOK_UNION => TOK_UNIONALL while adding
TOK_UNIONDISTINCT
commit df46b83248060195c3bbd910b69995601495f0d3
Author: Steve Loughran <[email protected]>
Date: 2015-07-24T17:19:50Z
SPARK-8064: DATE is now a predicate; you can't use it as a field in select
ops
commit db23fab7b8dded018d3af57194b482df74e2665c
Author: Steve Loughran <[email protected]>
Date: 2015-07-24T19:50:05Z
SPARK-8064 Hive compatibilty tests sin sync with explain/show output from
Hive 1.2.1
commit e957f1ce86b21cb9feefd80371b3ee9ab33c8a75
Author: Steve Loughran <[email protected]>
Date: 2015-07-24T21:52:49Z
SPARK-8064: thrift server startup to fail fast on any exception in the main
thread
commit da9ead6f1f0c2e820b99829ba3b2839bfae303e2
Author: Steve Loughran <[email protected]>
Date: 2015-07-24T21:53:12Z
SPARK-8064: reinstate yarn-rm-server dependencies to hive-exec to ensure
that jersey server is on classpath on hadoop versions < 2.6
commit efe21511409d8a42db6f679197781510450c5ead
Author: Steve Loughran <[email protected]>
Date: 2015-07-27T05:22:43Z
SPARK-8064: more resubmit than fix; tighten startup timeout to 60s. Still
no obvious reason why jersey server code in spark-assembly isn't being picked
up -it hasn't been shaded
commit eae54e593dcad6a666ca56ff6a5b3c90e13ca751
Author: Steve Loughran <[email protected]>
Date: 2015-07-27T17:36:08Z
SPARK-8064 TestHive to use sered2.thrift.test.Complex
commit 5797c2950e2b29e81cffea0f7cbd88f972de2533
Author: Steve Loughran <[email protected]>
Date: 2015-07-27T17:37:13Z
SPARK-8064 ParquetSuites to escape `date` field name
commit fa4031872155d7f2c3b58734f0a059a33b5ad32e
Author: Steve Loughran <[email protected]>
Date: 2015-07-27T18:01:12Z
SPARK-8064 wrap tests with withTable() calls to avoid table-exists
exceptions
commit aa455dc053e3132c6ab4cc14c27938293e1d7b1b
Author: Steve Loughran <[email protected]>
Date: 2015-07-27T20:57:10Z
SPARK-8064 missed one of the `date` escapes
commit c219f004cb27e0dd9accaa3730c91f7f3f280b2f
Author: Steve Loughran <[email protected]>
Date: 2015-07-27T20:57:42Z
SPARK-8064 rename field double to dbl
commit 5a77167b22b6fa21a00a3db747209cc6b53f80a7
Author: Steve Loughran <[email protected]>
Date: 2015-07-27T23:19:47Z
SPARK-8064 fail fast on thrive process spawning tests on exit codes and/or
error string patterns seen in log.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
