GitHub user srowen opened a pull request:
https://github.com/apache/spark/pull/3992
SPARK-5172 [BUILD] spark-examples-***.jar shades a wrong Hadoop distribution
In addition to the `hadoop-2.x` profiles in the parent POM, there is
actually another set of profiles in `examples` that has to be activated
differently to get the right Hadoop 1 vs 2 flavor of HBase. This wasn't
actually used in making Hadoop 2 distributions, hence the problem.
To reduce complexity, I suggest merging them with the parent POM profiles,
which is possible now.
You'll see this changes appears to update the HBase version, but actually,
the default 0.94 version was not being used. HBase is only used in examples,
and the examples POM always chose one profile or the other that updated the
version to 0.98.x anyway.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/srowen/spark SPARK-5172
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/3992.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3992
----
commit 17830d93fd84eda1ac05cf62cc5d22c61addcd78
Author: Sean Owen <[email protected]>
Date: 2015-01-11T20:05:10Z
Control hbase hadoop1/2 flavor in the parent POM with existing hadoop-2.x
profiles
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
