GitHub user andrewor14 opened a pull request:
https://github.com/apache/spark/pull/660
[Spark-1735] Add the missing special profiles to make-distribution.sh
73b0cbcc241cca3d318ff74340e80b02f884acbd introduced a few special profiles
that are not covered in the `make-distribution.sh`. This affects hadoop
versions 2.2.x, 2.3.x, and 2.4.x. Without these special profiles, a java
version error for protobufs is thrown at run time.
I took the opportunity to rewrite the way we build the maven command.
Previously, the only hadoop version that triggered the `yarn-alpha` profile was
0.23.x, which was not consistent with the
[docs](https://github.com/apache/spark/blob/master/docs/building-with-maven.md).
This is now generalized to hadoop versions from 0.23.x to 2.1.x.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/andrewor14/spark hadoop-distribution
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/660.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #660
----
commit 88f192dc1c44a8ae166cf6637e905c92b9ad5210
Author: Andrew Or <[email protected]>
Date: 2014-05-06T03:33:22Z
Add the required special profiles to make-distribution.sh
commit 07507b4bddbc7a372ade27bc90e9ad1f8de101a5
Author: Andrew Or <[email protected]>
Date: 2014-05-06T03:42:44Z
Generalize hadoop versions that trigger the "yarn" profile
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
