GitHub user mengxr opened a pull request:
https://github.com/apache/spark/pull/3023
[SPARK-4121] Set commons-math3 version based on hadoop profiles, instead of
shading
In #2928 , we shade commons-math3 to prevent future conflicts with hadoop.
It caused problems with our Jenkins master build with maven. Some tests used
local-cluster mode, where the assembly jar contains relocated math3 classes,
while mllib test code still compiles with core and the untouched math3 classes.
This PR sets commons-math3 version based on hadoop profiles.
@pwendell @JoshRosen @srowen
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mengxr/spark SPARK-4121-alt
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/3023.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3023
----
commit b4180dceaa0e61b83122ce591c422f2e29ed4870
Author: Xiangrui Meng <[email protected]>
Date: 2014-10-30T17:18:56Z
temp work
commit d3353d95f68fb47a1968e9f138d310bc0b7e6fc0
Author: Xiangrui Meng <[email protected]>
Date: 2014-10-30T18:48:11Z
do not shade commons-math3
commit 7f71f086dfde656ed28c5609212d91f1ed74abaf
Author: Xiangrui Meng <[email protected]>
Date: 2014-10-30T19:42:47Z
revert changes to PoissonSampler to avoid conflicts
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
