We removed commons-math3 from dependencies to avoid version conflict
with hadoop-common. hadoop-common-2.3+ depends on commons-math3-3.1.1,
while breeze depends on commons-math3-3.3. 3.3 is not backward
compatible with 3.1.1. So we removed it because the breeze functions
we use do not touch commons
I solve the problem by including the commons-math3 package in my sbt
dependencies as Sean suggested. Thanks.
On Fri, Sep 26, 2014 at 6:05 PM, Ted Yu wrote:
> You can use scope of runtime.
>
> See
> http://maven.apache.org/guides/introduction/introduction-to-dependency-mechanism.html#Dependency_S
You can use scope of runtime.
See
http://maven.apache.org/guides/introduction/introduction-to-dependency-mechanism.html#Dependency_Scope
Cheers
On Fri, Sep 26, 2014 at 8:57 AM, Jaonary Rabarisoa
wrote:
> Thank Ted. Can you tell me how to adjust the scope ?
>
> On Fri, Sep 26, 2014 at 5:47 PM,
Shouldn't the user's application depend on commons-math3 if it uses
it? it shouldn't require a Spark change. Maybe I misunderstand.
On Fri, Sep 26, 2014 at 4:47 PM, Ted Yu wrote:
> spark-core's dependency on commons-math3 is @ test scope (core/pom.xml):
>
> org.apache.commons
> c
Thank Ted. Can you tell me how to adjust the scope ?
On Fri, Sep 26, 2014 at 5:47 PM, Ted Yu wrote:
> spark-core's dependency on commons-math3 is @ test scope (core/pom.xml):
>
> org.apache.commons
> commons-math3
> 3.3
> test
>
>
> Adjusting the scope should so
spark-core's dependency on commons-math3 is @ test scope (core/pom.xml):
org.apache.commons
commons-math3
3.3
test
Adjusting the scope should solve the problem below.
On Fri, Sep 26, 2014 at 8:42 AM, Jaonary Rabarisoa
wrote:
> Hi all,
>
> I'm using some functio
