spark with breeze error of NoClassDefFoundError

[Jack Yang]

Hi all,
I am using spark 1.4.0, and building my codes using maven.
So in one of my scala, I used:

import breeze.linalg._
val v1 = new breeze.linalg.SparseVector(commonVector.indices, 
commonVector.values, commonVector.size)
val v2 = new breeze.linalg.SparseVector(commonVector2.indices, 
commonVector2.values, commonVector2.size)
println (v1.dot(v2) / (norm(v1) * norm(v2)) )



in my pom.xml file, I used:
<dependency>
                                             <groupId>org.scalanlp</groupId>
                                             
<artifactId>breeze-math_2.10</artifactId>
                                             <version>0.4</version>
                                             <scope>provided</scope>
                              </dependency>

                              <dependency>
                                             <groupId>org.scalanlp</groupId>
                                             
<artifactId>breeze_2.10</artifactId>
                                             <version>0.11.2</version>
                                             <scope>provided</scope>
                              </dependency>


When submit, I included breeze jars (breeze_2.10-0.11.2.jar 
breeze-math_2.10-0.4.jar breeze-natives_2.10-0.11.2.jar 
breeze-process_2.10-0.3.jar) using "--jar" arguments, although I doubt it is 
necessary to do that.

however, the error is

Exception in thread "main" java.lang.NoClassDefFoundError: 
breeze/storage/DefaultArrayValue

Any thoughts?



Best regards,
Jack