Thanks for point me to the MLlib guide. I was looking at only README and Spark docs.
Also found it's already filed in JIRA https://spark-project.atlassian.net/browse/SPARK-797 On Wed, Jul 9, 2014 at 7:45 PM, Xiangrui Meng <men...@gmail.com> wrote: > It is documented in the official doc: > http://spark.apache.org/docs/latest/mllib-guide.html > > On Wed, Jul 9, 2014 at 7:35 PM, Taka Shinagawa <taka.epsi...@gmail.com> > wrote: > > Hi, > > > > After testing Spark 1.0.1-RC2 on EC2 instances from the standard Ubuntu > and > > Amazon Linux AMIs, > > I've noticed the MLlib's dependancy on gfortran library > (libgfortran.so.3). > > > > "sbt assembly" succeeds without this library installed, but "sbt test" > > fails as follows. > > > > I'm wondering if documenting this dependency in README and online doc > might > > a good idea. > > > > ------------- > > [info] ALSSuite: > > -- org.jblas ERROR Couldn't load copied link file: > > java.lang.UnsatisfiedLinkError: > > /tmp/jblas8312335435391185287libjblas_arch_flavor.so: libgfortran.so.3: > > cannot open shared object file: No such file or directory. > > > > On Linux 64bit, you need additional support libraries. > > You need to install libgfortran3. > > > > For example for debian or Ubuntu, type "sudo apt-get install > libgfortran3" > > > > For more information, see > > https://github.com/mikiobraun/jblas/wiki/Missing-Libraries > > [info] Exception encountered when attempting to run a suite with class > > name: org.apache.spark.mllib.recommendation.ALSSuite *** ABORTED *** > > [info] java.lang.UnsatisfiedLinkError: > > org.jblas.NativeBlas.dgemm(CCIIID[DII[DIID[DII)V > > [info] at org.jblas.NativeBlas.dgemm(Native Method) > > [info] at org.jblas.SimpleBlas.gemm(SimpleBlas.java:251) > > [info] at org.jblas.DoubleMatrix.mmuli(DoubleMatrix.java:1697) > > [info] at org.jblas.DoubleMatrix.mmul(DoubleMatrix.java:3054) > > [info] at > > > org.apache.spark.mllib.recommendation.ALSSuite$.generateRatings(ALSSuite.scala:67) > > [info] at > > > org.apache.spark.mllib.recommendation.ALSSuite.testALS(ALSSuite.scala:167) > > [info] at > > > org.apache.spark.mllib.recommendation.ALSSuite$$anonfun$3.apply$mcV$sp(ALSSuite.scala:83) > > [info] at > > > org.apache.spark.mllib.recommendation.ALSSuite$$anonfun$3.apply(ALSSuite.scala:83) > > [info] at > > > org.apache.spark.mllib.recommendation.ALSSuite$$anonfun$3.apply(ALSSuite.scala:83) > > [info] at > > org.scalatest.Transformer$$anonfun$apply$1.apply(Transformer.scala:22) > > [info] ... > > > > ------------- >