Hi, After testing Spark 1.0.1-RC2 on EC2 instances from the standard Ubuntu and Amazon Linux AMIs, I've noticed the MLlib's dependancy on gfortran library (libgfortran.so.3).
"sbt assembly" succeeds without this library installed, but "sbt test" fails as follows. I'm wondering if documenting this dependency in README and online doc might a good idea. ------------- [info] ALSSuite: -- org.jblas ERROR Couldn't load copied link file: java.lang.UnsatisfiedLinkError: /tmp/jblas8312335435391185287libjblas_arch_flavor.so: libgfortran.so.3: cannot open shared object file: No such file or directory. On Linux 64bit, you need additional support libraries. You need to install libgfortran3. For example for debian or Ubuntu, type "sudo apt-get install libgfortran3" For more information, see https://github.com/mikiobraun/jblas/wiki/Missing-Libraries [info] Exception encountered when attempting to run a suite with class name: org.apache.spark.mllib.recommendation.ALSSuite *** ABORTED *** [info] java.lang.UnsatisfiedLinkError: org.jblas.NativeBlas.dgemm(CCIIID[DII[DIID[DII)V [info] at org.jblas.NativeBlas.dgemm(Native Method) [info] at org.jblas.SimpleBlas.gemm(SimpleBlas.java:251) [info] at org.jblas.DoubleMatrix.mmuli(DoubleMatrix.java:1697) [info] at org.jblas.DoubleMatrix.mmul(DoubleMatrix.java:3054) [info] at org.apache.spark.mllib.recommendation.ALSSuite$.generateRatings(ALSSuite.scala:67) [info] at org.apache.spark.mllib.recommendation.ALSSuite.testALS(ALSSuite.scala:167) [info] at org.apache.spark.mllib.recommendation.ALSSuite$$anonfun$3.apply$mcV$sp(ALSSuite.scala:83) [info] at org.apache.spark.mllib.recommendation.ALSSuite$$anonfun$3.apply(ALSSuite.scala:83) [info] at org.apache.spark.mllib.recommendation.ALSSuite$$anonfun$3.apply(ALSSuite.scala:83) [info] at org.scalatest.Transformer$$anonfun$apply$1.apply(Transformer.scala:22) [info] ... -------------