Those are warning messages instead of errors. You need to add netlib-java:all to use native BLAS/LAPACK. But it won't work if you include netlib-java:all in an assembly jar. It has to be a separate jar when you submit your job. For SGD, we only use level-1 BLAS, so I don't think native code is called. -Xiangrui
On Sun, May 11, 2014 at 9:32 AM, DB Tsai <dbt...@stanford.edu> wrote: > Hi Debasish, > > In https://github.com/apache/spark/blob/master/docs/mllib-guide.md > Dependencies section, the document talks about the native blas dependencies > issue. > > For netlib which breeze uses internally, if the native library isn't found, > the jblas implementation will be used. > > Here is more detail about how to install native library in different > platform. > https://github.com/fommil/netlib-java/blob/master/README.md#machine-optimised-system-libraries > > > Sincerely, > > DB Tsai > ------------------------------------------------------- > My Blog: https://www.dbtsai.com > LinkedIn: https://www.linkedin.com/in/dbtsai > > > On Wed, May 7, 2014 at 10:52 AM, Debasish Das <debasish.da...@gmail.com> > wrote: >> >> Hi, >> >> How do I load native BLAS libraries on Mac ? >> >> I am getting the following errors while running LR and SVM with SGD: >> >> 14/05/07 10:48:13 WARN BLAS: Failed to load implementation from: >> com.github.fommil.netlib.NativeSystemBLAS >> >> 14/05/07 10:48:13 WARN BLAS: Failed to load implementation from: >> com.github.fommil.netlib.NativeRefBLAS >> >> centos it was fine...but on mac I am getting these warnings.. >> >> Also when it fails to run native blas does it use java code for BLAS >> operations ? >> >> May be after addition of breeze, we should add these details on a page as >> well so that users are aware of it before they report any performance >> results.. >> >> Thanks. >> >> Deb > >
