[
https://issues.apache.org/jira/browse/SPARK-21331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077605#comment-16077605
]
Yan Facai (颜发才) edited comment on SPARK-21331 at 7/7/17 5:21 AM:
-----------------------------------------------------------------
Hi, I run the code in description on mac, spark-2.1.1. It works out
successfully without any exception.
{code}
scala> val svd: SingularValueDecomposition[RowMatrix, Matrix] =
mat.computeSVD(2, computeU = true)
17/07/07 13:17:12 WARN netlib.BLAS: Failed to load implementation from:
com.github.fommil.netlib.NativeSystemBLAS
17/07/07 13:17:12 WARN netlib.BLAS: Failed to load implementation from:
com.github.fommil.netlib.NativeRefBLAS
17/07/07 13:17:12 WARN netlib.LAPACK: Failed to load implementation from:
com.github.fommil.netlib.NativeSystemLAPACK
17/07/07 13:17:12 WARN netlib.LAPACK: Failed to load implementation from:
com.github.fommil.netlib.NativeRefLAPACK
svd:
org.apache.spark.mllib.linalg.SingularValueDecomposition[org.apache.spark.mllib.linalg.distributed.RowMatrix,org.apache.spark.mllib.linalg.Matrix]
=
SingularValueDecomposition(org.apache.spark.mllib.linalg.distributed.RowMatrix@5a4f7911,[13.029275535600473,5.368578733451684],-0.31278534337232633
0.3116713569157832
-0.029801450130953977 -0.17133211263608739
-0.12207248163673157 0.15256470925290191
-0.7184789931874109 -0.6809628499946365
-0.6084105917199364 0.6217072292290715 )
{code}
was (Author: facai):
Hi, I run the code in description on mac, spark-2.1.1. It works out
successfully without any exception.
{block}
scala> val svd: SingularValueDecomposition[RowMatrix, Matrix] =
mat.computeSVD(2, computeU = true)
17/07/07 13:17:12 WARN netlib.BLAS: Failed to load implementation from:
com.github.fommil.netlib.NativeSystemBLAS
17/07/07 13:17:12 WARN netlib.BLAS: Failed to load implementation from:
com.github.fommil.netlib.NativeRefBLAS
17/07/07 13:17:12 WARN netlib.LAPACK: Failed to load implementation from:
com.github.fommil.netlib.NativeSystemLAPACK
17/07/07 13:17:12 WARN netlib.LAPACK: Failed to load implementation from:
com.github.fommil.netlib.NativeRefLAPACK
svd:
org.apache.spark.mllib.linalg.SingularValueDecomposition[org.apache.spark.mllib.linalg.distributed.RowMatrix,org.apache.spark.mllib.linalg.Matrix]
=
SingularValueDecomposition(org.apache.spark.mllib.linalg.distributed.RowMatrix@5a4f7911,[13.029275535600473,5.368578733451684],-0.31278534337232633
0.3116713569157832
-0.029801450130953977 -0.17133211263608739
-0.12207248163673157 0.15256470925290191
-0.7184789931874109 -0.6809628499946365
-0.6084105917199364 0.6217072292290715 )
{block}
> java.lang.NullPointerException for certain methods in classes of MLlib
> ----------------------------------------------------------------------
>
> Key: SPARK-21331
> URL: https://issues.apache.org/jira/browse/SPARK-21331
> Project: Spark
> Issue Type: Bug
> Components: Build, MLlib
> Affects Versions: 2.1.0
> Environment: Spark running locally on OSX at spark://127.0.0.1:7077.
> Reporter: Anirban Das
>
> I am trying to run the following code using sbt package and sbt run. I am
> getting a runtime error that seems to be a bug since the same code works
> great on spark-shell with Scala. The error occurs when executing the
> computeSVD line. If this line is commented out, the program works fine. I am
> having similar issues for other methods for classes in MLlib as well. This
> looks like a bug to me.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
