[
https://issues.apache.org/jira/browse/SPARK-19423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marco Biglieri updated SPARK-19423:
-----------------------------------
Priority: Minor (was: Major)
> Warning MLlib netlib
> --------------------
>
> Key: SPARK-19423
> URL: https://issues.apache.org/jira/browse/SPARK-19423
> Project: Spark
> Issue Type: Bug
> Components: MLlib
> Affects Versions: 2.0.1
> Reporter: Marco Biglieri
> Priority: Minor
>
> Hello,
> I have used the glm to create a linear regressio model but there is these
> warning messages:
> WARN BLAS: Failed to load implementation from:
> com.github.fommil.netlib.NativeSystemBLAS
> WARN BLAS: Failed to load implementation from:
> com.github.fommil.netlib.NativeRefBLAS
> WARN LAPACK: Failed to load implementation from:
> com.github.fommil.netlib.NativeSystemLAPACK
> WARN LAPACK: Failed to load implementation from:
> com.github.fommil.netlib.NativeRefLAPACK
> to solve this warnings i have added the dependencies in the
> spark-defaults.conf as described in mllib guide
> (https://spark.apache.org/docs/1.2.1/mllib-guide.html):
> spark.jars.packages=com.github.fommil.netlib:core:1.1.2
> but after i obtain a null pointer exception:
> The jars for the packages stored in: /root/.ivy2/jars
> :: loading settings :: url =
> jar:file:/home/user/spark-2.0.1-bin-hadoop2.7/jars/ivy-2.4.0.jar!/org/apache/ivy/core/settings/ivysettings.xml
> com.github.fommil.netlib#all added as a dependency
> :: resolving dependencies :: org.apache.spark#spark-submit-parent;1.0
> confs: [default]
> found com.github.fommil.netlib#all;1.1.2 in central
> found net.sourceforge.f2j#arpack_combined_all;0.1 in central
> found com.github.fommil.netlib#core;1.1.2 in central
> found com.github.fommil.netlib#netlib-native_ref-osx-x86_64;1.1 in
> central
> found com.github.fommil.netlib#native_ref-java;1.1 in central
> found com.github.fommil#jniloader;1.1 in central
> found com.github.fommil.netlib#netlib-native_ref-linux-x86_64;1.1 in
> central
> found com.github.fommil.netlib#netlib-native_ref-linux-i686;1.1 in
> central
> found com.github.fommil.netlib#netlib-native_ref-win-x86_64;1.1 in
> central
> found com.github.fommil.netlib#netlib-native_ref-win-i686;1.1 in central
> found com.github.fommil.netlib#netlib-native_ref-linux-armhf;1.1 in
> central
> found com.github.fommil.netlib#netlib-native_system-osx-x86_64;1.1 in
> central
> found com.github.fommil.netlib#native_system-java;1.1 in central
> found com.github.fommil.netlib#netlib-native_system-linux-x86_64;1.1 in
> central
> found com.github.fommil.netlib#netlib-native_system-linux-i686;1.1 in
> central
> found com.github.fommil.netlib#netlib-native_system-linux-armhf;1.1 in
> central
> found com.github.fommil.netlib#netlib-native_system-win-x86_64;1.1 in
> central
> found com.github.fommil.netlib#netlib-native_system-win-i686;1.1 in
> central
> :: resolution report :: resolve 1151ms :: artifacts dl 46ms
> :: modules in use:
> com.github.fommil#jniloader;1.1 from central in [default]
> com.github.fommil.netlib#all;1.1.2 from central in [default]
> com.github.fommil.netlib#core;1.1.2 from central in [default]
> com.github.fommil.netlib#native_ref-java;1.1 from central in [default]
> com.github.fommil.netlib#native_system-java;1.1 from central in
> [default]
> com.github.fommil.netlib#netlib-native_ref-linux-armhf;1.1 from central
> in [default]
> com.github.fommil.netlib#netlib-native_ref-linux-i686;1.1 from central
> in [default]
> com.github.fommil.netlib#netlib-native_ref-linux-x86_64;1.1 from
> central in [default]
> com.github.fommil.netlib#netlib-native_ref-osx-x86_64;1.1 from central
> in [default]
> com.github.fommil.netlib#netlib-native_ref-win-i686;1.1 from central in
> [default]
> com.github.fommil.netlib#netlib-native_ref-win-x86_64;1.1 from central
> in [default]
> com.github.fommil.netlib#netlib-native_system-linux-armhf;1.1 from
> central in [default]
> com.github.fommil.netlib#netlib-native_system-linux-i686;1.1 from
> central in [default]
> com.github.fommil.netlib#netlib-native_system-linux-x86_64;1.1 from
> central in [default]
> com.github.fommil.netlib#netlib-native_system-osx-x86_64;1.1 from
> central in [default]
> com.github.fommil.netlib#netlib-native_system-win-i686;1.1 from central
> in [default]
> com.github.fommil.netlib#netlib-native_system-win-x86_64;1.1 from
> central in [default]
> net.sourceforge.f2j#arpack_combined_all;0.1 from central in [default]
> :: evicted modules:
> com.github.fommil.netlib#core;1.1 by
> [com.github.fommil.netlib#core;1.1.2] in [default]
> ---------------------------------------------------------------------
> | | modules || artifacts |
> | conf | number| search|dwnlded|evicted|| number|dwnlded|
> ---------------------------------------------------------------------
> | default | 19 | 0 | 0 | 1 || 17 | 0 |
> ---------------------------------------------------------------------
> :: retrieving :: org.apache.spark#spark-submit-parent
> confs: [default]
> 0 artifacts copied, 17 already retrieved (0kB/46ms)
> Exception in thread "main" java.lang.NullPointerException
> at
> org.apache.spark.deploy.RPackageUtils$.checkManifestForR(RPackageUtils.scala:95)
> at
> org.apache.spark.deploy.RPackageUtils$$anonfun$checkAndBuildRPackage$1.apply(RPackageUtils.scala:179)
> at
> org.apache.spark.deploy.RPackageUtils$$anonfun$checkAndBuildRPackage$1.apply(RPackageUtils.scala:175)
> at
> scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
> at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186)
> at
> org.apache.spark.deploy.RPackageUtils$.checkAndBuildRPackage(RPackageUtils.scala:175)
> at
> org.apache.spark.deploy.SparkSubmit$.prepareSubmitEnvironment(SparkSubmit.scala:306)
> at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:158)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:124)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> Error in sparkR.sparkContext(master, appName, sparkHome, sparkConfigMap, :
> JVM is not ready after 10 seconds
> Calls: sparkR.session -> sparkR.sparkContext
> Seems there are problems with JVM,Anyoune knows how is possible solve this
> problem?
> Thanks
> Marco
> Fai clic qui per Rispondere
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
