Hi
I have compiled OpenBlas library into nonstandard directory and I want to
inform Spark app about it via:
-Dcom.github.fommil.netlib.NativeSystemBLAS.natives=/usr/local/lib/libopenblas.so


I tried 2 ways:
1. via --conf parameter
bin/spark-submit -v  --class
org.apache.spark.examples.mllib.LinearRegression --conf
"-Dcom.github.fommil.netlib.NativeSystemBLAS.natives=/usr/local/lib/libopenblas.so"
examples/target/scala-2.10/spark-examples-1.3.0-SNAPSHOT-hadoop1.0.4.jar
data/mllib/sample_libsvm_data.txt

2. via --driver-java-options parameter
bin/spark-submit -v --driver-java-options
"-Dcom.github.fommil.netlib.NativeSystemBLAS.natives=/usr/local/lib/libopenblas.so"
--class org.apache.spark.examples.mllib.LinearRegression
examples/target/scala-2.10/spark-examples-1.3.0-SNAPSHOT-hadoop1.0.4.jar
data/mllib/sample_libsvm_data.txt

How can I force spark-submit to propagate info about non-standard placement
to netlob-java lib?

-Dcom.github.fommil.netlib.NativeSystemBLAS.natives=/usr/local is standard
option in netlib-java (https://github.com/fommil/netlib-java)


thanks, Tomas

Reply via email to