This is the command I used to submit the job:
> >> >
> >> > ~/spark/spark-1.0.0-bin-hadoop2/bin/spark-submit \
> >> > --class com.jk.sparktest.Test \
> >> > --master yarn-cluster \
> >> > --num-executors 40 \
> >> > ~/sparktest-
gt; >
>> /apache/hadoop/share/hadoop/common/hadoop-common-2.2.0.2.0.6.0-61.jar:/apache/hadoop/lib/hadoop-lzo-0.6.0.jar::/home/jilei/spark/spark-1.0.0-bin-hadoop2/conf:/home/jilei/spark/spark-1.0.0-bin-hadoop2/lib/spark-assembly-1.0.0-hado
Thanks. I tried this option, but still got the same error.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Could-not-load-native-gpl-library-tp11743p11791.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
oop2/lib/datanucleus-rdbms-3.2.1.jar:/home/jilei/spark/spark-1.0.0-bin-hadoop2/lib/datanucleus-core-3.2.2.jar:/home/jilei/spark/spark-1.0.0-bin-hadoop2/lib/datanucleus-api-jdo-3.2.1.jar:/apache/hadoop/conf:/apache/hadoop/conf
> > \
> > -XX:MaxPermSize=128m \
> > -Djava.library.path=
>
gt; ~/sparktest-0.0.1-SNAPSHOT-jar-with-dependencies.jar
>
>
> Seems the -Djava.library.path is not set. I also tried the java command
> above and supplied the native lib directory to the java.library.path, but
> still got the same errors.
>
> Any idea on what's wrong? Thanks.
>
>
>
e.com/Spark-Could-not-load-native-gpl-library-tp11743.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: u
