Rectified the issue by providing the executor uri location in the input ./bin/spark-submit --master mesos://<ip-addr>:5050 --class org.apache.spark.examples.SparkPi --driver-java-options -Dspark.executor.uri=hdfs://<ip-addr>:9000/new/spark-1.0.0-hadoop-2.4.0.tgz /opt/spark-examples-1.0.0-hadoop2.4.0.jar 10
I am still not able to give the path of the jar in hdfs. This only seems to work for locally stored jars. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-submit-failing-on-cluster-tp8369p8378.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
