Luis Alves created SPARK-11759: ---------------------------------- Summary: Spark task on mesos with docker fails with sh: 1: /opt/spark/bin/spark-class: not found Key: SPARK-11759 URL: https://issues.apache.org/jira/browse/SPARK-11759 Project: Spark Issue Type: Question Reporter: Luis Alves
I'm using Spark 1.5.1 and Mesos 0.25 in cluster mode. I've the spark-dispatcher running, and run spark-submit. The driver is launched, but it fails because it seems that the task it launches fails. In the logs of the launched task I can see the following error: sh: 1: /opt/spark/bin/spark-class: not found I checked my docker image and the /opt/spark/bin/spark-class exists. I then noticed that it's using sh, therefore I tried to run (in the docker image) the following: sh /opt/spark/bin/spark-class org.apache.spark.deploy.master.Master It fails with the following error: spark-class: 73: spark-class: Syntax error: "(" unexpected Is this an error in Spark? Thanks -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org