Iulian Dragos created SPARK-12423:
-------------------------------------

             Summary: Mesos executor home should not be resolved on the 
driver's file system
                 Key: SPARK-12423
                 URL: https://issues.apache.org/jira/browse/SPARK-12423
             Project: Spark
          Issue Type: Bug
          Components: Mesos
    Affects Versions: 1.6.0
            Reporter: Iulian Dragos


{{spark.mesos.executor.home}} should be an uninterpreted string. It is very 
possible that this path does not exist on the driver, and if it does, it may be 
a symlink that should not be resolved. Currently, this leads to failures in 
client mode.

For example, setting it to {{/var/spark/spark-1.6.0-bin-hadoop2.6/}} leads to 
executors failing:

{code}
sh: 1: /private/var/spark/spark-1.6.0-bin-hadoop2.6/bin/spark-class: not found
{code}

{{getCanonicalPath}} transforms {{/var/spark...}} into {{/private/var..}} 
because on my system there is a symlink from one to the other.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to