Andrew Or created SPARK-2718:
--------------------------------

             Summary: YARN does not handle spark configs with quotes or 
backslashes
                 Key: SPARK-2718
                 URL: https://issues.apache.org/jira/browse/SPARK-2718
             Project: Spark
          Issue Type: Bug
          Components: YARN
    Affects Versions: 1.0.1
            Reporter: Andrew Or
             Fix For: 1.1.0


Say we have the following config:
{code}
spark.app.name spark shell with spaces and "quotes " and \ backslashes \
{code}

This works in standalone mode but not in YARN mode. This is because standalone 
mode uses Java's ProcessBuilder, which handles these cases nicely, but YARN 
mode uses org.apache.hadoop.yarn.api.records.ContainerLaunchContext.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to