Andrew Or created SPARK-2718:
--------------------------------
Summary: YARN does not handle spark configs with quotes or
backslashes
Key: SPARK-2718
URL: https://issues.apache.org/jira/browse/SPARK-2718
Project: Spark
Issue Type: Bug
Components: YARN
Affects Versions: 1.0.1
Reporter: Andrew Or
Fix For: 1.1.0
Say we have the following config:
{code}
spark.app.name spark shell with spaces and "quotes " and \ backslashes \
{code}
This works in standalone mode but not in YARN mode. This is because standalone
mode uses Java's ProcessBuilder, which handles these cases nicely, but YARN
mode uses org.apache.hadoop.yarn.api.records.ContainerLaunchContext.
--
This message was sent by Atlassian JIRA
(v6.2#6252)