Andrew Or created SPARK-2718: -------------------------------- Summary: YARN does not handle spark configs with quotes or backslashes Key: SPARK-2718 URL: https://issues.apache.org/jira/browse/SPARK-2718 Project: Spark Issue Type: Bug Components: YARN Affects Versions: 1.0.1 Reporter: Andrew Or Fix For: 1.1.0
Say we have the following config: {code} spark.app.name spark shell with spaces and "quotes " and \ backslashes \ {code} This works in standalone mode but not in YARN mode. This is because standalone mode uses Java's ProcessBuilder, which handles these cases nicely, but YARN mode uses org.apache.hadoop.yarn.api.records.ContainerLaunchContext. -- This message was sent by Atlassian JIRA (v6.2#6252)