XianXianwang created SPARK-50271:
------------------------------------
Summary: Spark App executes unintended commands
Key: SPARK-50271
URL: https://issues.apache.org/jira/browse/SPARK-50271
Project: Spark
Issue Type: Improvement
Components: YARN
Affects Versions: 3.5.3
Reporter: XianXianwang
Spark commits a task and Yarn executes the command directly using bash -c, if
the commit contains ``` it will execute the statement directly, this has some
impact on Yarn, does Saprk need to intercept this case
hadoop ContainerExecutor.java
{code:java}
ContainerLaunch.ShellScriptBuilder sb =
ContainerLaunch.ShellScriptBuilder.create();
...
sb.command(command);
PrintStream pout = null;
try {
pout = new PrintStream(out, false, "UTF-8");
sb.write(pout);
} finally {
if (out != null) {
out.close();
}
}{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
