Attila Zsolt Piros created HADOOP-16550:
-------------------------------------------
Summary: Wrong Spark config name on the "Launching Applications
Using Docker Containers" page
Key: HADOOP-16550
URL: https://issues.apache.org/jira/browse/HADOOP-16550
Project: Hadoop Common
Issue Type: Bug
Components: documentation
Affects Versions: 3.1.2, 2.8.5, 3.0.3, 2.9.2, 3.1.1, 3.0.2, 2.8.4, 3.0.1,
2.9.1, 3.1.0, 3.0.0, 2.8.3, 2.8.2, 2.9.0
Reporter: Attila Zsolt Piros
On the "Launching Applications Using Docker Containers" page at the "Example:
Spark" section the Spark config for configuring the environment variables for
the application master the config prefix are wrong:
-
spark.yarn.{color:#DE350B}*A*{color}ppMasterEnv.YARN_CONTAINER_RUNTIME_DOCKER_IMAGE
- park.yarn.{color:#DE350B}*A*{color}ppMasterEnv.YARN_CONTAINER_RUNTIME_TYPE
The correct ones:
- spark.yarn.appMasterEnv.YARN_CONTAINER_RUNTIME_DOCKER_IMAGE
- spark.yarn.appMasterEnv.YARN_CONTAINER_RUNTIME_TYPE
See https://spark.apache.org/docs/2.4.0/running-on-yarn.html:
{quote}
spark.yarn.appMasterEnv.[EnvironmentVariableName]
{quote}
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
