groot created YARN-11255:
----------------------------
Summary: Support loading alternative docker client config from
system environment
Key: YARN-11255
URL: https://issues.apache.org/jira/browse/YARN-11255
Project: Hadoop YARN
Issue Type: New Feature
Reporter: groot
Assignee: groot
When using YARN docker support, although the hadoop shell supported
{code:java}
-docker_client_config{code}
to pass the client config file that contains security token to generate the
docker config for each job as a temporary file.
For other applications that submit jobs to YARN, e.g. Spark, which loads the
docker setting via system environment e.g.
{code:java}
spark.executorEnv.* {code}
will not be able to add those authorization token because this system
environment isn't considered in YARN.
Add genetic solution to handle these kind of cases without making changes in
spark code or others
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
