[
https://issues.apache.org/jira/browse/YARN-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432222#comment-15432222
]
Zhankun Tang commented on YARN-5428:
------------------------------------
Exposing the admin settings in this config file seems inappropriate. I suppose
this patch is mainly a prerequisite (credentials in it) for YARN-3854 to pull
the image from secured repository without feeding in credentials.
[~aw], if I remember correctly, a single overall config.json can contains all
user's credentials for all private repos. So I guess it will be ok that the
administrator copy this file to all nodes? This is why I made it an assumption
in proposal for YARN-3854 currently.
It seems that this patch can allow user to pass in customized config.json
already, using command "yarn jar app.jar
-Dyarn.nodemanager.runtime.linux.docker.client-config-directory=/etc/docker"
should works. But the end user's config.json needs also be distributed to all
nodes (otherwise, image localization will fail). This file distribution mostly
will be done by administrator and become the same burden with a single overall
config.json mentioned above.
Since we are implementing all this together, we can also just pass credentials
content to Docker in new designed interface, this requires us to have the
content materialized in specific directory's config.json before image
localization happens. This needs more discussions.
Any ideas on passing in credentials content or a single overall config.json,
[[email protected]], [~templedf]?
> Allow for specifying the docker client configuration directory
> --------------------------------------------------------------
>
> Key: YARN-5428
> URL: https://issues.apache.org/jira/browse/YARN-5428
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: yarn
> Reporter: Shane Kumpf
> Assignee: Shane Kumpf
> Attachments: YARN-5428.001.patch, YARN-5428.002.patch,
> YARN-5428.003.patch, YARN-5428.004.patch
>
>
> The docker client allows for specifying a configuration directory that
> contains the docker client's configuration. It is common to store "docker
> login" credentials in this config, to avoid the need to docker login on each
> cluster member.
> By default the docker client config is $HOME/.docker/config.json on Linux.
> However, this does not work with the current container executor user
> switching and it may also be desirable to centralize this configuration
> beyond the single user's home directory.
> Note that the command line arg is for the configuration directory NOT the
> configuration file.
> This change will be needed to allow YARN to automatically pull images at
> localization time or within container executor.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
