[
https://issues.apache.org/jira/browse/YARN-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15475856#comment-15475856
]
Allen Wittenauer commented on YARN-5428:
----------------------------------------
I'm a little disturbed by how the architecture is pretty much dedicated to
talking about directories rather than configuration objects. I think that's
sort of building an architecture for a predetermined solution rather than
actually thinking about the problem at hand.
Let's say, that an admin level solution is picked. The code could copy from
HADOOP_CONF_DIR/docker (which would be hard-coded) on each node into the
localized directory then just pass --config to the docker commands. This
eliminates the need for a pretty useless configuration entry. It also means
that in the future once it gets fixed to actually do merges, the only code
change is going to be the merge.
bq. Puts the burden on all frameworks that leverage YARN to supply the client
configuration.
I don't think this is necessarily true. If the client configuration is passed
as a YARN configuration setting during job submission, it effectively becomes
part of the YARN protocol itself just like other YARN configuration settings.
Frameworks already have to handle configs.
> Allow for specifying the docker client configuration directory
> --------------------------------------------------------------
>
> Key: YARN-5428
> URL: https://issues.apache.org/jira/browse/YARN-5428
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: yarn
> Reporter: Shane Kumpf
> Assignee: Shane Kumpf
> Attachments: YARN-5428.001.patch, YARN-5428.002.patch,
> YARN-5428.003.patch, YARN-5428.004.patch,
> YARN-5428Allowforspecifyingthedockerclientconfigurationdirectory.pdf
>
>
> The docker client allows for specifying a configuration directory that
> contains the docker client's configuration. It is common to store "docker
> login" credentials in this config, to avoid the need to docker login on each
> cluster member.
> By default the docker client config is $HOME/.docker/config.json on Linux.
> However, this does not work with the current container executor user
> switching and it may also be desirable to centralize this configuration
> beyond the single user's home directory.
> Note that the command line arg is for the configuration directory NOT the
> configuration file.
> This change will be needed to allow YARN to automatically pull images at
> localization time or within container executor.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
