[
https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308357#comment-16308357
]
Eric Yang edited comment on YARN-7677 at 1/2/18 4:54 PM:
---------------------------------------------------------
[~ebadger] Happy new year. I think it will be safer for {{HADOOP_CONF_DIR}} to
be passed from host to docker image as default. This is better for preventing
mistakes instead of allowing override system specific settings at container
level. This will also ensure that when an application requires system
settings, docker doesn't need to reconstruct the environment, but simply mount
the {{HADOOP_CONF_DIR}} as source of truth. If docker container wants to
generate its own environment, there shouldn't be anything getting in the way
for docker application to accomplish that. I don't understand how is this
paramount for docker case, could you elaborate? Thanks
was (Author: eyang):
[~ebadger] Happy new year. I think it will be safer for {HADOOP_CONF_DIR} to
be passed from host to docker image as default. This is better for preventing
mistakes instead of allowing override system specific settings at container
level. This will also ensure that when an application requires system
settings, docker doesn't need to reconstruct the environment, but simply mount
the {HADOOP_CONF_DIR} as source of truth. If docker container wants to
generate its own environment, there shouldn't be anything getting in the way
for docker application to accomplish that. I don't understand how is this
paramount for docker case, could you elaborate? Thanks
> HADOOP_CONF_DIR should not be automatically put in task environment
> -------------------------------------------------------------------
>
> Key: YARN-7677
> URL: https://issues.apache.org/jira/browse/YARN-7677
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: Eric Badger
> Assignee: Eric Badger
>
> Currently, {{HADOOP_CONF_DIR}} is being put into the task environment whether
> it's set by the user or not. It completely bypasses the whitelist and so
> there is no way for a task to not have {{HADOOP_CONF_DIR}} set. This causes
> problems in the Docker use case where Docker containers will set up their own
> environment and have their own {{HADOOP_CONF_DIR}} preset in the image
> itself.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
