[
https://issues.apache.org/jira/browse/YARN-1503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jian He updated YARN-1503:
--------------------------
Description:
We have a use case, where additional resources (jars, libraries etc) need to be
made available to an already running container. Ideally, we'd like this to be
done via YARN (instead of having potentially multiple containers per node
download resources on their own).
The goal is to enable NodeManagers to localize resources while container is
running. Today, resource-localization is always the first step before starting
a container. It will be useful if YARN can localize the resources continuously
even while container is running.
was:
We have a use case, where additional resources (jars, libraries etc) need to be
made available to an already running container. Ideally, we'd like this to be
done via YARN (instead of having potentially multiple containers per node
download resources on their own).
Proposal:
NM to support an additional API where a list of resources can be specified.
Something like "localiceResource(ContainerId, Map<String, LocalResource>)
NM would also require an additional API to get state for these resources -
"getLocalizationState(ContainerId)" - which returns the current state of all
local resources for the specified container(s).
> Continuous resource-localization for YARN containers
> ----------------------------------------------------
>
> Key: YARN-1503
> URL: https://issues.apache.org/jira/browse/YARN-1503
> Project: Hadoop YARN
> Issue Type: Improvement
> Reporter: Siddharth Seth
> Assignee: Jian He
> Attachments: Continuous-resource-localization.pdf
>
>
> We have a use case, where additional resources (jars, libraries etc) need to
> be made available to an already running container. Ideally, we'd like this to
> be done via YARN (instead of having potentially multiple containers per node
> download resources on their own).
> The goal is to enable NodeManagers to localize resources while container is
> running. Today, resource-localization is always the first step before
> starting a container. It will be useful if YARN can localize the resources
> continuously even while container is running.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
