[
https://issues.apache.org/jira/browse/YARN-5670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809338#comment-16809338
]
Eric Yang commented on YARN-5670:
---------------------------------
In today's YARN Docker meeting, there is consensus on using Node Manager track
LRU by digest ID, and apply mark and sweep algorithm to prune images seem by
node manager. Open concern is still around corner case where locally tagged
system admin images can get deleted when the same image is used by a job.
Kubernetes tackles docker image pruning problem by making assumption that
[system not require human operators to work
reliably|https://thenewstack.io/deletion-garbage-collection-kubernetes-objects/].
I think this is a safe assumption, and wait for [[email protected]] and
[~ebadger] to process this information.
> Add support for Docker image clean up
> -------------------------------------
>
> Key: YARN-5670
> URL: https://issues.apache.org/jira/browse/YARN-5670
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: yarn
> Reporter: Zhankun Tang
> Priority: Major
> Labels: Docker
> Attachments: Localization Support For Docker Images_002.pdf
>
>
> Regarding to Docker image localization, we also need a way to clean up the
> old/stale Docker image to save storage space. We may extend deletion service
> to utilize "docker rm" to do this.
> This is related to YARN-3854 and may depend on its implementation. Please
> refer to YARN-3854 for Docker image localization details.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
