[
https://issues.apache.org/jira/browse/YARN-5670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16797768#comment-16797768
]
Eric Yang commented on YARN-5670:
---------------------------------
[~csingh] If node manager is offline for whatever reason, it is possible that
some images tracking are lost from LRU and result in dangling images over time.
In production environment, it is best to automate as much as possible to keep
system running without manual intervention. I think option 2 will keep system
cleaner over long period of service. With proper deployment of Docker private
registry, there is no good reason to use local image as permanent storage of
docker images in production environment because populating local docker with
consistent images can be painful at scale. [~ebadger]'s team moved onto using
squashFS with runc, so his team does not depend on local docker to store
images. Hence, his opinion may change over time.
> Add support for Docker image clean up
> -------------------------------------
>
> Key: YARN-5670
> URL: https://issues.apache.org/jira/browse/YARN-5670
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: yarn
> Reporter: Zhankun Tang
> Assignee: Eric Yang
> Priority: Major
> Labels: Docker
> Attachments: Localization Support For Docker Images_002.pdf
>
>
> Regarding to Docker image localization, we also need a way to clean up the
> old/stale Docker image to save storage space. We may extend deletion service
> to utilize "docker rm" to do this.
> This is related to YARN-3854 and may depend on its implementation. Please
> refer to YARN-3854 for Docker image localization details.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
