[ 
https://issues.apache.org/jira/browse/YARN-8643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Eric Yang updated YARN-8643:
----------------------------
    Description: 
This JIRA is forking an idea proposed in YARN-3854 to manage trusted docker 
images on HDFS.  YARN-3854 is going to focus on rearranging the node manager 
and container-executor logic to download docker image during file localization 
phase for better error handling and reporting.  The new proposal is to create a 
docker container which host Docker registry and NFS gateway, and configure 
docker images to store on HDFS.  The docker container can run in YARN framework 
to serve as privileged or trusted registries.

HDFS_Docker_registry_design.png describes the components required to create a 
docker image that can store docker images on HDFS.

Deploy_HDFS_Docker_registry_workflow.png describes the operation to perform to 
setup a trusted docker registry that write to HDFS.

  was:This JIRA is forking an idea proposed in YARN-3854 to manage trusted 
docker images on HDFS.  YARN-3854 is going to focus on rearranging the node 
manager and container-executor logic to download docker image during file 
localization phase for better error handling and reporting.  The new proposal 
is to create a docker container which host Docker registry and NFS gateway, and 
configure docker images to store on HDFS.  The docker container can run in YARN 
framework to serve as privileged or trusted registries.


> Docker image life cycle management on HDFS
> ------------------------------------------
>
>                 Key: YARN-8643
>                 URL: https://issues.apache.org/jira/browse/YARN-8643
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: yarn
>            Reporter: Eric Yang
>            Priority: Major
>              Labels: Docker
>         Attachments: Deploy_HDFS_Docker_registry_workflow.png, 
> HDFS_Docker_registry_design.png
>
>
> This JIRA is forking an idea proposed in YARN-3854 to manage trusted docker 
> images on HDFS.  YARN-3854 is going to focus on rearranging the node manager 
> and container-executor logic to download docker image during file 
> localization phase for better error handling and reporting.  The new proposal 
> is to create a docker container which host Docker registry and NFS gateway, 
> and configure docker images to store on HDFS.  The docker container can run 
> in YARN framework to serve as privileged or trusted registries.
> HDFS_Docker_registry_design.png describes the components required to create a 
> docker image that can store docker images on HDFS.
> Deploy_HDFS_Docker_registry_workflow.png describes the operation to perform 
> to setup a trusted docker registry that write to HDFS.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to