[
https://issues.apache.org/jira/browse/YARN-9014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010976#comment-17010976
]
Eric Badger commented on YARN-9014:
-----------------------------------
[~brahmareddy], there are still pending JIRAs that will not be fixed in time
for the 3.3.0 release. However, I would like to keep everything under this
umbrella as it makes things easier to find and keep track of. The main
RuncContainerRuntime feature has been implemented and committed via YARN-9560,
YARN-9561, YARN-9562, and YARN-9884. The pending JIRAs are for extended
functionality to bring some functionality over from
DockerLinuxContainerRuntime. However, these JIRAs are not required for the
initial use case of just running Hadoop jobs inside of runC containers.
> runC container runtime
> ----------------------
>
> Key: YARN-9014
> URL: https://issues.apache.org/jira/browse/YARN-9014
> Project: Hadoop YARN
> Issue Type: New Feature
> Reporter: Jason Darrell Lowe
> Assignee: Eric Badger
> Priority: Major
> Labels: Docker
> Attachments: OciSquashfsRuntime.v001.pdf,
> RuncContainerRuntime.v002.pdf
>
>
> This JIRA tracks a YARN container runtime that supports running containers in
> images built by Docker but the runtime does not use Docker directly, and
> Docker does not have to be installed on the nodes. The runtime leverages the
> [OCI runtime standard|https://github.com/opencontainers/runtime-spec] to
> launch containers, so an OCI-compliant runtime like {{runc}} is required.
> {{runc}} has the benefit of not requiring a daemon like {{dockerd}} to be
> running in order to launch/control containers.
> The layers comprising the Docker image are uploaded to HDFS as
> [squashfs|http://tldp.org/HOWTO/SquashFS-HOWTO/whatis.html] images, enabling
> the runtime to efficiently download and execute directly on the compressed
> layers. This saves image unpack time and space on the local disk. The image
> layers, like other entries in the YARN distributed cache, can be spread
> across the YARN local disks, increasing the available space for storing
> container images on each node.
> A design document will be posted shortly.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
