[
https://issues.apache.org/jira/browse/YARN-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16567596#comment-16567596
]
Shane Kumpf commented on YARN-8619:
-----------------------------------
Thanks for the proposal, [~eyang]! I can see the value in making it easier to
admin container networking. However, I think we need to make this plugable
beyond Docker/macvlan, and I think we can do that with minimal changes to your
idea by adding a -type option or similar. One of the goals I'd like to see us
move towards is the adoption of prevailing standards, one of which is CNI,
which follows a different execution model than Docker's CNM/libnetwork and so
the macvlan options wouldn't apply. The -type option could lead to a CLI
similar to below:
Docker:
{code:java}
yarn network -create my-libnetwork-macvlan-net -type docker -conf
/tmp/network.json{code}
CNI:
{code:java}
yarn network -create my-cni-net -type cni -cni-config /tmp/cni.cfg -cni-plugin
/tmp/cni-plugin
{code}
As you mention, each host may need a different configuration. We may need a
-node option to target a specific nodemanager.
> Automate docker network configuration through YARN API
> ------------------------------------------------------
>
> Key: YARN-8619
> URL: https://issues.apache.org/jira/browse/YARN-8619
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: yarn-native-services
> Reporter: Eric Yang
> Priority: Major
> Labels: Docker
>
> Docker supports bridge, host, overlay, macvlan networking. It might be
> useful to automate docker network setup through a set of YARN API to improve
> management of docker networks. Each type of network driver requires
> different type of parameters. For Hadoop use case, it seems more useful to
> focus on macvlan networking for ease of use and configuration. It would be
> great addition to support commands like:
> {code}
> yarn network create -d macvlan \
> --subnet=172.16.86.0/24 \
> --gateway=172.16.86.1 \
> -o parent=eth0 \
> my-macvlan-net
> {code}
> This changes docker configuration to hosts managed by YARN.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
