[
https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wangda Tan updated YARN-3926:
-----------------------------
Description:
Currently, there are efforts to add support for various resource-types such as
disk(YARN-2139), network(YARN-2140), and HDFS bandwidth(YARN-2681). These
efforts all aim to add support for a new resource type and are fairly involved
efforts. In addition, once support is added, it becomes harder for users to
specify the resources they need. All existing jobs have to be modified, or have
to use the minimum allocation.
This ticket is a proposal to extend the YARN resource model to a more flexible
model which makes it easier to support additional resource-types. It also
considers the related aspect of “resource profiles” which allow users to easily
specify the various resources they need for any given container.
{color:red}This feature is already merged to trunk, please go to YARN-7069 for
all pending items.{color}
was:
Currently, there are efforts to add support for various resource-types such as
disk(YARN-2139), network(YARN-2140), and HDFS bandwidth(YARN-2681). These
efforts all aim to add support for a new resource type and are fairly involved
efforts. In addition, once support is added, it becomes harder for users to
specify the resources they need. All existing jobs have to be modified, or have
to use the minimum allocation.
This ticket is a proposal to extend the YARN resource model to a more flexible
model which makes it easier to support additional resource-types. It also
considers the related aspect of “resource profiles” which allow users to easily
specify the various resources they need for any given container.
> Extend the YARN resource model for easier resource-type management and
> profiles
> -------------------------------------------------------------------------------
>
> Key: YARN-3926
> URL: https://issues.apache.org/jira/browse/YARN-3926
> Project: Hadoop YARN
> Issue Type: New Feature
> Components: nodemanager, resourcemanager
> Reporter: Varun Vasudev
> Assignee: Varun Vasudev
> Fix For: 3.1.0
>
> Attachments: Proposal for modifying resource model and profiles.pdf
>
>
> Currently, there are efforts to add support for various resource-types such
> as disk(YARN-2139), network(YARN-2140), and HDFS bandwidth(YARN-2681). These
> efforts all aim to add support for a new resource type and are fairly
> involved efforts. In addition, once support is added, it becomes harder for
> users to specify the resources they need. All existing jobs have to be
> modified, or have to use the minimum allocation.
> This ticket is a proposal to extend the YARN resource model to a more
> flexible model which makes it easier to support additional resource-types. It
> also considers the related aspect of “resource profiles” which allow users to
> easily specify the various resources they need for any given container.
> {color:red}This feature is already merged to trunk, please go to YARN-7069
> for all pending items.{color}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
