[
https://issues.apache.org/jira/browse/YARN-8765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16614610#comment-16614610
]
Weiwei Yang commented on YARN-8765:
-----------------------------------
Hi [~suma.shivaprasad]
Thanks for the comments. I can see there are 2 points,
1) Resource declare as a range
Resource layer everything must be specific, RANGE would be something hard to
achieve in this level. However, we can tentative achieve that in the upper
front. E.g at NM side, we can allow user to specify a range of IP addresses, NM
translate that into specific IP addresses and then report back to RM.
2) How such resource can be managed.
In the proposal, SET resource was managed by NM like rest of resources. But you
are raising up a point to have an central resource provider to manage them
(internally in RM or externally in a plugin).
#1 can be done as a instrument upon this proposal, #2 exceeds the scope here
but we can discuss that in a separate ticket.
What do you think?
> Extend YARN to support SET type of resources
> --------------------------------------------
>
> Key: YARN-8765
> URL: https://issues.apache.org/jira/browse/YARN-8765
> Project: Hadoop YARN
> Issue Type: New Feature
> Reporter: Weiwei Yang
> Priority: Major
>
> YARN-3926 evolves a new resource model in YARN by providing a general
> resource definition mechanism. However right now only COUNTABLE type is
> supported. To support resources that cannot be declared with a single value,
> propose to add a SET type. This will extend YARN to manage IP address
> resources. Design doc is attached
> [here|https://docs.google.com/document/d/1U9hj1xX9a3c_xT_X4EP_YC0fZ7ItD5X-rB0bYne-waU/edit?usp=sharing].
> This feature is split from YARN-8446.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
