[
https://issues.apache.org/jira/browse/YARN-1708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13990240#comment-13990240
]
Carlo Curino commented on YARN-1708:
------------------------------------
The attached patch represents a proposal for an extension of YARN's APIs.
This is the externally visible portion of the the umbrella JIRA YARN-1051,
and provides users with the opportunity to create/update/deleted time varying
resource reservations within a queue (if the queue allows it).
Reservations are expressed leveraging existing ResourceRequest objects
and extending them with temporal semantics (e.g., I need 1h of 20 containers
of size <2GB,1vcore> some time between 2pm and 6pm). We allow also to express
minimum concurrency constraints, and dependencies among different stages of
a pipeline.
The reservationID token obtained by the user during the reservation process
is passed during application submission, and instructs the RM to use the
reserved resources to satisfy this application needs.
The patch posted here is not submitted, since it depends on many other patches
part of the umbrella JIRA, the separation is designed only for ease of
reviewing.
A more broad discussion of this idea, and some experimental results are
provided in
the tech-report attached to the umbrella JIRA YARN-1051.
We have a complete solution backing this API, which we are testing/hardening and
will be posting the rest of it in the upcoming days/weeks.
> Add a public API to reserve resources (part of YARN-1051)
> ---------------------------------------------------------
>
> Key: YARN-1708
> URL: https://issues.apache.org/jira/browse/YARN-1708
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: resourcemanager
> Reporter: Carlo Curino
> Assignee: Subramaniam Krishnan
> Attachments: YARN-1708.patch
>
>
> This JIRA tracks the definition of a new public API for YARN, which allows
> users to reserve resources (think of time-bounded queues). This is part of
> the admission control enhancement proposed in YARN-1051.
--
This message was sent by Atlassian JIRA
(v6.2#6252)