[
https://issues.apache.org/jira/browse/YARN-5468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405052#comment-15405052
]
Panagiotis Garefalakis edited comment on YARN-5468 at 8/3/16 12:03 AM:
-----------------------------------------------------------------------
Attaching a patch to showcase above proposal.
In this first patch we are introducing allocation tags and three placement
constraints: affinity, anti-affinity, cardinality. We are planning to
consolidate those in a single constraint in the 2nd version of the patch. For
the time being we do not support time constraints.
In the current version the requests are accommodated in an online, greedy
fashion.
We extend distribute-shell application Client and AM to demonstrate inter-job
placement constraints. Some unit-tests are also included to show the supported
constraints (affinity, anti-affinity, and cardinality) in Node and Rack level.
was (Author: pgaref):
Attaching a patch to showcase above proposal.
In this first patch we are introducing allocation tags and three placement
constraints: affinity, anti-affinity, cardinality. We are planning to
consolidate those in a single constraint in the 2nd version of the patch. For
the time being we do not support time constraints.
We extend distribute-shell Client and AM to demonstrate affinity inter-job
constraints. Some unit-tests are also included to show the supported
constraints (affinity, anti-affinity, and cardinality) in Node and Rack level.
> Scheduling of long-running applications
> ---------------------------------------
>
> Key: YARN-5468
> URL: https://issues.apache.org/jira/browse/YARN-5468
> Project: Hadoop YARN
> Issue Type: New Feature
> Components: capacityscheduler, fairscheduler
> Reporter: Konstantinos Karanasos
> Assignee: Konstantinos Karanasos
> Attachments: YARN-5468.prototype.patch
>
>
> This JIRA is about the scheduling of applications with long-running tasks.
> It will include adding support to the YARN for a richer set of scheduling
> constraints (such as affinity, anti-affinity, cardinality and time
> constraints), and extending the schedulers to take them into account during
> placement of containers to nodes.
> We plan to have both an online version that will accommodate such requests as
> they arrive, as well as a Long-running Application Planner that will make
> more global decisions by considering multiple applications at once.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
