[
https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16284824#comment-16284824
]
Wangda Tan commented on YARN-7612:
----------------------------------
[~asuresh],
For 1. I'm completely fine with the first cut only implements single App
placement. But I think it is important to support multiple apps from the API,
it will be quite important to make sure we have a correct abstraction of
PlacementProcessor, algorithm, and scheduler. To me, the reason why it is so
hard to implement multi-app allocation in today's schedule is because of the
original scheduler's API design. Since the purpose of this framework could be
the future global scheduler API, I want to make sure it is capable to do it.
I'm fine with a sub-API support single App allocation and invoked by a common
SingleAppPlacementAlgorithm (by using strategy pattern, etc.). However, I would
prefer to avoid it if possible to make sure we have a generic/clean Algorithm
API design.
And for the single app allocation order, I prefer to get application allocation
order by looking at existing queues/apps instead of simply relies on queued
request. I'm fine with initial cut doesn't include it, but I suggest to move
these logics (replies on queued request) to Algorithm. In my mind, Algorithm
should be able to decide the order of allocation instead of depending on
external Processor.
For 3. I think the purpose is reasonable, we do need to properly reject
Requests if it is always not placeable. I need to look into more details before
giving more feedbacks.
For 4. I would prefer not to have the "place" call at all in the top-level
Algorithm API. Instead, Algorithm will run asynchronously and notify Processor
about its decisions.
> Add Placement Processor and planner framework
> ---------------------------------------------
>
> Key: YARN-7612
> URL: https://issues.apache.org/jira/browse/YARN-7612
> Project: Hadoop YARN
> Issue Type: Sub-task
> Reporter: Arun Suresh
> Assignee: Arun Suresh
> Attachments: YARN-7612-YARN-6592.001.patch,
> YARN-7612-YARN-6592.002.patch, YARN-7612-v2.wip.patch, YARN-7612.wip.patch
>
>
> This introduces a Placement Processor and a Planning algorithm framework to
> handle placement constraints and scheduling requests from an app and places
> them on nodes.
> The actual planning algorithm(s) will be handled in a YARN-7613.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
