[
https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15104893#comment-15104893
]
Wangda Tan commented on YARN-4108:
----------------------------------
Hi [~sunilg],
bq. As Wangda mentioned, I think we can discuss this point in the new Jira. In
top of my mind, few use case are there...
Thanks for sharing your thoughts, I have a very rough draft for PCPP
refactoring, but I would like to start discuss it after we have a conclusion
about direction of this JIRA first.
bq. I think we can avoid this list. rather we can verify from PreemptionEntity
itself.
Done
bq. Now along with PCPP, preemption will happen on above case. I think we can
add some more detailed diagnostics here to give reason for preemption that
max-capacity is violated etc.. It will helpful while debugging.
Good suggestion, I have some additional logs for lazy preemption, see
LeafQueue#killToPreemptContainers
> CapacityScheduler: Improve preemption to preempt only those containers that
> would satisfy the incoming request
> --------------------------------------------------------------------------------------------------------------
>
> Key: YARN-4108
> URL: https://issues.apache.org/jira/browse/YARN-4108
> Project: Hadoop YARN
> Issue Type: Bug
> Components: capacity scheduler
> Reporter: Wangda Tan
> Assignee: Wangda Tan
> Attachments: YARN-4108-design-doc-V3.pdf,
> YARN-4108-design-doc-v1.pdf, YARN-4108-design-doc-v2.pdf,
> YARN-4108.poc.1.patch, YARN-4108.poc.2-WIP.patch
>
>
> This is sibling JIRA for YARN-2154. We should make sure container preemption
> is more effective.
> *Requirements:*:
> 1) Can handle case of user-limit preemption
> 2) Can handle case of resource placement requirements, such as: hard-locality
> (I only want to use rack-1) / node-constraints (YARN-3409) / black-list (I
> don't want to use rack1 and host\[1-3\])
> 3) Can handle preemption within a queue: cross user preemption (YARN-2113),
> cross applicaiton preemption (such as priority-based (YARN-1963) /
> fairness-based (YARN-3319)).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
