[
https://issues.apache.org/jira/browse/YARN-5293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15357609#comment-15357609
]
Wangda Tan commented on YARN-5293:
----------------------------------
Thanks for discussion, [~jhung], [~sunilg], [~Naganarasimha].
I can understand the use case for per-queue-per-partition preemption disable.
In my mind, node partition should be considered as an individual cluster, if we
allow preemption disable for default partition, we should allow preemption
disable for other queues. One straightforward use case is, one queue can access
multi partitions, applications in some partitions are more important than
others.
I don't think we should add per-partition preemption, this brings more issues
about which configuration will be honored (assume we have
queue.disable-preemption / queue.label.disable-preemption /
label.disable-preemption).
For configuration:
Existing queue.disable-preemption means *disable preemption for all partitions
of this queue*. We should keep this semantic, otherwise it becomes a
incompatible change. In my mind:
queue.label.disable-preemption should be able to overwrite
queue.disable-preemption.
For sequence of configuration override:
- non-default-partition: this-queue.label.disable-preemption >
this-queue.disable-preemption > parent-queue.label.disable-preemption >
parent-queue.disable-preemption.
- default-partition: this-queue.disable-preemption >
parent-queue.disable-preemption (as same as now).
Thoughts?
> Disable preemption per queue per partition
> ------------------------------------------
>
> Key: YARN-5293
> URL: https://issues.apache.org/jira/browse/YARN-5293
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: capacityscheduler
> Reporter: Jonathan Hung
>
> [YARN-2056|https://issues.apache.org/jira/browse/YARN-2056] added support for
> disabling preemption at queue level.
> [YARN-2498|https://issues.apache.org/jira/browse/YARN-2498] added support for
> per partition preemption. It would be useful to be able to disable preemption
> per partition per queue, so that if a queue Q has access to two labels A and
> B, we can disable preemption for Q in A but not in B.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
