[
https://issues.apache.org/jira/browse/YARN-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304854#comment-15304854
]
Carlo Curino commented on YARN-5165:
------------------------------------
The attached patch leverages the {{RLESparseResourceAllocation.merge()}} to
subtract the proposed reservation skyline from the plan available resources,
and testing for non-negative. In case of exception, we repackage it in a more
meaningful exception type. This requires less code and it is substantially more
efficient as it leverages the RLE encoded implementation of merge instead of a
step-by-step implementation we used to have.
> NoOvercommitPolicy does not take advantage of RLE representation of plan
> ------------------------------------------------------------------------
>
> Key: YARN-5165
> URL: https://issues.apache.org/jira/browse/YARN-5165
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: capacityscheduler, fairscheduler, resourcemanager
> Reporter: Carlo Curino
> Assignee: Carlo Curino
> Attachments: YARN-5165.1.patch, YARN-5165.2.patch
>
>
> As a consequence small time granularities (e.g., 1 sec) and long time horizon
> for a reservation (e.g., months) run rather slow (10 sec).
> Proposed resolution is to switch to interval math in checking, similar to how
> YARN-4359 does for agents.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
