[
https://issues.apache.org/jira/browse/FLINK-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Till Rohrmann updated FLINK-7866:
---------------------------------
Description:
[~sihuazhou] proposed to not only use the list of preferred locations to decide
where to schedule a task, but to also weigh the list according to how often a
location appeared and then select the location based on the weight. That way,
we would obtain better locality in some cases.
Example:
Preferred locations list: {{\{location1, location2, location2\}}}
Weighted preferred locations list {{\{ (location2 , 2), (location1, 1)\}}}
was:
[~sihuazhou] proposed to not only use the list of preferred locations to decide
where to schedule a task, but to also weigh the list according to how often a
location appeared and then select the location based on the weight. That way,
we would obtain better locality in some cases.
Example:
Preferred locations list: {{{location1, location2, location2}}}
Weighted preferred locations list {{{ (location2 , 2), (location1, 1)}}}
> Weigh list of preferred locations for scheduling
> ------------------------------------------------
>
> Key: FLINK-7866
> URL: https://issues.apache.org/jira/browse/FLINK-7866
> Project: Flink
> Issue Type: Improvement
> Components: Scheduler
> Affects Versions: 1.4.0, 1.3.2
> Reporter: Till Rohrmann
> Fix For: 1.5.0
>
>
> [~sihuazhou] proposed to not only use the list of preferred locations to
> decide where to schedule a task, but to also weigh the list according to how
> often a location appeared and then select the location based on the weight.
> That way, we would obtain better locality in some cases.
> Example:
> Preferred locations list: {{\{location1, location2, location2\}}}
> Weighted preferred locations list {{\{ (location2 , 2), (location1, 1)\}}}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
