[
https://issues.apache.org/jira/browse/FLINK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845095#comment-16845095
]
Ben La Monica commented on FLINK-12122:
---------------------------------------
I think the thing that is throwing everything off is that I have 3 slot sharing
groups set up. 1 for data enrichment (default) and 1 for calculation and 1 for
sorting. I added the slot sharing group because without it a cpu intensive
message coming in would result in all other messages just backing up behind it
on the same partition instead of processing in parallel, but maybe I can figure
out how to prevent that without a slot sharing group.
I'll try with everything in the same slot sharing group and parallelism but
just force a new chain at the calculation step and the sorting step. (you can
see the slot sharing groups break everything apart at the calc, sorter and
gatherer operators).
!image-2019-05-21-13-02-50-251.png!
> Spread out tasks evenly across all available registered TaskManagers
> --------------------------------------------------------------------
>
> Key: FLINK-12122
> URL: https://issues.apache.org/jira/browse/FLINK-12122
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
> Affects Versions: 1.6.4, 1.7.2, 1.8.0
> Reporter: Till Rohrmann
> Assignee: Till Rohrmann
> Priority: Major
> Fix For: 1.7.3, 1.9.0, 1.8.1
>
> Attachments: image-2019-05-21-12-28-29-538.png,
> image-2019-05-21-13-02-50-251.png
>
>
> With Flip-6, we changed the default behaviour how slots are assigned to
> {{TaskManages}}. Instead of evenly spreading it out over all registered
> {{TaskManagers}}, we randomly pick slots from {{TaskManagers}} with a
> tendency to first fill up a TM before using another one. This is a regression
> wrt the pre Flip-6 code.
> I suggest to change the behaviour so that we try to evenly distribute slots
> across all available {{TaskManagers}} by considering how many of their slots
> are already allocated.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
