[
https://issues.apache.org/jira/browse/FLINK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17723475#comment-17723475
]
Maximilian Michels commented on FLINK-32119:
--------------------------------------------
True, partition skew is probably worse than key group misalignment. In that
light, we probably want to rethink the current code which tolerates skewness
for sources in case it can't reach an even balance.
> Disable key group alignment for determining source parallelism
> --------------------------------------------------------------
>
> Key: FLINK-32119
> URL: https://issues.apache.org/jira/browse/FLINK-32119
> Project: Flink
> Issue Type: Bug
> Components: Autoscaler, Kubernetes Operator
> Reporter: Maximilian Michels
> Assignee: Maximilian Michels
> Priority: Major
> Fix For: kubernetes-operator-1.6.0, kubernetes-operator-1.5.1
>
>
> After choosing the target parallelism for a vertex, we choose a higher
> parallelism if that parallelism leads to evenly spreading the number of key
> groups (=max parallelism).
> For one, sources don't have keyed state, so this adjustment does not make
> sense.
> For another, we internally limit the max parallelism of sources to the number
> of partitions discovered. This makes the adjustment even less meaningful.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
