[
https://issues.apache.org/jira/browse/FLINK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17723800#comment-17723800
]
Zhanghao Chen commented on FLINK-32119:
---------------------------------------
+1 for "partition skew is probably worse than key group misalignment", and key
group misalignment is not even a problem for non-key-based operations. I think
we'd better add two different options to control partition balance for sources
and key group alignment for other operators separately.
> Disable key group alignment for determining source parallelism
> --------------------------------------------------------------
>
> Key: FLINK-32119
> URL: https://issues.apache.org/jira/browse/FLINK-32119
> Project: Flink
> Issue Type: Bug
> Components: Autoscaler, Kubernetes Operator
> Reporter: Maximilian Michels
> Assignee: Maximilian Michels
> Priority: Major
> Fix For: kubernetes-operator-1.6.0, kubernetes-operator-1.5.1
>
>
> After choosing the target parallelism for a vertex, we choose a higher
> parallelism if that parallelism leads to evenly spreading the number of key
> groups (=max parallelism).
> For one, sources don't have keyed state, so this adjustment does not make
> sense.
> For another, we internally limit the max parallelism of sources to the number
> of partitions discovered. This makes the adjustment even less meaningful.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
