[
https://issues.apache.org/jira/browse/FLINK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maximilian Michels updated FLINK-32119:
---------------------------------------
Summary: Add option to control source partition skew (was: Disable key
group alignment for determining source parallelism)
> Add option to control source partition skew
> -------------------------------------------
>
> Key: FLINK-32119
> URL: https://issues.apache.org/jira/browse/FLINK-32119
> Project: Flink
> Issue Type: Bug
> Components: Autoscaler, Kubernetes Operator
> Reporter: Maximilian Michels
> Assignee: Maximilian Michels
> Priority: Major
> Fix For: kubernetes-operator-1.6.0, kubernetes-operator-1.5.1
>
>
> After choosing the target parallelism for a vertex, we choose a higher
> parallelism if that parallelism leads to evenly spreading the number of key
> groups (=max parallelism).
> For one, sources don't have keyed state, so this adjustment does not make
> sense.
> For another, we internally limit the max parallelism of sources to the number
> of partitions discovered. This makes the adjustment even less meaningful.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)