[
https://issues.apache.org/jira/browse/FLINK-32119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maximilian Michels updated FLINK-32119:
---------------------------------------
Description:
After choosing the target parallelism for a vertex, we choose a higher
parallelism if that parallelism leads to evenly spreading the number of key
groups (=max parallelism).
For one, sources don't have keyed state, so this adjustment does not make sense.
For another, we internally limit the max parallelism of sources to the number
of partitions discovered. This makes the adjustment even less meaningful.
was:
After choosing the target parallelism for a vertex, we choose a higher
parallelism if that parallelism leads to evenly spreading the number of key
groups.
For one, sources don't have keyed state, so this adjustment does not make sense.
For another, we internally limit the max parallelism of sources to the number
of partitions discovered. This makes the adjustment even less meaningful.
> Disable key group alignment for determining source parallelism
> --------------------------------------------------------------
>
> Key: FLINK-32119
> URL: https://issues.apache.org/jira/browse/FLINK-32119
> Project: Flink
> Issue Type: Bug
> Components: Autoscaler, Kubernetes Operator
> Reporter: Maximilian Michels
> Assignee: Maximilian Michels
> Priority: Major
> Fix For: kubernetes-operator-1.6.0, kubernetes-operator-1.5.1
>
>
> After choosing the target parallelism for a vertex, we choose a higher
> parallelism if that parallelism leads to evenly spreading the number of key
> groups (=max parallelism).
> For one, sources don't have keyed state, so this adjustment does not make
> sense.
> For another, we internally limit the max parallelism of sources to the number
> of partitions discovered. This makes the adjustment even less meaningful.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
