[
https://issues.apache.org/jira/browse/FLINK-31215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863062#comment-17863062
]
Artem Plyusnin commented on FLINK-31215:
----------------------------------------
Hi all. I finished with implementation of the feature and I need someone to
review (and maybe discuss it) and merge the pr. Whom I have to ask to do it?
> Backpropagate processing rate limits from non-scalable bottlenecks to
> upstream operators
> ----------------------------------------------------------------------------------------
>
> Key: FLINK-31215
> URL: https://issues.apache.org/jira/browse/FLINK-31215
> Project: Flink
> Issue Type: New Feature
> Components: Autoscaler, Kubernetes Operator
> Reporter: Gyula Fora
> Assignee: Artem Plyusnin
> Priority: Major
> Labels: pull-request-available
>
> The current algorithm scales operators based on input data rates by
> propagating it forward through the graph.
> However there are cases where a certain operators processing capacity is
> limited either because it has a set maxParallelism or the users excludes it
> from scaling (or otherwise the capacity doesnt increase with scaling).
> In these cases it doesn't make sense to scale upstream operators to the
> target data rate if the job is going to be bottlenecked by a downstream
> operator. But instead we should backpropagate the limit based on the
> non-scalable bottleneck.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
