[
https://issues.apache.org/jira/browse/BEAM-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16693239#comment-16693239
]
Maximilian Michels commented on BEAM-6077:
------------------------------------------
[~JozoVilcek] Just saw this. You mentioned the wrong Max ;) My handle is [~mxm]
({{@mxm}}).
It should be possible to rescale the state in case the number of readers is
larger than the parallelism. So we might need to change the source splitting
logic which currently tries to split according to the parallelism. Perhaps we
need to change it to {{MAX_PARALLELISM}}.
> Make UnboundedSource state rescale friendly
> -------------------------------------------
>
> Key: BEAM-6077
> URL: https://issues.apache.org/jira/browse/BEAM-6077
> Project: Beam
> Issue Type: Improvement
> Components: runner-flink
> Affects Versions: 2.8.0
> Reporter: Jozef Vilcek
> Assignee: Jozef Vilcek
> Priority: Major
>
> FlinkRunner's UnboundedSourceWrapper currently does not rescale well it's
> state when job changes parallelism.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
