[
https://issues.apache.org/jira/browse/BEAM-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16696632#comment-16696632
]
Maximilian Michels commented on BEAM-6077:
------------------------------------------
No worries!
The {{ListState}} is part of Flink's API for keyed state. That means you do not
have to worry about partitioning the state manually, it is already partitioned
by a key range. You just append to the state and it is internally grouped into
key groups which then can be repartitioned when scaling up or down. Since this
is a transparent process, you just increase the splits of the source and it
should work automatically.
> Make UnboundedSource state rescale friendly
> -------------------------------------------
>
> Key: BEAM-6077
> URL: https://issues.apache.org/jira/browse/BEAM-6077
> Project: Beam
> Issue Type: Improvement
> Components: runner-flink
> Affects Versions: 2.8.0
> Reporter: Jozef Vilcek
> Assignee: Jozef Vilcek
> Priority: Major
>
> FlinkRunner's UnboundedSourceWrapper currently does not rescale well it's
> state when job changes parallelism.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)