[
https://issues.apache.org/jira/browse/FLINK-31706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17721999#comment-17721999
]
Lijie Wang edited comment on FLINK-31706 at 5/12/23 3:59 AM:
-------------------------------------------------------------
Thanks for your attention and effort, but we cannot do it now, because it will
change the behavior of {{parallelism.default}} and
{{execution.batch.adaptive.auto-parallelism.default-source-parallelism}} ,
needs to be discussed and approved on the mailing list (See
[FLIP|https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals]
for details).
In addition, as I said above, we have some other ideas about Source paralleism
in adaptive batch scheduler, and hope to merge the idea here into one FLIP and
discuss them together on the mailing list.
This FLIP is in preparation and we will drive a discussion on the mailing list
once it is ready. If you are interested, welcome to participate in the
discussion and coding at that time.
WDYT? [~zxcoccer]
was (Author: wanglijie95):
Thanks for your attention and effort, but we cannot do it now, because it will
change the behavior of {{parallelism.default}} and
{{execution.batch.adaptive.auto-parallelism.default-source-parallelism}} ,
needs to be discussed and approved on the mailing list (See
[FLIP|https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals]
for details).
In addition, as I said above, we have some other ideas about Source paralleism
in adaptive batch scheduler, and hope to merge the idea here into one FLIP and
discuss them together on the mailing list.
This FLIP is in preparation and we will drive a discussion on the mailing list
once it is ready. If you are interested, welcome to participate in the
discussion and development at that time.
WDYT? [~zxcoccer]
> The default source parallelism should be the same as execution's default
> parallelism under adaptive batch scheduler
> -------------------------------------------------------------------------------------------------------------------
>
> Key: FLINK-31706
> URL: https://issues.apache.org/jira/browse/FLINK-31706
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Coordination
> Reporter: Yun Tang
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.18.0
>
>
> Currently, the sources need to set
> {{execution.batch.adaptive.auto-parallelism.default-source-parallelism }} in
> the adaptive batch scheduler mode, otherwise, the source parallelism is only
> 1 by default. A better solution might be set as the default execution
> parallelism if no user configured.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
