[
https://issues.apache.org/jira/browse/FLINK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681514#comment-17681514
]
Junrui Li commented on FLINK-30808:
-----------------------------------
The failure is because currently in StreamGraph#createActualEdge, if the
partitioner is a ForwardPartitioner, then the operator parallelism of the
upstream and downstream of the partitioner will be required to be consistent.
However, for the ForConsecutiveHashPartitioner used in this case, it is not
required that the parallelism of upstream and downstream operators must be
consistent. So we can fix this bug by fixing the StreamGraph#createActualEdge.
> MultipleInputITCase failed with AdaptiveBatch Scheduler
> -------------------------------------------------------
>
> Key: FLINK-30808
> URL: https://issues.apache.org/jira/browse/FLINK-30808
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Coordination
> Affects Versions: 1.16.0, 1.17.0
> Reporter: Junrui Li
> Assignee: Junrui Li
> Priority: Major
> Fix For: 1.17.0
>
>
> MultipleInputITCase#testRelatedInputs failed with AdaptiveBatch Scheduler.
> {code:java}
> java.lang.UnsupportedOperationException: Forward partitioning does not allow
> change of parallelism. Upstream operation: Calc[10]-14 parallelism: 1,
> downstream operation: HashJoin[15]-20 parallelism: 3 You must use another
> partitioning strategy, such as broadcast, rebalance, shuffle or global. {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
