[
https://issues.apache.org/jira/browse/FLINK-19822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
godfrey he updated FLINK-19822:
-------------------------------
Description:
This is similar
[FLINK-12575|https://issues.apache.org/jira/browse/FLINK-12575], we could
implement {{satisfyTraits}} method for stream nodes to remove redundant
shuffle. This could add more possibilities that more operators can be merged
into multiple input operator.
Different batch, stream operators require the shuffle keys and the state keys
must be exactly the same, otherwise the state may be not correct.
We only support a few operators in this issue, such as Join and regular
Aggregate. Other operators will be supported in the future.
was:
This is similar
[FLINK-12575|https://issues.apache.org/jira/browse/FLINK-12575], we could
implement {{satisfyTraits}} method for stream nodes to remove redundant
shuffle. This could add more possibilities that more operators can be merged
into multiple input operator.
Note: to ensure the key range is correct, the shuffle can be removed only if
the required keys must totally equal to the provided keys
> Remove redundant shuffle for streaming
> --------------------------------------
>
> Key: FLINK-19822
> URL: https://issues.apache.org/jira/browse/FLINK-19822
> Project: Flink
> Issue Type: Sub-task
> Components: Table SQL / Planner
> Reporter: godfrey he
> Assignee: godfrey he
> Priority: Major
> Fix For: 1.12.0
>
>
> This is similar
> [FLINK-12575|https://issues.apache.org/jira/browse/FLINK-12575], we could
> implement {{satisfyTraits}} method for stream nodes to remove redundant
> shuffle. This could add more possibilities that more operators can be merged
> into multiple input operator.
> Different batch, stream operators require the shuffle keys and the state keys
> must be exactly the same, otherwise the state may be not correct.
> We only support a few operators in this issue, such as Join and regular
> Aggregate. Other operators will be supported in the future.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
