Shuo Cheng created FLINK-24048:
----------------------------------
Summary: Move changeLog inference out of optimizing phase
Key: FLINK-24048
URL: https://issues.apache.org/jira/browse/FLINK-24048
Project: Flink
Issue Type: Improvement
Components: Table SQL / Planner
Affects Versions: 1.14.0
Reporter: Shuo Cheng
Fix For: 1.15.0
Currently, when there are multiple sinks in a sql job, the DAG is split into
multiple relNode blocks; as changeLog inference is in optimizing phase, we need
to propagate the changeLog mode among blocks to ensure each block can generate
an accurate physical plan.
In current solution, the DAG is optimized 3 times, which is inefficient.
Actually, we can just optimize the DAG, expanding the DAG to a physical node
tree, and then infer changeLog mode. In this way, the dag is only optimized 1
time.
(Similarly, minibatch interval can also be inferred is same way)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
