Yanquan Lv created FLINK-37786:
----------------------------------

             Summary: Infer schema information from the state of Source and 
emit it to avoid maintaining state in PreTransform
                 Key: FLINK-37786
                 URL: https://issues.apache.org/jira/browse/FLINK-37786
             Project: Flink
          Issue Type: Improvement
          Components: Flink CDC
    Affects Versions: cdc-3.5.0
            Reporter: Yanquan Lv


At present, in order to maintain the schema information of the original table 
before transform processing, we have maintained a state in the PreTransform 
operator, which increases the complexity of the code and the difficulty of 
maintenance.

In fact, such information has already been saved in Source. Taking MySQL Source 
as an example, there is a map<TableId, TableChange>saved in 
EmbeddedFlinkBaseHistory. We can derive the schema information corresponding to 
the read site from here.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to