[
https://issues.apache.org/jira/browse/FLINK-18825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17322980#comment-17322980
]
Flink Jira Bot commented on FLINK-18825:
----------------------------------------
This issue is assigned but has not received an update in 7 days so it has been
labeled "stale-assigned". If you are still working on the issue, please give an
update and remove the label. If you are no longer working on the issue, please
unassign so someone else may work on it. In 7 days the issue will be
automatically unassigned.
> Support to process CDC message in batch mode
> --------------------------------------------
>
> Key: FLINK-18825
> URL: https://issues.apache.org/jira/browse/FLINK-18825
> Project: Flink
> Issue Type: Sub-task
> Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table
> SQL / Ecosystem
> Reporter: Jark Wu
> Assignee: Nicholas Jiang
> Priority: Major
> Labels: stale-assigned
>
> Currently, processing CDC is only supported for streaming mode. However,
> there is also cases to process CDC data in batch mode. For example, load,
> materialize and compress CDC data into Hive using parquet format.
> Interpreting changelog in batch mode can be supported by adding a
> MaterializeOperator after the CDC source operator. The MaterializeOperator
> acts like a HashAggregate and SortAggregate based on whether all the fields
> are fixed-length. It will consume all the input RowDatas and replace/remove
> rows depending on the flag in the header.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
