Yanquan Lv created FLINK-37539:
----------------------------------
Summary: performance optimization in Paimon Sink to reduce
end-to-end checkpoint time
Key: FLINK-37539
URL: https://issues.apache.org/jira/browse/FLINK-37539
Project: Flink
Issue Type: Improvement
Components: Flink CDC
Affects Versions: cdc-3.3.0
Reporter: Yanquan Lv
At present, when using Paimon as a sink for jobs that require writing a large
number of tables, the end-to-end checkpoint takes a long time because we need
to perform commit operations at the checkpoint.
Perhaps we can use multithreading to have each table submit separately and then
process them together.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
