MOBIN-F commented on code in PR #4029:
URL: https://github.com/apache/flink-cdc/pull/4029#discussion_r2128524947
##########
flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/v2/PreCommitOperator.java:
##########
@@ -140,4 +147,9 @@ public void close() throws Exception {
storeMultiCommitter.close();
}
}
+
+ @Override
+ public void endInput() throws Exception {
+ commitUpToCheckpoint(Long.MAX_VALUE);
+ }
Review Comment:
When using flink batch mode and bounded stream, the endInput method of
BoundedOneInput is needed to drive commit.
In the test case, env.fromCollection(events, TypeInformation.of(Event.class)
returns a bounded stream. When the data ends, endInput() is called to generate
a paimon snapshot.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
