bube commented on code in PR #10109:
URL: https://github.com/apache/paimon/pull/10109#discussion_r4388145924
##########
paimon-flink/paimon-flink-common/src/main/java/org/apache/paimon/flink/FlinkConnectorOptions.java:
##########
@@ -483,6 +496,20 @@ public class FlinkConnectorOptions {
+
"${UID_PREFIX}_${TABLE_NAME}_${USER_UID_SUFFIX}. If the uid suffix is not set,
flink will "
+ "automatically generate the operator
uid, which may be incompatible when the topology changes.");
+ public static final ConfigOption<Boolean>
SINK_OPERATOR_UID_COVER_ALL_OPERATORS =
+ key("sink.operator-uid.cover-all-operators")
+ .booleanType()
+ .defaultValue(false)
+ .withDescription(
+ "If true, 'sink.operator-uid.suffix' also names
every other operator a streaming "
+ + "write adds: the row conversions, the
local merge, the compaction operators, "
Review Comment:
Correction to my last comment: the bounded dedicated-split route does not
re-read because of the migration. It re-plans its scan on every restore, and
the Paimon sink drops the repeated end-of-input commit. Its monitor entry does
need `allowNonRestoredState`, like the exactly-once route. I removed the
sentence from the guide (e7aee65).
I also ran the guide's steps on a real Flink 1.20.5 cluster for the append,
PARTITION_DYNAMIC, HA-store recovery and exactly-once consumer routes: no lost
or duplicated rows, and the log lines match the guide.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
