mao-liu commented on code in PR #7031:
URL: https://github.com/apache/paimon/pull/7031#discussion_r2686085032
##########
paimon-flink/paimon-flink-common/src/main/java/org/apache/paimon/flink/sink/StoreCompactOperator.java:
##########
@@ -244,4 +259,65 @@ public Class<? extends StreamOperator>
getStreamOperatorClass(ClassLoader classL
return StoreCompactOperator.class;
}
}
+
+ /** {@link StreamOperatorFactory} of {@link StoreCompactOperator}. */
+ public static class CoordinatedFactory
Review Comment:
Extending StoreCompactOperator to use WriteOperatorCoordinator
In practice, this did not help with the write performance, as it required
very high memory for ManifestEntryCache, and was also repeatedly fetching from
cloud filesystem.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
