codope commented on code in PR #7309:
URL: https://github.com/apache/hudi/pull/7309#discussion_r1034750722
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java:
##########
@@ -265,6 +265,13 @@ public class HoodieWriteConfig extends HoodieConfig {
.withDocumentation("When inserted records share same key, controls
whether they should be first combined (i.e de-duplicated) before"
+ " writing to storage.");
+ public static final ConfigProperty<String> PERSIST_BEFORE_INSERT =
ConfigProperty
Review Comment:
@scxwhite Thanks for raising the PR. This is a very valid issue. However, I
think we should refrain from adding another config here. We should optimize the
DAG instead.
The work here seems related to #7039
cc @nsivabalan
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
