bvaradar commented on issue #2051: URL: https://github.com/apache/hudi/issues/2051#issuecomment-683241932
@jiegzhan : RecordKey uniqueness is a fundamental constraint in Hudi. Even for inserts, the expectation is that the primary key uniqueness needs to be maintained. The only reason why (1) allowed duplicates is because "hoodie.combine.before.insert=false". If the above property is turned on, deduplication would have eliminated the duplicate. For insert only use-case, you can add a UUID column as record-key to preserve uniqueness ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
