michael1991 opened a new issue, #8121: URL: https://github.com/apache/hudi/issues/8121
**Describe the problem you faced** We found duplicated records in partitions of a MOR table with schedule compaction only, meanwhile we didn't run separate compaction job. After we changed schedule compaction to inline compaction, we didn't find duplicated records on later ingested partitions. **Expected behavior** Whatever compactions were executed, record_key should be unique in one partition. **Environment Description** * Hudi version : 0.12.0 * Spark version : 3.3.0 * Hive version : not used * Hadoop version : 3.1.3 * Storage (HDFS/S3/GCS..) : GCS * Running on Docker? (yes/no) : no -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
