hudi-bot opened a new issue, #16456: URL: https://github.com/apache/hudi/issues/16456
When we compact an MOR table who with _hoodie_operation field, the hoodiekey tagged with operation "-D" was not correctly removed. Refer to previous discussions (https://github.com/apache/hudi/pull/8721#issuecomment-1736629662) we should keep flink engine for the delete record, And also repair the spark in the https://github.com/apache/hudi/pull/10219 engine problems when reading data, should repair caused by compact problem now. Because of the 'compact' directly using the HoodieMergedLogRecordScanner in the common module, I think we have to add some optional configuration to control whether or not the HoodieMergedLogRecordScanner directly delete the key that taged with "-D" operation ## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-7642 - Type: Bug -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
