hudi-bot opened a new issue, #17233: URL: https://github.com/apache/hudi/issues/17233
With adding delete support for RLI, [https://github.com/apache/hudi/pull/9058/files] Hbase index needs some fixes. Test that is failing is: TestSparkHoodieHBaseIndex. testTagLocationAndPartitionPathUpdateWithExplicitRollback Root cause: when update partition path is set to true, within same batch we have a deleted record and a new insert record. So, to hbase we are sending both the records and for some inserts take precedence, while for others deletes take precedence. we need to fix SparkHoodieHbaseIndex. updateLocation to do one pass overWriteStatus and ensure we de-dup if we have two records where one of them is deleted and another is inserted. but there are chances that only deletes are present, so in such cases, we need to ensure deletes are routed to hbase. ## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-6460 - Type: Sub-task - Parent: https://issues.apache.org/jira/browse/HUDI-8875 - Fix version(s): - 1.1.0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
