deepakpanda93 commented on issue #16024: URL: https://github.com/apache/hudi/issues/16024#issuecomment-4852133020
This is fixed as of Hudi 0.14.0. Update-partition-path support was added to the record-level index in HUDI-6431 / [#9041](https://github.com/apache/hudi/pull/9041) ("Support update partition path in record-level index"), which introduced the hoodie.record.index.update.partition.path config — the RLI equivalent of hoodie.bloom.index.update.partition.path. Deletes handling when the partition path changes was fixed in HUDI-6467 / [#9114](https://github.com/apache/hudi/pull/9114). (The SparkMetadataTableRecordIndex class has since been refactored into HoodieRecordIndex.) To use it: with hoodie.index.type=RECORD_INDEX, set hoodie.record.index.update.partition.path=true, and records whose partition value changes will be moved (deleted from the old partition, inserted into the new) rather than duplicated. Both fixes are in 0.14.0 and all later releases including 1.x. Closing as fixed — please reopen if you still see incorrect behavior with hoodie.record.index.update.partition.path=true on a recent 1.x release. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
