sivabalan narayanan created HUDI-8385:
-----------------------------------------
Summary: Apply clean commits to col stats partition on restore in
data table
Key: HUDI-8385
URL: https://issues.apache.org/jira/browse/HUDI-8385
Project: Apache Hudi
Issue Type: Improvement
Components: metadata
Reporter: sivabalan narayanan
When we trigger restore in data table, we do the following:
* we restore the MDT also to the same instant as data table.
* For clean commits which could not be reverted in data table, we find the
difference b/w fs based listing and MDT based listing and add a delta commit to
FILES partition to clean those files.
but no other indexes are updated here.
We might need to update col stats as well. Similar to how we delete files from
FILES partition, we should also delete entries from col stats partition.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
