[jira] [Created] (HUDI-8662) When a user switches the list of cols to index with col stats, we need to clean up old stats and re-build new one

[sivabalan narayanan (Jira)]

sivabalan narayanan created HUDI-8662:
-----------------------------------------

             Summary: When a user switches the list of cols to index with col 
stats, we need to clean up old stats and re-build new one
                 Key: HUDI-8662
                 URL: https://issues.apache.org/jira/browse/HUDI-8662
             Project: Apache Hudi
          Issue Type: Improvement
            Reporter: sivabalan narayanan
            Assignee: sivabalan narayanan
             Fix For: 1.0.1


As of now, we do not store the list of cols we index anywhere.

so, if user chose colA, colB for 100 commits. and then switches to colC, colD 
after 100th commit, we will go ahead and keep generating stats for just for 
colC and colD. 

 

We have plans to store cols being indexed 
https://issues.apache.org/jira/browse/HUDI-8232,

 

So, we can leverage that to tear down existing one and re-build col stats from 
scratch for colC and colD. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)