sivabalan narayanan created HUDI-3785:
-----------------------------------------
Summary: When any specific metadata table partition is disable,
ensure to remove the entry from TableConfig
Key: HUDI-3785
URL: https://issues.apache.org/jira/browse/HUDI-3785
Project: Apache Hudi
Issue Type: Bug
Components: index, metadata
Affects Versions: 0.11.0
Reporter: sivabalan narayanan
as of now, if entire metadata table is disabled, we ensure we delete the
directory and update the table config wrt fully available MDT partitions.
but if a user enables col stats and disables it after sometime, we don't update
the table config to remove col stats. and so the data skipping might still be
reading col stats and serving the queries which might lead to data loss.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)