sivabalan narayanan created HUDI-7331:
-----------------------------------------
Summary: Test and certify col stats integration with MOR table
Key: HUDI-7331
URL: https://issues.apache.org/jira/browse/HUDI-7331
Project: Apache Hudi
Issue Type: Bug
Components: metadata
Reporter: sivabalan narayanan
Lets test and certify col stats integration with MOR table for all operations.
for eg, any write operations (bulk insert, insert, upsert, insert overwrite)
should add new entries to col stats index in metadata table.
rollback:
for files that were deleted should be removed from col stats (data files).
for log files added, we should add new entries to col stats
clean:
any files deleted (data files and log files) should have the entries removed
from col stats in MDT.
Similarly, lets also do similar exercise with delete partition and other
operations we have with hudi.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)