Jiayu Shen created CARBONDATA-4251:
--------------------------------------
Summary: optimize clean index file performance
Key: CARBONDATA-4251
URL: https://issues.apache.org/jira/browse/CARBONDATA-4251
Project: CarbonData
Issue Type: Improvement
Components: core
Affects Versions: 2.2.0
Reporter: Jiayu Shen
Fix For: 2.2.1
When cleanfile cleans up data, it cleans up all the carbonindex and
carbonmergeindex that once existed, even though many carbonindex have been all
deleted, which have been merged into carbonergeindex. considering that there
are tens of thousands of carbonindex that once existed after the completion of
the compaction, the clean file command will take serveral hours.
Here, we just need to clean up the existing files, carbonmergeindex or
carbonindex files
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
