Jacky Li created CARBONDATA-3579:
------------------------------------
Summary: Support merge index files when adding partition
Key: CARBONDATA-3579
URL: https://issues.apache.org/jira/browse/CARBONDATA-3579
Project: CarbonData
Issue Type: Improvement
Reporter: Jacky Li
Fix For: 2.0.0
Normally, application will use Carbon SDK to write files into a partition
folder, then add the folder to partitioned carbon table.
If there are many threads writes to the same partition folder, there will be
many carbon index files, and it is not good for query performance since all
index files need to be read to spark driver.
So, a better way is to merge the index files when adding new partition to
carbon table.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)