[
https://issues.apache.org/jira/browse/CARBONDATA-3579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jacky Li reassigned CARBONDATA-3579:
------------------------------------
Assignee: Jacky Li
> Support merge index files when adding partition
> -----------------------------------------------
>
> Key: CARBONDATA-3579
> URL: https://issues.apache.org/jira/browse/CARBONDATA-3579
> Project: CarbonData
> Issue Type: Improvement
> Reporter: Jacky Li
> Assignee: Jacky Li
> Priority: Major
> Fix For: 2.0.0
>
>
> Normally, application will use Carbon SDK to write files into a partition
> folder, then add the folder to partitioned carbon table.
> If there are many threads writes to the same partition folder, there will be
> many carbon index files, and it is not good for query performance since all
> index files need to be read to spark driver.
> So, a better way is to merge the index files when adding new partition to
> carbon table.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
