[
https://issues.apache.org/jira/browse/CARBONDATA-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajantha Bhat resolved CARBONDATA-4183.
--------------------------------------
Fix Version/s: 2.2.0
Resolution: Fixed
> Local sort Partition Load and Compaction improvement
> ----------------------------------------------------
>
> Key: CARBONDATA-4183
> URL: https://issues.apache.org/jira/browse/CARBONDATA-4183
> Project: CarbonData
> Issue Type: Improvement
> Reporter: Indhumathi Muthumurugesh
> Priority: Major
> Fix For: 2.2.0
>
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> Currently, number of tasks for partition table local sort load, is decided
> based on input file size. In this case, the data will not be properly sorted,
> as tasks launched is more. For compaction, number of tasks is equal to number
> of partitions. If data is huge for a partition, then there can be chances,
> that compaction will fail with OOM with less memory configurations.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
