[
https://issues.apache.org/jira/browse/CARBONDATA-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhichao Zhang updated CARBONDATA-2230:
---------------------------------------
Description:
After [PR1984|https://github.com/apache/carbondata/pull/1984] merged, it
doesn't delete the lock files when unlock, there are many useless lock files in
table path, especially segment lock files, they grow after every batch loading.
Solution :
1. add a child path into table path, called Locks, all lock files will be
stored in this path;
2. Before loading, get all useless segment lock files and delete them, because
just segment lock files will grow, other lock files dosen't grow.
> Add a path into table path to store lock files and delete useless segment
> lock files before loading
> ---------------------------------------------------------------------------------------------------
>
> Key: CARBONDATA-2230
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2230
> Project: CarbonData
> Issue Type: Improvement
> Components: data-load
> Affects Versions: 1.3.0, 1.4.0
> Reporter: Zhichao Zhang
> Assignee: Zhichao Zhang
> Priority: Minor
> Fix For: 1.3.0, 1.4.0
>
>
> After [PR1984|https://github.com/apache/carbondata/pull/1984] merged, it
> doesn't delete the lock files when unlock, there are many useless lock files
> in table path, especially segment lock files, they grow after every batch
> loading.
> Solution :
> 1. add a child path into table path, called Locks, all lock files will be
> stored in this path;
> 2. Before loading, get all useless segment lock files and delete them,
> because just segment lock files will grow, other lock files dosen't grow.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
