[
https://issues.apache.org/jira/browse/CARBONDATA-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajantha Bhat resolved CARBONDATA-3881.
--------------------------------------
Fix Version/s: 2.1.0
Resolution: Fixed
[https://github.com/apache/carbondata/pull/3810]
> concurrent main table compaction and SI load issue
> --------------------------------------------------
>
> Key: CARBONDATA-3881
> URL: https://issues.apache.org/jira/browse/CARBONDATA-3881
> Project: CarbonData
> Issue Type: Bug
> Reporter: Ajantha Bhat
> Assignee: Ajantha Bhat
> Priority: Major
> Fix For: 2.1.0
>
> Time Spent: 2h 20m
> Remaining Estimate: 0h
>
> problem: consider a scenario, where segmentX has loaded to main table but
> failed to load to SI table. So, while loading another segmentY, we reload
> failed SI segmentX. this time if the segmentX is compacted in main table and
> clean files executed on it. SI load will fail and segmented will not be found
> in segmentMap of SI and it throws exception.
>
> solution: just before reloading the failed SI segment. check if it is valid
> segment in main table.
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
