[ https://issues.apache.org/jira/browse/CARBONDATA-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ajantha Bhat resolved CARBONDATA-3881. -------------------------------------- Fix Version/s: 2.1.0 Resolution: Fixed [https://github.com/apache/carbondata/pull/3810] > concurrent main table compaction and SI load issue > -------------------------------------------------- > > Key: CARBONDATA-3881 > URL: https://issues.apache.org/jira/browse/CARBONDATA-3881 > Project: CarbonData > Issue Type: Bug > Reporter: Ajantha Bhat > Assignee: Ajantha Bhat > Priority: Major > Fix For: 2.1.0 > > Time Spent: 2h 20m > Remaining Estimate: 0h > > problem: consider a scenario, where segmentX has loaded to main table but > failed to load to SI table. So, while loading another segmentY, we reload > failed SI segmentX. this time if the segmentX is compacted in main table and > clean files executed on it. SI load will fail and segmented will not be found > in segmentMap of SI and it throws exception. > > solution: just before reloading the failed SI segment. check if it is valid > segment in main table. > > -- This message was sent by Atlassian Jira (v8.3.4#803005)