suyash yadav created CARBONDATA-4116:
----------------------------------------
Summary: Concurrent Data Loading Issue
Key: CARBONDATA-4116
URL: https://issues.apache.org/jira/browse/CARBONDATA-4116
Project: CarbonData
Issue Type: Improvement
Components: core
Affects Versions: 1.6.1, 2.0.1
Environment: Apache carbondata 2.0.1
Reporter: suyash yadav
Even carbon claim that it can support the concurrent data loading together with
table compaction, in fact it cannot. We have faced data inconsistent issue in
carbon 1.6.1 when loading data concurrently into the table together with
compaction. That is why we implement table locking for load data, compact and
clean files command. All this is due to the manipulation of the table’s
metadata file, i.e .tablestatus.
We are facing issue in concurrent data loading together with compaction - gets
us to data inconsistency - what is the way out to fix this as we want
concurrent loading with compaction
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
