Xingjun Hao created CARBONDATA-4083:
---------------------------------------
Summary: Refactor Update and Support Update Atomicity
Key: CARBONDATA-4083
URL: https://issues.apache.org/jira/browse/CARBONDATA-4083
Project: CarbonData
Issue Type: Improvement
Reporter: Xingjun Hao
Currently, we will modify tablestatus file for serveral times in the update
flow. In total 4 tablestauts write ops destoy the Atomicity to a certain
extent. which maybe incur dirty data under update failure scenrios.
The first time we update tablestatus is when writing delta files, firstly we
update the updatedeltastarttime and updatedeltaendtime in the tablestatus, then
delete some segments, which bring 2 tablestatus write ops.
The second time we update tatblstatus is when insert new data. just like the
first time, will bring 2 tablesatus write ops.
Also, auto compaction doesn't work for UPDATE. UPDATE won't trigger MINOR
Compaction even when we TURN ON carbon.merge.auto.compaction.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
