Sicheng Yu created IOTDB-6287:
---------------------------------
Summary: Load: Add Progress Index for the Second Phase of Load
TsFile
Key: IOTDB-6287
URL: https://issues.apache.org/jira/browse/IOTDB-6287
Project: Apache IoTDB
Issue Type: Improvement
Reporter: Sicheng Yu
Assignee: Sicheng Yu
Problems:
The Load TsFile process uses a two-phase transaction commit to ensure
consistency. Currently, commands are sent directly to each DataNode through the
Thrift framework during the second stage of validation, which does not ensure
that the loaded TsFiles are organized within the DataRegionGroup. This does not
ensure that the loaded TsFiles are organized within the DataRegionGroup, nor
can they be correctly identified as progress by the Pipe system.
Solution:
A RecoverProgressIndex will be added to the second stage command, so that when
a local load or a cross-DataNode load is performed, the ProgressIndex will be
incorporated into the TsFileResource to complete the progress identification.
问题：
Load TsFile 过程中使用了两阶段事务提交的方式保证一致性。目前在第二阶段确认的过程中直接通过 Thrift 框架发送指令到各个 DataNode
上，这无法保证加载的 TsFile 在 DataRegionGroup 内的有序性。也无法被 Pipe 系统正确地标识成进度
解决方案：
会将第二阶段指令添加一个 RecoverProgressIndex，当执行本地 load 或者跨 DataNode load 的时候，将
ProgressIndex 融入 TsFileResource 从而完成进度标识
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
