Sicheng Yu created IOTDB-6284:
---------------------------------
Summary: Load: The Second Phase Merged into the Consensus Layer
Key: IOTDB-6284
URL: https://issues.apache.org/jira/browse/IOTDB-6284
Project: Apache IoTDB
Issue Type: Improvement
Reporter: Sicheng Yu
Assignee: Sicheng Yu
Problems:
The Load TsFile process uses a two-phase transaction commit to ensure
consistency. Currently, during the second stage of the validation process,
commands are sent directly to each DataNode through the Thrift framework, which
does not ensure that the loaded TsFile is organized within the DataRegionGroup.
This does not ensure that the loaded TsFiles are organized within the
DataRegionGroup, nor can they be correctly identified as progress by the Pipe
system.
Solution:
Phase 2 instructions will be wrapped into a consensus layer request and routed
through the consensus layer to the target DataRegion to execute the
instructions.
问题:
Load TsFile 过程中使用了两阶段事务提交的方式保证一致性。目前在第二阶段确认的过程中直接通过 Thrift 框架发送指令到各个 DataNode
上,这无法保证加载的 TsFile 在 DataRegionGroup 内的有序性。也无法被 Pipe 系统正确地标识成进度
解决方案:
会将第二阶段指令包装成共识层请求,通过共识层路由至目标 DataRegion 再执行指令
--
This message was sent by Atlassian Jira
(v8.20.10#820010)