Sicheng Yu created IOTDB-6284:
---------------------------------

             Summary: Load: The Second Phase Merged into the Consensus Layer
                 Key: IOTDB-6284
                 URL: https://issues.apache.org/jira/browse/IOTDB-6284
             Project: Apache IoTDB
          Issue Type: Improvement
            Reporter: Sicheng Yu
            Assignee: Sicheng Yu


Problems:
The Load TsFile process uses a two-phase transaction commit to ensure 
consistency. Currently, during the second stage of the validation process, 
commands are sent directly to each DataNode through the Thrift framework, which 
does not ensure that the loaded TsFile is organized within the DataRegionGroup. 
This does not ensure that the loaded TsFiles are organized within the 
DataRegionGroup, nor can they be correctly identified as progress by the Pipe 
system.

Solution:
Phase 2 instructions will be wrapped into a consensus layer request and routed 
through the consensus layer to the target DataRegion to execute the 
instructions.

问题:
Load TsFile 过程中使用了两阶段事务提交的方式保证一致性。目前在第二阶段确认的过程中直接通过 Thrift 框架发送指令到各个 DataNode 
上,这无法保证加载的 TsFile 在 DataRegionGroup 内的有序性。也无法被 Pipe 系统正确地标识成进度

解决方案:
会将第二阶段指令包装成共识层请求,通过共识层路由至目标 DataRegion 再执行指令



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to