yschengzi opened a new pull request, #11851: URL: https://github.com/apache/iotdb/pull/11851
Problems: The Load TsFile process uses a two-phase transaction commit to ensure consistency. Currently, commands are sent directly to each DataNode through the Thrift framework during the second stage of validation, which does not ensure that the loaded TsFiles are organized within the DataRegionGroup. This does not ensure that the loaded TsFiles are organized within the DataRegionGroup, nor can they be correctly identified as progress by the Pipe system. Solution: A RecoverProgressIndex will be added to the second stage command, so that when a local load or a cross-DataNode load is performed, the ProgressIndex will be incorporated into the TsFileResource to complete the progress identification. 问题： Load TsFile 过程中使用了两阶段事务提交的方式保证一致性。目前在第二阶段确认的过程中直接通过 Thrift 框架发送指令到各个 DataNode 上，这无法保证加载的 TsFile 在 DataRegionGroup 内的有序性。也无法被 Pipe 系统正确地标识成进度 解决方案： 会将第二阶段指令添加一个 RecoverProgressIndex，当执行本地 load 或者跨 DataNode load 的时候，将 ProgressIndex 融入 TsFileResource 从而完成进度标识 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
