[
https://issues.apache.org/jira/browse/IOTDB-5321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
刘珍 reassigned IOTDB-5321:
-------------------------
Sprint: 2022-12-Catalyst
Affects Version/s: master branch
Assignee: Xinyu Tan
> [load snapshot]ERROR o.a.i.d.e.s.SnapshotLoader:72 - Exception occurs while
> load snapshot
> ------------------------------------------------------------------------------------------
>
> Key: IOTDB-5321
> URL: https://issues.apache.org/jira/browse/IOTDB-5321
> Project: Apache IoTDB
> Issue Type: Bug
> Components: mpp-cluster
> Affects Versions: master branch
> Reporter: 刘珍
> Assignee: Xinyu Tan
> Priority: Major
> Attachments: screenshot-1.png, screenshot-2.png
>
>
> master_1229_0fedffd
> config/schema/data 分别是ratis/ratis/IoT协议
> 1副本1C4D，BM写入数据过程中，执行migrate region操作，目标节点报错（各节点OS时间不一致）：
> 2022-12-29 18:24:39,186 [pool-20-IoTDB-IoTConsensusRPC-Processor-6] ERROR
> o.a.i.d.e.s.SnapshotLoader:72 - Exception occurs while load snapshot from
> /data/iotdb/m_1229_0fedffd/sbin/../data/datanode/consensus/data_region/1_1/snapshot_1_1672309589275
> org.apache.iotdb.db.exception.DataRegionException: data region
> root.test.g_0[1] is down,{color:#DE350B}* because the time of tsfile
> /data/iotdb/m_1229_0fedffd/sbin/../data/datanode/data/sequence/root.test.g_0/1/2538/1672309581061-39-0-0.tsfile
> is larger than system current time*{color}, file time is 1672309581061 while
> system current time is 1672309479184, please check it.
> at
> org.apache.iotdb.db.engine.storagegroup.DataRegion.checkTsFileTime(DataRegion.java:732)
> at
> org.apache.iotdb.db.engine.storagegroup.DataRegion.getAllFiles(DataRegion.java:691)
> at
> org.apache.iotdb.db.engine.storagegroup.DataRegion.recover(DataRegion.java:429)
> at
> org.apache.iotdb.db.engine.storagegroup.DataRegion.<init>(DataRegion.java:334)
> at
> org.apache.iotdb.db.engine.snapshot.SnapshotLoader.loadSnapshot(SnapshotLoader.java:69)
> at
> org.apache.iotdb.db.engine.snapshot.SnapshotLoader.loadSnapshotWithoutLog(SnapshotLoader.java:134)
> at
> org.apache.iotdb.db.engine.snapshot.SnapshotLoader.loadSnapshotForStateMachine(SnapshotLoader.java:111)
> at
> org.apache.iotdb.db.consensus.statemachine.DataRegionStateMachine.loadSnapshot(DataRegionStateMachine.java:137)
> at
> org.apache.iotdb.consensus.iot.IoTConsensusServerImpl.loadSnapshot(IoTConsensusServerImpl.java:394)
> at
> org.apache.iotdb.consensus.iot.service.IoTConsensusRPCServiceProcessor.triggerSnapshotLoad(IoTConsensusRPCServiceProcessor.java:288)
> at
> org.apache.iotdb.consensus.iot.thrift.IoTConsensusIService$AsyncProcessor$triggerSnapshotLoad.start(IoTConsensusIService.java:1349)
> at
> org.apache.iotdb.consensus.iot.thrift.IoTConsensusIService$AsyncProcessor$triggerSnapshotLoad.start(IoTConsensusIService.java:1292)
> at
> org.apache.thrift.TBaseAsyncProcessor.process(TBaseAsyncProcessor.java:103)
> at
> org.apache.thrift.server.AbstractNonblockingServer$AsyncFrameBuffer.invoke(AbstractNonblockingServer.java:603)
> at org.apache.thrift.server.Invocation.run(Invocation.java:18)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> 测试环境：私有云3期
> DataNode配置
> MAX_HEAP_SIZE="20G"
> MAX_DIRECT_MEMORY_SIZE="6G"
> dn_max_connection_for_internal_service=300
> ConfigNode配置
> MAX_HEAP_SIZE="20G"
> MAX_DIRECT_MEMORY_SIZE="6G"
> 运行BM写入数据，配置见附件。
> 10分钟后执行迁移region：
> 迁移之前的region信息
> !screenshot-1.png!
> 迁移命令
> ./sbin/start-cli.sh -h 172.20.70.4 -e "migrate region 1 from 2 to 3"
> 迁移成功，迁移后的region信息
> !screenshot-2.png!
> 172.20.70.14节点datanode 报错。
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
