刘珍 created IOTDB-3276:
-------------------------
Summary: [ datanode restart ] tsfile is all deleted (
[CrossSpaceCompaction] Delete TsFile)
Key: IOTDB-3276
URL: https://issues.apache.org/jira/browse/IOTDB-3276
Project: Apache IoTDB
Issue Type: Bug
Components: Core/Compaction
Affects Versions: 0.14.0-SNAPSHOT
Reporter: 刘珍
Assignee: 周沛辰
Attachments: image-2022-05-24-13-19-18-400.png
master_0523_51e9703
问题描述:
1. 单副本data_replication_factor=1
3confignode,3datanode
2.bm连node1,写入数据(如root.sg1.dev1),数据在node1。
kill node1的datanode进程。
3. bm连node2,写入数据(root.sg1.dev2),数据在node2。
4. 启动node1的datanode,node1上的tsfile被完全删除:
2022-05-24 12:36:20,574 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/sequence/root.test.g_0/1/0/1653363632954-1-0-0.tsfile.
2022-05-24 12:36:20,574 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/sequence/root.test.g_0/1/0/1653363736139-2-0-0.tsfile.
2022-05-24 12:36:20,574 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/sequence/root.test.g_0/1/0/1653363838825-3-0-0.tsfile.
2022-05-24 12:36:20,574 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/sequence/root.test.g_0/1/0/1653363941370-4-0-0.tsfile.
2022-05-24 12:36:20,574 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/sequence/root.test.g_0/1/0/1653364044379-5-0-0.tsfile.
2022-05-24 12:36:20,574 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/sequence/root.test.g_0/1/0/1653364148312-6-0-0.tsfile.
2022-05-24 12:36:20,575 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/sequence/root.test.g_0/1/0/1653364251418-7-0-0.tsfile.
2022-05-24 12:36:20,575 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/sequence/root.test.g_0/1/0/1653364354126-8-0-0.tsfile.
2022-05-24 12:36:20,575 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/sequence/root.test.g_0/1/0/1653364456635-9-0-0.tsfile.
2022-05-24 12:36:20,575 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/sequence/root.test.g_0/1/0/1653364559232-10-0-0.tsfile.
2022-05-24 12:36:20,575 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/unsequence/root.test.g_0/1/0/1653366964624-11-0-0.tsfile.
2022-05-24 12:36:20,575 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/unsequence/root.test.g_0/1/0/1653366965016-12-0-0.tsfile.
2022-05-24 12:36:20,575 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/unsequence/root.test.g_0/1/0/1653366965401-13-0-0.tsfile.
2022-05-24 12:36:20,575 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/unsequence/root.test.g_0/1/0/1653366965655-14-0-0.tsfile.
2022-05-24 12:36:20,575 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/unsequence/root.test.g_0/1/0/1653366965862-15-0-0.tsfile.
2022-05-24 12:36:20,576 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/unsequence/root.test.g_0/1/0/1653366966373-16-0-0.tsfile.
2022-05-24 12:36:20,576 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/unsequence/root.test.g_0/1/0/1653366966559-17-0-0.tsfile.
2022-05-24 12:36:20,576 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/unsequence/root.test.g_0/1/0/1653366966741-18-0-0.tsfile.
2022-05-24 12:36:20,576 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/unsequence/root.test.g_0/1/0/1653366966966-19-0-0.tsfile.
2022-05-24 12:36:20,576 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:264 - [CrossSpaceCompaction] Delete
TsFile
:/data3/cluster_test/master_0523_51e9703/datanode/./sbin/../data/data/unsequence/root.test.g_0/1/0/1653366967152-20-0-0.tsfile.
2022-05-24 12:36:20,577 [pool-7-IoTDB-Compaction-1] INFO
o.a.i.d.e.c.c.CrossSpaceCompactionTask:155 - root.test.g_0-1 [Compaction]
CrossSpaceCompactionTask Costs 0 s, compaction speed is Infinity MB/s
!image-2022-05-24-13-19-18-400.png!
复现流程:
1. 3台测试机器192.168.130.3/4/5
confignode,datanode的配置文件见附件。
2. bm配置文件见附件(1_config.properties连ip-3)
/home/benchmark/bm_20220322
3. bm写入完成(约17分钟)
kill ip-3的datanode进程
4. bm配置文件见附件(2_config.properties连ip-4)
bm写入完成
5. 启动ip-3的datanode服务
查看恢复日志与原始数据(ip-3上的原始数据)
select s_42 from root.**
select s_42 from root.test.g_0.test.schema_t.d_0
结果为空。
--
This message was sent by Atlassian Jira
(v8.20.7#820007)