刘珍 created IOTDB-3991:
-------------------------
Summary: [ MultiLeaderConsensus ] When there is no new write
operation, some data may be left without synchronization
Key: IOTDB-3991
URL: https://issues.apache.org/jira/browse/IOTDB-3991
Project: Apache IoTDB
Issue Type: Bug
Components: mpp-cluster
Affects Versions: 0.14.0-SNAPSHOT
Reporter: 刘珍
Assignee: 张洪胤
master_0727_975eaa5
问题描述:
MultiLeaderConsensus,写入停止,出现最后写入的部分数据没有被同步到follower。
复现流程:
1. 私有云
172.20.70.2/3/4/5/13/14/16
benchmark在15
ConfigNode
schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
data_region_consensus_protocol_class=org.apache.iotdb.consensus.multileader.MultiLeaderConsensus
schema_replication_factor=3
data_replication_factor=3
MAX_HEAP_SIZE="4G"
DataNode
wal_buffer_size_in_byte=1048576
max_waiting_time_when_insert_blocked=3600000
enable_seq_space_compaction=false
enable_unseq_space_compaction=false
enable_cross_space_compaction=false
query_timeout_threshold=36000000
MAX_HEAP_SIZE="16G"
2. ip15 启动2个bm,连2个datanode
配置文件见附件
3. 运行过程无ERROR
follower同步完成,执行flush。
4. 执行查询
连任一 datanode执行查询
select count(s_4) from root.** align by device
2000条记录的结果值,期望为100000。
实际上有部分序列的值(12条)为 99990( bm的1个batch)
这些数据没有同步到follower节点(几个小时前写入已完成)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)