[jira] [Commented] (IOTDB-3802) [ raft log ] Raft log takes up a lot of disk space

[Jira]

    [ 
https://issues.apache.org/jira/browse/IOTDB-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17567104#comment-17567104
 ] 

刘珍 commented on IOTDB-3802:
---------------------------

master_0713_7d0f517
ratis，3副本3C3D，停止写入，同步完成，有2个datanode的raft log 做了几次snapshot后，就没再执行snapshot，导致raft 
log大（282GB）。
 !screenshot-1.png! 
192.168.130.3/4/5   路径  /data2/cluster_test/master_0713_7d0f517

> [ raft log ] Raft log takes up a lot of disk space
> --------------------------------------------------
>
>                 Key: IOTDB-3802
>                 URL: https://issues.apache.org/jira/browse/IOTDB-3802
>             Project: Apache IoTDB
>          Issue Type: Improvement
>          Components: mpp-cluster
>            Reporter: 刘珍
>            Assignee: Song Ziyang
>            Priority: Major
>         Attachments: config.properties, image-2022-07-12-10-41-14-126.png, 
> screenshot-1.png
>
>
> master_0711_d1dd425 
> RatisConsensus ,3副本3C3D
> benchmark写入完成（配置文件见附件），所有节点同步完成，执行flush。
> raft log占用磁盘空间大：
> 4个dataregion的raft log分别是8.3GB/5.8GB/46GB/27GB
> 如果节点数/dataregion数比较多，磁盘占用会更大。需优化。
>  !image-2022-07-12-10-41-14-126.png! 
> 复现流程
> 1. 192.168.10.62 /66 /68
> schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
> data_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
> schema_replication_factor=3
> data_replication_factor=3
> max_waiting_time_when_insert_blocked=36000000
> query_timeout_threshold=36000000
> 2. benchmark 配置见附件
> 约10.26小时
> 3. 写入完成执行flush



--
This message was sent by Atlassian Jira
(v8.20.10#820010)