[ 
https://issues.apache.org/jira/browse/IOTDB-3734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564808#comment-17564808
 ] 

刘珍 commented on IOTDB-3734:
---------------------------

 !screenshot-1.png! 
30分钟监控1次wal各dataregion的大小,写入操作在第6.5个小时完成(红色框),后面的时间是follower在同步日志。
wal文件在减小,测试通过。
https://github.com/apache/iotdb/pull/6630 已解决

> [ wal delete ] No write operations, expired wal files will not be deleted
> -------------------------------------------------------------------------
>
>                 Key: IOTDB-3734
>                 URL: https://issues.apache.org/jira/browse/IOTDB-3734
>             Project: Apache IoTDB
>          Issue Type: Improvement
>          Components: mpp-cluster
>            Reporter: 刘珍
>            Assignee: Haiming Zhu
>            Priority: Major
>              Labels: pull-request-available
>         Attachments: config.properties.1, config.properties.2, 
> screenshot-1.png
>
>
> master_0701_b8efd24  ,MultiLeaderConsensus,3副本 3C3D
> 写入负载压力大,节点同步慢,wal文件会堆积(1个benchmark运行2小时,单个datanode上的某dataregion的wal文件夹大小达290多GB),
> 停止客户端写入,让iotdb 
> 同步完成,wal文件并不删除,{color:#DE350B}*只有再次发生写入操作,才会删除过期的wal文件,需优化。*{color}
> 复现流程
> 1. 192.168.10.62 / 66 / 68
> schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
> data_region_consensus_protocol_class=org.apache.iotdb.consensus.multileader.MultiLeaderConsensus
> schema_replication_factor=3
> data_replication_factor=3
> 2. 启动benchmark 见config.properties.1
> 运行2小时,停止benchmark。
> 3. 等待iotdb 同步数据完成。
> 查看过期的wal 并没有被删除。
> 4. benchmark运行config.properties.2
> 过期的wal文件才会被删除。



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to