刘珍 created IOTDB-4700:
-------------------------

             Summary: Flush performance is slow
                 Key: IOTDB-4700
                 URL: https://issues.apache.org/jira/browse/IOTDB-4700
             Project: Apache IoTDB
          Issue Type: Improvement
          Components: mpp-cluster
            Reporter: 刘珍
            Assignee: Haiming Zhu
         Attachments: image-2022-10-20-17-12-15-915.png, 
image-2022-10-20-17-21-01-580.png, image-2022-10-20-17-26-48-200.png, 
image-2022-10-20-17-27-46-815.png

m_1019_f2ffb49
3rep,3C3D

{color:#DE350B}stop-datanode.sh , flushing metadata is slow :
At first , there is only one flush thread (pool-4-IoTDB-Flush-1 )
There are three Dataregions  , so three flush threads should execute in 
parallel{color}
 !image-2022-10-20-17-12-15-915.png! 

1. 192.168.10.72/73/74       48CPU 384GB
ConfigNode
MAX_HEAP_SIZE="8G"
schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
data_region_consensus_protocol_class=org.apache.iotdb.consensus.multileader.MultiLeaderConsensus
schema_replication_factor=3
data_replication_factor=3

DataNode
MAX_HEAP_SIZE="256G"
MAX_DIRECT_MEMORY_SIZE="32G"
max_connection_for_internal_service=300
enable_timed_flush_seq_memtable=true
seq_memtable_flush_interval_in_ms=600000
seq_memtable_flush_check_interval_in_ms=300000
enable_timed_flush_unseq_memtable=true
seq_memtable_flush_interval_in_ms=600000
seq_memtable_flush_check_interval_in_ms=300000
max_waiting_time_when_insert_blocked=3600000
query_timeout_threshold=3600000


2. bm
See the attachment
 !image-2022-10-20-17-21-01-580.png! 

3. benchmark write completed, ip74 datanode synchronization completed


4. stop ip74 datanode
Execute  stop-datanode.sh
before stop datanode:
 !image-2022-10-20-17-26-48-200.png! 

after stop datanode(take snapshot):
 !image-2022-10-20-17-27-46-815.png! 







--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to