刘珍 created IOTDB-5115:
-------------------------
Summary: [ ConfigNode ] “ConfigNodeRPC-Processor” thread leaks
Key: IOTDB-5115
URL: https://issues.apache.org/jira/browse/IOTDB-5115
Project: Apache IoTDB
Issue Type: Bug
Components: mpp-cluster
Affects Versions: 1.0.0
Reporter: 刘珍
Assignee: Gaofei Cao
Attachments: image-2022-12-05-09-13-14-368.png
rel/1.0 fbbca3f ,1副本,schema/data region CUSTOM 策略
启动1个datanode,启动1个BM连接这个datanode创建元数据,每个序列写入1个点。
再启动到第15个datanode,15个BM创建原数据时,元数据不能继续创建(实际创建144799 设备,预期应该创建150000),ConfigNode
Leader 的ConfigNodeRPC-Processor线程数在不断增长:
!image-2022-12-05-09-13-14-368.png!
测试环境-私有云1期
1.172.16.2.2~22 是DataNode(共21台 8C32GB)
BM :172.16.2.26~46 运行BM (共21台 4C16GB)
ConfigNode :172.16.2.23~25 (共3台 8C32GB)
配置参数
#
config_node_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
#
schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
#
data_region_consensus_protocol_class=org.apache.iotdb.consensus.iot.IoTConsensus
# schema_replication_factor=1
# data_replication_factor=1
schema_region_group_extension_policy=CUSTOM
schema_region_group_per_database=6
data_region_group_extension_policy=CUSTOM
data_region_group_per_database=8
time_partition_interval=60480000000
ConfigNode配置
MAX_HEAP_SIZE="20G"
MAX_DIRECT_MEMORY_SIZE="6G"
cn_target_config_node_list=172.16.2.23:22277
DataNode配置
MAX_HEAP_SIZE="20G"
MAX_DIRECT_MEMORY_SIZE="6G"
dn_data_dirs=data/datanode/data,/data1/iotdb/datanode/data
dn_target_config_node_list=172.16.2.23:22277,172.16.2.24:22277,172.16.2.25:22277
Common 配置
#
config_node_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
#
schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
#
data_region_consensus_protocol_class=org.apache.iotdb.consensus.iot.IoTConsensus
# schema_replication_factor=1
# data_replication_factor=1
schema_region_group_extension_policy=CUSTOM
schema_region_group_per_database=6
data_region_group_extension_policy=CUSTOM
data_region_group_per_database=8
time_partition_interval=60480000000
2. BM配置
DB_SWITCH=IoTDB-014-SESSION_BY_TABLET
########### Data Mode ###########
GROUP_NUMBER=1
DEVICE_NUMBER=10000
REAL_INSERT_RATE=1.0
SENSOR_NUMBER=100
IS_SENSOR_TS_ALIGNMENT=true
IS_OUT_OF_ORDER=false
OUT_OF_ORDER_RATIO=0.5
########### Data Amount ###########
OPERATION_PROPORTION=1:0:0:0:0:0:0:0:0:0:0
CLIENT_NUMBER=15
LOOP=1
BATCH_SIZE_PER_WRITE=1
START_TIME=2018-8-29T00:00:00+08:00
POINT_STEP=100
OP_MIN_INTERVAL=0
OP_MIN_INTERVAL_RANDOM=false
INSERT_DATATYPE_PROPORTION=1:1:1:1:1:1
ENCODINGS=PLAIN/PLAIN/PLAIN/PLAIN/PLAIN/PLAIN
COMPRESSOR=SNAPPY
########### Other Param ###########
IS_DELETE_DATA=false
CREATE_SCHEMA=true
3. 日志
ConfigNode Leader
172.16.2.23
/data/iotdb/rel_1202_fbbca3f/logs_confignode_thread_leak
--
This message was sent by Atlassian Jira
(v8.20.10#820010)