GitHub user twoholes added a comment to the discussion: Memory Leak in KVROCKS？
I am using kvrocks version 2.11.1 with the following configurations:
rocksdb.block_cache_size 1000, rocksdb.max_write_buffer_number 16, and
rocksdb.write_buffer_size 64. After running tests for a period, I found that
the memory usage increased to 4.5 GB. According to my understanding, the memory
usage should be around block_cache (1 GB) + memtable (1 GB) = 2 GB. Since
RocksDB uses jemalloc, the resident memory is 1.4 GB. Why, then, does the
memory usage rise to 4.5 GB?
Detailed kvrocks Configuration:
slowlog-max-len 128
cluster-enabled yes
rocksdb.max_write_buffer_number 16
rocksdb.write_buffer_size 64
rocksdb.max_background_jobs 4
rocksdb.max_bytes_for_level_base 2147483647
rocksdb.use_direct_io_for_flush_and_compaction yes
rocksdb.compression no
workers 16
max-replication-mb 500
migrate-batch-rate-limit-mb 64
persist-cluster-nodes-enabled no
dir /data
pidfile /data/kvrocks.pid
log-dir /lingtian/logs/app
backup-dir /data/backup
bind 0.0.0.0
port 8888
log-retention-days 1
maxclients 60001
rocksdb.block_size 4096
migrate-speed 0
migrate-pipeline-size 64
migrate-batch-size-kb 64
tcp-backlog 4096
log-level warning
slowlog-log-slower-than 20000
rocksdb.level0_file_num_compaction_trigger 8
rocksdb.min_write_buffer_number_to_merge 4
rocksdb.max_sub_compactions 1
rocksdb.compaction_readahead_size 1048576
rocksdb.level0_slowdown_writes_trigger 30
rocksdb.level0_stop_writes_trigger 60
rocksdb.level0_file_num_compaction_trigger 8
rocksdb.stats_dump_period_sec 60
rocksdb.min_write_buffer_number_to_merge 4
rocksdb.stats_dump_period_sec 60
rocksdb.enable_pipelined_write yes
rocksdb.use_direct_reads no
migrate-type raw-key-value
rocksdb.max_subcompactions 1
rocksdb.wal_ttl_seconds 3600
rocksdb.wal_size_limit_mb 32768
requirepass lkC55kQ40O
masterauth lkC55kQ40O
max-db-size 160
rocksdb.block_cache_size 1000
rocksdb.cache_index_and_filter_blocks yes
jemalloc Statistics:
allocated nmalloc (#/sec) ndalloc
(#/sec) nrequests (#/sec) nfill (#/sec) nflush
(#/sec)
small: 1041185624 2869758745 40679 2868831004
40666 297726959299 4220323 238617686 3382 165571637
2347
large: 75034624 395315 5 394354
5 416490 5 395315 5 36853
0
total: 1116220248 2870154060 40684 2869225358
40671 297727375789 4220329 239013001 3388 165608490
2347
active: 1252102144
mapped: 1602326528
retained: 8815276032
base: 235655312
internal: 897024
metadata_thp: 0
tcache_bytes: 2981912
tcache_stashed_bytes: 0
resident: 1487855616
abandoned_vm: 0
extent_avail: 1286066
GitHub link:
https://github.com/apache/kvrocks/discussions/2784#discussioncomment-12231493
----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]
