[
https://issues.apache.org/jira/browse/CASSANDRA-14495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16660666#comment-16660666
]
Abdul Patel commented on CASSANDRA-14495:
-----------------------------------------
I see below GC inspector messages, can some help me undertsnad these ?
INFO [Service Thread] 2018-10-22 11:10:22,178 GCInspector.java:284 - G1 Young
Generation GC in 251ms. G1 Eden Space: 729808896 -> 0; G1 Old Gen: 7029653504
-> 7138390512; G1 Survivor Space: 109051904 -> 75497472;
INFO [Service Thread] 2018-10-22 11:16:05,708 GCInspector.java:284 - G1 Young
Generation GC in 209ms. G1 Eden Space: 729808896 -> 0; G1 Old Gen: 4353687552
-> 4483710984;
INFO [Service Thread] 2018-10-22 11:16:08,759 GCInspector.java:284 - G1 Young
Generation GC in 253ms. G1 Eden Space: 729808896 -> 0; G1 Old Gen: 4483710984
-> 4601151480;
INFO [Service Thread] 2018-10-22 11:20:26,201 GCInspector.java:284 - G1 Young
Generation GC in 217ms. G1 Eden Space: 729808896 -> 0; G1 Old Gen: 3602907144
-> 2015954944;
INFO [Service Thread] 2018-10-22 11:20:34,467 GCInspector.java:284 - G1 Young
Generation GC in 206ms. G1 Eden Space: 729808896 -> 0; G1 Old Gen: 1874853896
-> 2052537840;
INFO [Service Thread] 2018-10-22 11:48:32,697 GCInspector.java:284 - G1 Young
Generation GC in 573ms. G1 Eden Space: 10200547328 -> 0; G1 Old Gen: 35824 ->
0; G1 Survivor Space: 100663296 -> 939524096;
INFO [Service Thread] 2018-10-22 11:48:38,038 GCInspector.java:284 - G1 Young
Generation GC in 793ms. G1 Eden Space: 3078619136 -> 0; G1 Old Gen: 0 ->
907214328; G1 Survivor Space: 939524096 -> 394264576;
INFO [Service Thread] 2018-10-22 11:48:39,133 GCInspector.java:284 - G1 Young
Generation GC in 294ms. G1 Eden Space: 461373440 -> 0; G1 Old Gen: 907214328 ->
1291845632; G1 Survivor Space: 394264576 -> 75497472;
INFO [Service Thread] 2018-10-22 11:49:12,405 GCInspector.java:284 - G1 Young
Generation GC in 222ms. G1 Eden Space: 2181038080 -> 0; G1 Old Gen: 3481272304
-> 3677068784; G1 Survivor Space: 251658240 -> 243269632;
INFO [Service Thread] 2018-10-22 11:49:34,485 GCInspector.java:284 - G1 Young
Generation GC in 210ms. G1 Eden Space: 4085252096 -> 0; G1 Survivor Space:
67108864 -> 234881024;
INFO [Service Thread] 2018-10-22 11:49:41,027 GCInspector.java:284 - G1 Young
Generation GC in 208ms. G1 Eden Space: 2290089984 -> 0; G1 Old Gen: 4903141368
-> 5096079352; G1 Survivor Space: 192937984 -> 100663296;
INFO [Service Thread] 2018-10-22 11:49:47,059 GCInspector.java:284 - G1 Young
Generation GC in 229ms. G1 Eden Space: 2113929216 -> 0; G1 Old Gen: 5096079352
-> 5179965448; G1 Survivor Space: 100663296 -> 260046848;
INFO [Service Thread] 2018-10-22 11:49:47,864 GCInspector.java:284 - G1 Young
Generation GC in 240ms. G1 Eden Space: 595591168 -> 0; G1 Old Gen: 5179965448
-> 5456591864; G1 Survivor Space: 260046848 -> 41943040;
INFO [Service Thread] 2018-10-22 11:51:55,126 GCInspector.java:284 - G1 Young
Generation GC in 682ms. G1 Eden Space: 10208935936 -> 0; G1 Old Gen: 2657805472
-> 2663677936; G1 Survivor Space: 92274688 -> 830472192;
INFO [Service Thread] 2018-10-22 11:52:02,632 GCInspector.java:284 - G1 Young
Generation GC in 614ms. G1 Eden Space: 2558525440 -> 0; G1 Old Gen: 2663677936
-> 3467692024; G1 Survivor Space: 830472192 -> 318767104;
INFO [Service Thread] 2018-10-22 11:52:04,595 GCInspector.java:284 - G1 Young
Generation GC in 213ms. G1 Eden Space: 536870912 -> 0; G1 Old Gen: 3467692024
-> 3783262192; G1 Survivor Space: 318767104 -> 83886080;
INFO [Service Thread] 2018-10-22 11:53:41,556 GCInspector.java:284 - G1 Young
Generation GC in 279ms. G1 Eden Space: 10150215680 -> 0; G1 Old Gen: 3793081848
-> 3797276144; G1 Survivor Space: 150994944 -> 662700032;
INFO [Service Thread] 2018-10-22 11:53:51,744 GCInspector.java:284 - G1 Young
Generation GC in 521ms. G1 Eden Space: 7440695296 -> 0; G1 Old Gen: 3797276144
-> 3918572016; G1 Survivor Space: 662700032 -> 998244352;
INFO [Service Thread] 2018-10-22 11:53:52,370 GCInspector.java:284 - G1 Young
Generation GC in 589ms. G1 Eden Space: 8388608 -> 0; G1 Old Gen: 3918572016 ->
4907335664; G1 Survivor Space: 998244352 -> 33554432;
INFO [Service Thread] 2018-10-22 11:54:31,296 GCInspector.java:284 - G1 Young
Generation GC in 253ms. G1 Eden Space: 1937768448 -> 0; G1 Old Gen: 3246391280
-> 3661627384; G1 Survivor Space: 394264576 -> 100663296;
INFO [Service Thread] 2018-10-22 11:54:42,711 GCInspector.java:284 - G1 Young
Generation GC in 210ms. G1 Eden Space: 872415232 -> 0; G1 Old Gen: 3955228664
-> 4215275512; G1 Survivor Space: 260046848 -> 67108864;
INFO [Service Thread] 2018-10-22 11:54:47,487 GCInspector.java:284 - G1 Young
Generation GC in 207ms. G1 Eden Space: 3816816640 -> 0; G1 Survivor Space:
67108864 -> 260046848;
INFO [Service Thread] 2018-10-22 11:54:48,615 GCInspector.java:284 - G1 Young
Generation GC in 212ms. G1 Eden Space: 763363328 -> 0; G1 Old Gen: 4215275512
-> 4466933752; G1 Survivor Space: 260046848 -> 67108864;
> Memory Leak /High Memory usage post 3.11.2 upgrade
> --------------------------------------------------
>
> Key: CASSANDRA-14495
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14495
> Project: Cassandra
> Issue Type: Bug
> Components: Metrics
> Reporter: Abdul Patel
> Priority: Major
> Attachments: cas_heap.txt
>
>
> Hi All,
>
> I recently upgraded my non prod cassandra cluster( 4 nodes single DC) from
> 3.10 to 3.11.2 version.
> No issues reported apart from only nodetool info reporting 80% usage .
> I intially had 16GB memory on each node, later i bumped up to 20GB, and
> rebooted all nodes.
> Waited for an week and now again i have seen memory usage more than 80% ,
> 16GB + .
> this means some memory leaks are happening over the time.
> Any one has faced such issue or do we have any workaround ? my 3.11.2 version
> upgrade rollout has been halted because of this bug.
> ===================================================================
> ID : 65b64f5a-7fe6-4036-94c8-8da9c57718cc
> Gossip active : true
> Thrift active : true
> Native Transport active: true
> Load : 985.24 MiB
> Generation No : 1526923117
> Uptime (seconds) : 1097684
> Heap Memory (MB) : 16875.64 / 20480.00
> Off Heap Memory (MB) : 20.42
> Data Center : DC7
> Rack : rac1
> Exceptions : 0
> Key Cache : entries 3569, size 421.44 KiB, capacity 100 MiB,
> 7931933 hits, 8098632 requests, 0.979 recent hit rate, 14400 save period in
> seconds
> Row Cache : entries 0, size 0 bytes, capacity 0 bytes, 0 hits, 0
> requests, NaN recent hit rate, 0 save period in seconds
> Counter Cache : entries 0, size 0 bytes, capacity 50 MiB, 0 hits, 0
> requests, NaN recent hit rate, 7200 save period in seconds
> Chunk Cache : entries 2361, size 147.56 MiB, capacity 3.97 GiB,
> 2412803 misses, 72594047 requests, 0.967 recent hit rate, NaN microseconds
> miss latency
> Percent Repaired : 99.88086234106282%
> Token : (invoke with -T/--tokens to see all 256 tokens)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org
