[
https://issues.apache.org/jira/browse/CASSANDRA-8066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169775#comment-14169775
]
Benoit Lacelle commented on CASSANDRA-8066:
-------------------------------------------
Here is the output for nodetool cfstats
{code}
Keyspace: prod_7
Read Count: 1424130
Read Latency: 3.122707294980093 ms.
Write Count: 8808265
Write Latency: 0.03234213866181365 ms.
Pending Flushes: 0
Table: alerts
SSTable count: 2
Space used (live), bytes: 10237
Space used (total), bytes: 10237
Space used by snapshots (total), bytes: 0
SSTable Compression Ratio: 0.6354418105671432
Memtable cell count: 0
Memtable data size, bytes: 0
Memtable switch count: 0
Local read count: 0
Local read latency: NaN ms
Local write count: 0
Local write latency: NaN ms
Pending flushes: 0
Bloom filter false positives: 0
Bloom filter false ratio: 0.00000
Bloom filter space used, bytes: 32
Compacted partition minimum bytes: 259
Compacted partition maximum bytes: 372
Compacted partition mean bytes: 341
Average live cells per slice (last five minutes): 0.0
Average tombstones per slice (last five minutes): 0.0
Table: details
SSTable count: 103
Space used (live), bytes: 578266489
Space used (total), bytes: 578266489
Space used by snapshots (total), bytes: 0
SSTable Compression Ratio: 0.724988344517149
Memtable cell count: 67212
Memtable data size, bytes: 18468770
Memtable switch count: 23
Local read count: 6
Local read latency: 10.742 ms
Local write count: 2036971
Local write latency: 0.017 ms
Pending flushes: 0
Bloom filter false positives: 0
Bloom filter false ratio: 0.00000
Bloom filter space used, bytes: 5136
Compacted partition minimum bytes: 87
Compacted partition maximum bytes: 129557750
Compacted partition mean bytes: 2595076
Average live cells per slice (last five minutes):
0.3333333333333333
Average tombstones per slice (last five minutes): 0.0
Table: domains
SSTable count: 21
Space used (live), bytes: 122407
Space used (total), bytes: 122407
Space used by snapshots (total), bytes: 0
SSTable Compression Ratio: 0.5848437821906775
Memtable cell count: 238238
Memtable data size, bytes: 2793
Memtable switch count: 1
Local read count: 60281
Local read latency: 0.162 ms
Local write count: 402903
Local write latency: 0.012 ms
Pending flushes: 0
Bloom filter false positives: 25
Bloom filter false ratio: 0.08929
Bloom filter space used, bytes: 664
Compacted partition minimum bytes: 87
Compacted partition maximum bytes: 372
Compacted partition mean bytes: 171
Average live cells per slice (last five minutes):
0.9985401459854014
Average tombstones per slice (last five minutes): 0.0
Table: domains_statistics
SSTable count: 7
Space used (live), bytes: 302413
Space used (total), bytes: 302413
Space used by snapshots (total), bytes: 0
SSTable Compression Ratio: 0.6144160676068052
Memtable cell count: 849893
Memtable data size, bytes: 42569
Memtable switch count: 1
Local read count: 60511
Local read latency: 0.141 ms
Local write count: 1055892
Local write latency: 0.013 ms
Pending flushes: 0
Bloom filter false positives: 0
Bloom filter false ratio: 0.00000
Bloom filter space used, bytes: 416
Compacted partition minimum bytes: 87
Compacted partition maximum bytes: 24601
Compacted partition mean bytes: 3795
Average live cells per slice (last five minutes):
0.9894160583941606
Average tombstones per slice (last five minutes): 0.0
Table: latest_urls
SSTable count: 3
Space used (live), bytes: 10239518
Space used (total), bytes: 10239518
Space used by snapshots (total), bytes: 559781
SSTable Compression Ratio: 0.20808927427548127
Memtable cell count: 0
Memtable data size, bytes: 0
Memtable switch count: 0
Local read count: 0
Local read latency: NaN ms
Local write count: 0
Local write latency: NaN ms
Pending flushes: 0
Bloom filter false positives: 0
Bloom filter false ratio: 0.00000
Bloom filter space used, bytes: 1400
Compacted partition minimum bytes: 125
Compacted partition maximum bytes: 5839588
Compacted partition mean bytes: 457273
Average live cells per slice (last five minutes): 0.0
Average tombstones per slice (last five minutes): 0.0
Table: prices
SSTable count: 65
Space used (live), bytes: 1352522066
Space used (total), bytes: 1352522066
Space used by snapshots (total), bytes: 0
SSTable Compression Ratio: 0.5120312303948739
Memtable cell count: 34010
Memtable data size, bytes: 8204495
Memtable switch count: 23
Local read count: 1235465
Local read latency: 1.262 ms
Local write count: 1073392
Local write latency: 0.028 ms
Pending flushes: 0
Bloom filter false positives: 0
Bloom filter false ratio: 0.00000
Bloom filter space used, bytes: 4024
Compacted partition minimum bytes: 150
Compacted partition maximum bytes: 802187438
Compacted partition mean bytes: 16664521
Average live cells per slice (last five minutes):
3.2496266587883915
Average tombstones per slice (last five minutes): 0.0
Table (index): urls.price_bucket
SSTable count: 2
SSTables in each level: [2, 0, 0, 0, 0, 0, 0, 0, 0]
Space used (live), bytes: -63707053
Space used (total), bytes: -63707053
Space used by snapshots (total), bytes: 0
SSTable Compression Ratio: 0.25296860730951387
Memtable cell count: 3313
Memtable data size, bytes: 581313
Memtable switch count: 0
Local read count: 229
Local read latency: 0.611 ms
Local write count: 2849164
Local write latency: 0.019 ms
Pending flushes: 0
Bloom filter false positives: 0
Bloom filter false ratio: 0.00000
Bloom filter space used, bytes: 4944
Compacted partition minimum bytes: 73
Compacted partition maximum bytes: 107964792
Compacted partition mean bytes: 72761
Average live cells per slice (last five minutes):
6.9475982532751095
Average tombstones per slice (last five minutes):
0.043668122270742356
Table: urls
SSTable count: 8
SSTables in each level: [1, 7, 0, 0, 0, 0, 0, 0, 0]
Space used (live), bytes: 1559974255
Space used (total), bytes: 1559974255
Space used by snapshots (total), bytes: 0
SSTable Compression Ratio: 0.245083421589559
Memtable cell count: 18694
Memtable data size, bytes: 2717755
Memtable switch count: 76
Local read count: 67637
Local read latency: 42.431 ms
Local write count: 1389930
Local write latency: 0.110 ms
Pending flushes: 0
Bloom filter false positives: 0
Bloom filter false ratio: 0.00000
Bloom filter space used, bytes: 416
Compacted partition minimum bytes: 61
Compacted partition maximum bytes: 1386179893
Compacted partition mean bytes: 34941561
Average live cells per slice (last five minutes):
4831.0001626328785
Average tombstones per slice (last five minutes): 0.0
Table: urls_statistics
SSTable count: 5
Space used (live), bytes: 180362447
Space used (total), bytes: 180362447
Space used by snapshots (total), bytes: 0
SSTable Compression Ratio: 0.35160611896275673
Memtable cell count: 7
Memtable data size, bytes: 601
Memtable switch count: 1
Local read count: 2
Local read latency: 9.025 ms
Local write count: 19
Local write latency: 0.068 ms
Pending flushes: 0
Bloom filter false positives: 0
Bloom filter false ratio: 0.00000
Bloom filter space used, bytes: 2800
Compacted partition minimum bytes: 104
Compacted partition maximum bytes: 74975550
Compacted partition mean bytes: 4751784
Average live cells per slice (last five minutes): 0.0
Average tombstones per slice (last five minutes): 0.0
Table: user_prices
SSTable count: 0
Space used (live), bytes: 0
Space used (total), bytes: 0
Space used by snapshots (total), bytes: 0
SSTable Compression Ratio: 0.0
Memtable cell count: 0
Memtable data size, bytes: 0
Memtable switch count: 0
Local read count: 0
Local read latency: NaN ms
Local write count: 0
Local write latency: NaN ms
Pending flushes: 0
Bloom filter false positives: 0
Bloom filter false ratio: 0.00000
Bloom filter space used, bytes: 0
Compacted partition minimum bytes: 0
Compacted partition maximum bytes: 0
Compacted partition mean bytes: 0
Average live cells per slice (last five minutes): 0.0
Average tombstones per slice (last five minutes): 0.0
{code}
> High Heap Consumption due to high number of SSTableReader
> ---------------------------------------------------------
>
> Key: CASSANDRA-8066
> URL: https://issues.apache.org/jira/browse/CASSANDRA-8066
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Environment: Cassandra 2.1.0
> Reporter: Benoit Lacelle
> Assignee: T Jake Luciani
> Fix For: 2.1.1
>
>
> Given a workload with quite a lot of reads, I recently encountered high heap
> memory consumption. Given 2GB of Heap, it appears I have 750.000+ tasks in
> SSTableReader.syncExecutor, consuming more than 1.2GB. These tasks have type
> SSTableReader$5, which I guess corresponds to :
> {code}
> readMeterSyncFuture = syncExecutor.scheduleAtFixedRate(new Runnable()
> {
> public void run()
> {
> if (!isCompacted.get())
> {
> meterSyncThrottle.acquire();
> SystemKeyspace.persistSSTableReadMeter(desc.ksname, desc.cfname,
> desc.generation, readMeter);
> }
> }
> }, 1, 5, TimeUnit.MINUTES);
> {code}
> I do not have have to the environment right now, but I could provide a
> threaddump later if necessary.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
