[
https://issues.apache.org/jira/browse/CASSANDRA-10253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14732184#comment-14732184
]
vijay commented on CASSANDRA-10253:
-----------------------------------
Marcus,
The Issue 2 i reported is: In my normal data Ingest process i am seeing 10 or
20 max ssables how ever when we starts running nodetool incrimental repair
ssatbable count grows to few thousands, i had seen ssable table count grows
from 20 to 100K small sstables, and compactions never stops compacting these
sstables. I am seeing this issue only when using DTCS and repair process.
let me know your thoughts.
> Incremental repairs not working as expected with DTCS
> -----------------------------------------------------
>
> Key: CASSANDRA-10253
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10253
> Project: Cassandra
> Issue Type: Bug
> Components: Core
> Environment: Pre-prod
> Reporter: vijay
> Assignee: Marcus Eriksson
> Labels: dtcs
> Fix For: 2.1.x
>
> Attachments: sstablemetadata-cluster-logs.zip, systemfiles 2.zip
>
>
> HI,
> we are ingesting data 6 million records every 15 mins into one DTCS table and
> relaying on Cassandra for purging the data.Table Schema given below, Issue 1:
> we are expecting to see table sstable created on day d1 will not be compacted
> after d1 how we are not seeing this, how ever i see some data being purged at
> random intervals
> Issue 2: when we run incremental repair using "nodetool repair keyspace table
> -inc -pr" each sstable is splitting up to multiple smaller SStables and
> increasing the total storage.This behavior is same running repairs on any
> node and any number of times
> There are mutation drop's in the cluster
> Table:
> {code}
> CREATE TABLE TableA (
> F1 text,
> F2 int,
> createts bigint,
> stats blob,
> PRIMARY KEY ((F1,F2), createts)
> ) WITH CLUSTERING ORDER BY (createts DESC)
> AND bloom_filter_fp_chance = 0.01
> AND caching = '{"keys":"ALL", "rows_per_partition":"NONE"}'
> AND comment = ''
> AND compaction = {'min_threshold': '12', 'max_sstable_age_days': '1',
> 'base_time_seconds': '50', 'class':
> 'org.apache.cassandra.db.compaction.DateTieredCompactionStrategy'}
> AND compression = {'sstable_compression':
> 'org.apache.cassandra.io.compress.LZ4Compressor'}
> AND dclocal_read_repair_chance = 0.0
> AND default_time_to_live = 93600
> AND gc_grace_seconds = 3600
> AND max_index_interval = 2048
> AND memtable_flush_period_in_ms = 0
> AND min_index_interval = 128
> AND read_repair_chance = 0.0
> AND speculative_retry = '99.0PERCENTILE';
> {code}
> Thanks
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
