Re: TWCS generates large numbers of sstables on only some nodes

2019-07-16 Thread Jeff Jirsa
On Tue, Jul 16, 2019 at 8:54 AM Carl Mueller wrote: > stays consistently in the 40-60 range, but only recent tables are being > compacted. > > What I fear is that TWCS when it hits a certain compaction threshold keeps > compacting the same tables adding a slice of the most recently flushed data

Re: TWCS generates large numbers of sstables on only some nodes

2019-07-16 Thread Oleksandr Shulgin
On Tue, Jul 16, 2019 at 5:54 PM Carl Mueller wrote: > stays consistently in the 40-60 range, but only recent tables are being > compacted. > I would be alarmed at this point. It definitely feels like not aggressive enough compaction: can you relax the throttling or afford to have more

Re: TWCS generates large numbers of sstables on only some nodes

2019-07-16 Thread Carl Mueller
stays consistently in the 40-60 range, but only recent tables are being compacted. What I fear is that TWCS when it hits a certain compaction threshold keeps compacting the same tables adding a slice of the most recently flushed data and falls behind. I'd rather it compacted fragments of sstable