Re: TWCS: 2.2 ring expand massive overstream 100000 sstables

2019-07-10 Thread Carl Mueller
So I looked at the code and the compaction seems to concentrate / find "most interesting" the newer buckets for compaction. Our problem is that we have a huge fragmented number of sstables in buckets that are a few days old. (not yet expired, our expiration is 7 days), so the sstable selection

TWCS: 2.2 ring expand massive overstream 100000 sstables

2019-07-09 Thread Carl Mueller
The existing 15 node cluster had about 450-500GB/node, most in one TWCS table. Data is applied with a 7-day TTL. Our cluster couldn't be expanded due to a bit of political foot dragging and new load of about 2x-3x started up around the time we started expanding. about 500 sstables per node, with