Re: manual deletes with TWCS

2017-05-06 Thread Alexander Dejanovski
Hi John, if all your data is TTLed then you'll be fine and purge should happen in due time as long as your sstables don't overlap on timestamp (which can only happen through repair mechanisms). The tombstones will get purged when the ssatble that contain them also fully expire. Cheers Le ven. 5

Re: manual deletes with TWCS

2017-05-05 Thread John Sanda
This is involving TTLed data, and I actually would want to delete all related partitions across all time windows. Let's say I have a time series partitioned by day with a 7 day TTL and a window size of one day. If I delete partitions for the past seven days, would I still run into the issue of

Re: manual deletes with TWCS

2017-05-05 Thread Jon Haddad
You cannot. From Alex’s TLP post: http://thelastpickle.com/blog/2016/12/08/TWCS-part1.html TWCS is no fit for workload that perform deletes on non TTLed data. Consider that SSTables from different time windows will never be compacted