I would say you are better off spreading out the deletes so compactions have the best chance of actually removing them from disk before they become a problem. You will likely need to pay close attempting to compaction strategy tuning.
I don’t have any personal experience with it but you may also want to check out deleting compaction strategy to see if it works for your use case: https://github.com/protectwise/cassandra-util/tree/master/deleting-compaction-strategy Cheers Ben On Wed, 7 Mar 2018 at 17:19 Charulata Sharma (charshar) <chars...@cisco.com> wrote: > Well it’s not like that. We don’t just purge. There are business rules > which will decide the records to be purged or archived and then purged, so > cannot rely on TTL. > > > > Thanks, > > Charu > > > > *From: *Jens Rantil <jens.ran...@tink.se> > *Reply-To: *"user@cassandra.apache.org" <user@cassandra.apache.org> > *Date: *Tuesday, March 6, 2018 at 12:34 AM > *To: *"user@cassandra.apache.org" <user@cassandra.apache.org> > *Subject: *Re: One time major deletion/purge vs periodic deletion > > > > Sounds like you are using Cassandra as a queue. It's an antibiotic > pattern. What I would do would be to rely on TTL for removal of data and > use the TWCS compaction strategy to handle removal and you just focus on > insertion. > > On Tue, Mar 6, 2018, 07:39 Charulata Sharma (charshar) <chars...@cisco.com> > wrote: > > Hi, > > > > Wanted the community’s feedback on deciding the schedule of Archive > and Purge job. > > Is it better to Purge a large volume of data at regular intervals (like > run A&P jobs once in 3 months ) or purge smaller amounts more frequently > (run the job weekly??) > > > > Some estimates on the number of deletes performed would be…upto 80-90K > rows purged in 3 months vs 10K deletes every week ?? > > > > Thanks, > > Charu > > > > -- > > Jens Rantil > Backend Developer @ Tink > > Tink AB, Wallingatan 5, 111 60 Stockholm, Sweden > <https://maps.google.com/?q=Wallingatan+5,+111+60+Stockholm,+Sweden&entry=gmail&source=g> > For urgent matters you can reach me at +46-708-84 18 32. > -- *Ben Slater* *Chief Product Officer <https://www.instaclustr.com/>* <https://www.facebook.com/instaclustr> <https://twitter.com/instaclustr> <https://www.linkedin.com/company/instaclustr> Read our latest technical blog posts here <https://www.instaclustr.com/blog/>. This email has been sent on behalf of Instaclustr Pty. Limited (Australia) and Instaclustr Inc (USA). This email and any attachments may contain confidential and legally privileged information. If you are not the intended recipient, do not copy or disclose its content, but please reply to this email immediately and highlight the error to the sender and then immediately delete the message.
