RE: Using TTL for data purge

2016-01-25 Thread SEAN_R_DURITY
Thank, I appreciate the correction to my understanding. Sean Durity From: Jeff Jirsa [mailto:jeff.ji...@crowdstrike.com] Sent: Friday, January 22, 2016 1:04 PM To: user@cassandra.apache.org Subject: Re: Using TTL for data purge "As I understand TTL, if there is a compaction of a cell (o

Re: Using TTL for data purge

2016-01-22 Thread Anuj Wadehra
On second thought, If you are anyways reading the user table on each website access and can afford extra IO, first option looks more appropriate as it will ease out the pain of manual purging maintenance and wont need full table scans. ThanksAnuj Sent from Yahoo Mail on Android On Sat, 23

Re: Using TTL for data purge

2016-01-22 Thread Anuj Wadehra
Give a deep thought on your use case. Different user tables/types may have different purge strategy based on how frequently a user account type is usually accessed, whats the user count for each user type and so on. ThanksAnuj Sent from Yahoo Mail on Android On Fri, 22 Jan, 2016 at 11:37 p

Re: Using TTL for data purge

2016-01-22 Thread Anuj Wadehra
Hi Joseph, I am personally in favour of Second approach because I dont want to do lot of IO just because a user is accessing a site several times a day.  Options I see: 1.If you are on SSDs, Test LCS and update TTL of all columns at each access. This will make sure that the system can tolerate

Re: Using TTL for data purge

2016-01-22 Thread Jeff Jirsa
sean_r_dur...@homedepot.com" Reply-To: "user@cassandra.apache.org" Date: Friday, January 22, 2016 at 7:27 AM To: "user@cassandra.apache.org" Subject: RE: Using TTL for data purge An upsert is a second insert. Cassandra’s sstables are immutable. There are no real “overwrites” (of the

RE: Using TTL for data purge

2016-01-22 Thread SEAN_R_DURITY
pdf> From: Joseph TechMails [mailto:jaalex.t...@gmail.com] Sent: Wednesday, December 30, 2015 3:59 AM To: user@cassandra.apache.org Subject: Re: Using TTL for data purge Thanks, Sean. Our usecase is to delete records after few months of inactivity, and that period is fixed, but the TTL cou

Re: Using TTL for data purge

2015-12-30 Thread Joseph TechMails
ed out.) > > > > > > Sean Durity – Lead Cassandra Admin > > *From:* jaalex.tech [mailto:jaalex.t...@gmail.com] > *Sent:* Tuesday, December 22, 2015 4:36 AM > *To:* user@cassandra.apache.org > *Subject:* Using TTL for data purge > > > > Hi, > > > >

RE: Using TTL for data purge

2015-12-29 Thread SEAN_R_DURITY
in the larger and older sstables may rarely, if ever, get compacted out.) Sean Durity – Lead Cassandra Admin From: jaalex.tech [mailto:jaalex.t...@gmail.com] Sent: Tuesday, December 22, 2015 4:36 AM To: user@cassandra.apache.org Subject: Using TTL for data purge Hi, I'm looking for sugges

Using TTL for data purge

2015-12-22 Thread jaalex.tech
Hi, I'm looking for suggestions/caveats on using TTL as a subsitute for a manual data purge job. We have few tables that hold user information - this could be guest or registered users, and there could be between 500K to 1M records created per day per table. Currently, these tables have a seconda