RE: TWCS: Repair create new buckets with old data

2018-10-24 Thread Meg Mara
Haddad [mailto:j...@jonhaddad.com] Sent: Wednesday, October 24, 2018 1:42 PM To: user Subject: Re: TWCS: Repair create new buckets with old data Hey Meg, a couple thoughts. > Set a table level TTL with TWCS, and stop setting it with inserts/updates > (insert TTL overrides table level TTL). S

Re: TWCS: Repair create new buckets with old data

2018-10-24 Thread Jonathan Haddad
g insert via insert statement with the > application. > > The repair is started each day on one of ten hosts with command : nodetool > --host hostname_# repair –pr > > > > Regards > > Maik > > > > *From:* Meg Mara [mailto:mm...@digitalriver.com ] > *Sent:* Dien

RE: TWCS: Repair create new buckets with old data

2018-10-24 Thread Meg Mara
3.0/cassandra/tools/toolsRepair.html Thank you, Meg From: Caesar, Maik [mailto:maik.cae...@dxc.com] Sent: Wednesday, October 24, 2018 2:17 AM To: user@cassandra.apache.org Subject: RE: TWCS: Repair create new buckets with old data Hi Meg, the ttl (4 month) is set during insert via insert statem

RE: TWCS: Repair create new buckets with old data

2018-10-24 Thread Caesar, Maik
To: user@cassandra.apache.org Subject: RE: TWCS: Repair create new buckets with old data Hi Maik, I noticed in your table description that your default_time_to_live = 0, so where is your TTL property set? At what point do your sstables get tombstoned? Also, could you please mention what kind

RE: TWCS: Repair create new buckets with old data

2018-10-23 Thread Meg Mara
) Thank you, Meg From: Caesar, Maik [mailto:maik.cae...@dxc.com] Sent: Monday, October 22, 2018 10:17 AM To: user@cassandra.apache.org Subject: RE: TWCS: Repair create new buckets with old data Ok, thanks. My conclusion: 1. I will set unchecked_tombstone_compaction to true to get old data

RE: TWCS: Repair create new buckets with old data

2018-10-22 Thread Caesar, Maik
. Regards Maik From: wxn...@zjqunshuo.com [mailto:wxn...@zjqunshuo.com] Sent: Freitag, 19. Oktober 2018 03:58 To: user Subject: RE: TWCS: Repair create new buckets with old data > Is the repair not necessary to get data files remove from filesystem ? The answer is no. IMO, Cassandra will remove ssta

Re: TWCS: Repair create new buckets with old data

2018-10-19 Thread Oleksandr Shulgin
On Fri, Oct 19, 2018 at 11:04 AM Jeff Jirsa wrote: > > I’m mobile and can’t check but it’s this JIRA > > https://issues.apache.org/jira/browse/CASSANDRA-6434 > > And it may be a table level prop, I suppose. Again, I’m not in a position > to confirm. > Indeed, it's called

Re: TWCS: Repair create new buckets with old data

2018-10-19 Thread Jeff Jirsa
> On Oct 19, 2018, at 10:37 AM, Oleksandr Shulgin > wrote: > >> On Fri, Oct 19, 2018 at 10:23 AM Jeff Jirsa wrote: >> It depends on your yaml settings - in newer versions you can have cassandra >> only purge repaired tombstones (and ttl’d data is a tombstone) > > Interesting. Which

Re: TWCS: Repair create new buckets with old data

2018-10-19 Thread Oleksandr Shulgin
On Fri, Oct 19, 2018 at 10:23 AM Jeff Jirsa wrote: > It depends on your yaml settings - in newer versions you can have > cassandra only purge repaired tombstones (and ttl’d data is a tombstone) > Interesting. Which setting is that? Is it 4.0 or 3.x -- I couldn't find anything similar in the

Re: TWCS: Repair create new buckets with old data

2018-10-19 Thread Jeff Jirsa
Caesar, Maik > Date: 2018-10-18 20:30 > To: user@cassandra.apache.org > Subject: RE: TWCS: Repair create new buckets with old data > Hello Simon, > Is the repair not necessary to get data files remove from filesystem ? My > assumption was, that only repaired data will removed after TT

RE: TWCS: Repair create new buckets with old data

2018-10-18 Thread wxn...@zjqunshuo.com
you don't need run repair manually. -Simon From: Caesar, Maik Date: 2018-10-18 20:30 To: user@cassandra.apache.org Subject: RE: TWCS: Repair create new buckets with old data Hello Simon, Is the repair not necessary to get data files remove from filesystem ? My assumption was, that only repai

RE: TWCS: Repair create new buckets with old data

2018-10-18 Thread Caesar, Maik
: TWCS: Repair create new buckets with old data Hi Maik, IMO, when using TWCS, you had better not run repair. The behaviour of TWCS is same with STCS for repair when merging sstables and the result is leaving sstables spanning multiple time buckets, but maybe I'm wrong. In my use case, I don't do

Re: TWCS: Repair create new buckets with old data

2018-10-17 Thread wxn...@zjqunshuo.com
Hi Maik, IMO, when using TWCS, you had better not run repair. The behaviour of TWCS is same with STCS for repair when merging sstables and the result is leaving sstables spanning multiple time buckets, but maybe I'm wrong. In my use case, I don't do repair with table using TWCS. -Simon From: