Re: TWCS and gc_grace_seconds

2019-10-26 Thread Jon Haddad
My coworker Radovan wrote up a post on the relationship between gc grace and hinted handoff: https://thelastpickle.com/blog/2018/03/21/hinted-handoff-gc-grace-demystified.html Jon On Sat, Oct 26, 2019 at 6:45 AM Hossein Ghiyasi Mehr wrote: > It needs to change gc_grace_seconds carefully because

Re: TWCS and gc_grace_seconds

2019-10-26 Thread Hossein Ghiyasi Mehr
It needs to change gc_grace_seconds carefully because it has side effect on hinted handoff. On Fri, Oct 18, 2019 at 5:04 PM Paul Chandler wrote: > Hi Adarsh, > > You will have problems if you manually delete data when using TWCS. > > To fully understand why, I recommend reading this The Last Pic

Re: TWCS and gc_grace_seconds

2019-10-18 Thread Paul Chandler
Hi Adarsh, You will have problems if you manually delete data when using TWCS. To fully understand why, I recommend reading this The Last Pickle post: https://thelastpickle.com/blog/2016/12/08/TWCS-part1.html And this post I wrote that dives deeper into the problems with deletes: http://www.red

Re: TWCS and gc_grace_seconds

2019-10-18 Thread Adarsh Kumar
Thanks Jeff, I just checked with business and we have differences in having TTL. So it will be manula purging always. We do not want to use LCS due to high IOs. So: 1. As the use case is of time series data model, TWCS will be give some benefit (without TTL) and with frequent deleted data

Re: TWCS and gc_grace_seconds

2019-10-17 Thread Jeff Jirsa
Is everything in the table TTL’d? Do you do explicit deletes before the data is expected to expire ? Generally speaking, gcgs exists to prevent data resurrection. But ttl’d data can’t be resurrected once it expires, so gcgs has no purpose unless you’re deleting it before the ttl expires. If y

TWCS and gc_grace_seconds

2019-10-17 Thread Adarsh Kumar
Hi, We have a use case of time series data with TTL where we want to use TimeWindowCompactionStrategy because of its better management for TTL and tombstones. In this case, data we have is frequently deleted so we want to reduce gc_grace_seconds to reduce the tombstones' life and reduce pressure o