Re: Academic paper about Cassandra database compaction

2018-05-15 Thread Jeff Jirsa
On Mon, May 14, 2018 at 11:04 AM, Lucas Benevides < lu...@maurobenevides.com.br> wrote: > Thank you Jeff Jirsa by your comments, > > How can we do this: "fix this by not scheduling the major compaction > until we know all of the sstables in the window are available to be > compacted"? > > Would

Re: Academic paper about Cassandra database compaction

2018-05-14 Thread Lucas Benevides
Hello kooljava2, There aren't many books about Cassandra, but one of the most famous is the "Cassandra: The definitive guide: Distributed Data at Web Scale", by Hewitt The problem is that as Cassandra evolves very fast, these books get out of date quickly. To understand some concepts that exist

Re: Academic paper about Cassandra database compaction

2018-05-14 Thread Lucas Benevides
Thank you Jeff Jirsa by your comments, How can we do this: "fix this by not scheduling the major compaction until we know all of the sstables in the window are available to be compacted"? About the column-family schema, I had to customize the cassandra-stress tool so that it could create a

Re: Academic paper about Cassandra database compaction

2018-05-14 Thread Jeff Jirsa
Interesting! I suspect I know what the increased disk usage in TWCS, and it's a solvable problem, the problem is roughly something like this: - Window 1 has sstables 1, 2, 3, 4, 5, 6 - We start compacting 1, 2, 3, 4 (using STCS-in-TWCS first window) - The TWCS window rolls over - We flush

Re: Academic paper about Cassandra database compaction

2018-05-14 Thread kooljava2
Hello, Thank you Lucas for sharing.  I am still a beginner in Cassandra NoSQL world. Are there any other good books related to Performance tuning and Architecture overview? Thank you. On Monday, 14 May 2018, 07:57:38 GMT-7, Nitan Kainth wrote: Hi Lucas, I am

Re: Academic paper about Cassandra database compaction

2018-05-14 Thread Nitan Kainth
Hi Lucas, I am not able to download. can you share as attachment in email? Regards, Nitan K. Cassandra and Oracle Architect/SME Datastax Certified Cassandra expert Oracle 10g Certified On Mon, May 14, 2018 at 9:12 AM, Lucas Benevides < lu...@maurobenevides.com.br> wrote: > Dear community, >

Academic paper about Cassandra database compaction

2018-05-14 Thread Lucas Benevides
Dear community, I want to tell you about my paper published in a conference in March. The title is " NoSQL Database Performance Tuning for IoT Data - Cassandra Case Study" and it is available (not for free) in http://www.scitepress.org/DigitalLibrary/Link.aspx?doi=10.5220/0006782702770284 .