Re: LCS Increasing the sstable size

2016-08-31 Thread Jérôme Mainaud
Hello DuyHai, I have no problem with performance even if I'm using 3 HDD in RAID 0. Last 4 years of data were imported in two weeks with is acceptable for the client. Daily data will be much less intensive and my client is more concerned with storage price than with pure latency. To be more

Re: LCS Increasing the sstable size

2016-08-31 Thread DuyHai Doan
Some random thoughts 1) Are they using SSD ? 2) If using SSD, I remember that one recommendation is not to exceed ~3Tb/node, unless they're using DateTiered or better TimeWindow compaction strategy 3) LCS is very disk intensive and usually exacerbates write amp the more you have data 4) The

LCS Increasing the sstable size

2016-08-31 Thread Jérôme Mainaud
Hello, My cluster use LeveledCompactionStrategy on rather big nodes (9 TB disk per node with a target of 6 TB of data and the 3 remaining TB are reserved for compaction and snapshots). There is only one table for this application. With default sstable_size_in_mb at 160 MB, we have a huge number