Re: Maximum SSTable size

2018-06-27 Thread Jeff Jirsa
That’s a target and not a maximum, and it can go over that even on LCS with 
wide partitions

In general, the practical limit is hundreds of gigabytes (I’ve seen 500-600 a 
lot, but not more than a terabyte very often). You’ll typically hit other 
issues and need to tune some params before you hit hard caps (unless you know 
what you’re doing).

-- 
Jeff Jirsa


> On Jun 27, 2018, at 3:11 PM, ZAIDI, ASAD A  wrote:
> 
> With  Leveled compaction strategy  , you can set target size with 
> sstable_size_in_mb attribute however actual size can still be larger than 
> target given large partition size.
>  
> Thanks/Asad
>  
> From: Lucas Benevides [mailto:lu...@maurobenevides.com.br] 
> Sent: Wednesday, June 27, 2018 7:02 AM
> To: user@cassandra.apache.org
> Subject: Maximum SSTable size
>  
> Hello Community,
>  
> Is there a maximum SSTable Size?  
> If there is not, does it go up to the maximum Operational System values? 
>  
> Thanks in advance,
> Lucas Benevides


Re: [External] Maximum SSTable size

2018-06-27 Thread Tom van der Woerdt
I’ve had SSTables as big as 11TB. It works, read performance is fine. But,
compaction is hell, because you’ll need twice that in disk space and it
will take many hours 🙂

Avoid large SSTables unless you really know what you’re doing. LCS is a
great default for almost every workload, especially if your cluster has a
single large table. STCS is the actual Cassandra default but it often
causes more trouble than it solves, because of large SSTables 🙂

Hope that helps!

Tom


On Wed, 27 Jun 2018 at 08:02, Lucas Benevides 
wrote:

> Hello Community,
>
> Is there a maximum SSTable Size?
> If there is not, does it go up to the maximum Operational System values?
>
> Thanks in advance,
> Lucas Benevides
>
-- 
Tom van der Woerdt
Site Reliability Engineer

Booking.com B.V.
Vijzelstraat 66-80 Amsterdam 1017HL Netherlands
Direct +31207153426
[image: Booking.com] <https://www.booking.com/>
The world's #1 accommodation site
43 languages, 198+ offices worldwide, 120,000+ global destinations,
1,550,000+ room nights booked every day
No booking fees, best price always guaranteed
Subsidiary of Booking Holdings Inc. (NASDAQ: BKNG)


RE: Maximum SSTable size

2018-06-27 Thread ZAIDI, ASAD A
With  Leveled compaction 
strategy<http://cassandra.apache.org/doc/latest/operating/compaction.html#lcs>  
, you can set target size with sstable_size_in_mb attribute however actual size 
can still be larger than target given large partition size.

Thanks/Asad

From: Lucas Benevides [mailto:lu...@maurobenevides.com.br]
Sent: Wednesday, June 27, 2018 7:02 AM
To: user@cassandra.apache.org
Subject: Maximum SSTable size

Hello Community,

Is there a maximum SSTable Size?
If there is not, does it go up to the maximum Operational System values?

Thanks in advance,
Lucas Benevides


Maximum SSTable size

2018-06-27 Thread Lucas Benevides
Hello Community,

Is there a maximum SSTable Size?
If there is not, does it go up to the maximum Operational System values?

Thanks in advance,
Lucas Benevides