Re: Dynamo autoscaling: does it beat cassandra?

2019-12-10 Thread Dor Laor
lective; you only >> bear the cost in the places already determined to win from the tradeoff. >> >> >> >> *From: *Dor Laor >> *Reply-To: *"user@cassandra.apache.org" >> *Date: *Monday, December 9, 2019 at 5:58 PM >> *To: *"user@cassandra.apac

Re: Dynamo autoscaling: does it beat cassandra?

2019-12-10 Thread Reid Pinchback
that so I don’t have a mental model for the details. From: Carl Mueller Reply-To: "user@cassandra.apache.org" Date: Tuesday, December 10, 2019 at 3:19 PM To: "user@cassandra.apache.org" Subject: Re: Dynamo autoscaling: does it beat cassandra? Message from External Sender

Re: Dynamo autoscaling: does it beat cassandra?

2019-12-10 Thread Carl Mueller
a more traditional RDBMS would use > compression, e.g. Postgres, use of compression is more selective; you only > bear the cost in the places already determined to win from the tradeoff. > > > > *From: *Dor Laor > *Reply-To: *"user@cassandra.apache.org"

Re: Dynamo autoscaling: does it beat cassandra?

2019-12-10 Thread Reid Pinchback
Subject: Re: Dynamo autoscaling: does it beat cassandra? Message from External Sender The DynamoDB model has several key benefits over Cassandra's. The most notable one is the tablet concept - data is partitioned into 10GB chunks. So scaling happens where such a tablet reaches maximum capacity and

Re: Dynamo autoscaling: does it beat cassandra?

2019-12-09 Thread Dor Laor
The DynamoDB model has several key benefits over Cassandra's. The most notable one is the tablet concept - data is partitioned into 10GB chunks. So scaling happens where such a tablet reaches maximum capacity and it is automatically divided to two. It can happen in parallel across the entire data

Re: Dynamo autoscaling: does it beat cassandra?

2019-12-09 Thread Jeff Jirsa
Expansion probably much faster in 4.0 with complete sstable streaming (skips ser/deser), though that may have diminishing returns with vnodes unless you're using LCS. Dynamo on demand / autoscaling isn't magic - they're overprovisioning to give you the burst, then expanding on demand. That

Re: Dynamo autoscaling: does it beat cassandra?

2019-12-09 Thread DuyHai Doan
Out of curiosity, does DynamoDB autoscaling allows you to exceed the partition limits (e.g. push more data than it is allowed for some outlier heavy partitions) ? If yes, it can be interesting (I guess DynamoDB is doing some kind of rebalancing behind the scene). If no, it's just an artificial

Dynamo autoscaling: does it beat cassandra?

2019-12-09 Thread Carl Mueller
Dynamo salespeople have been pushing autoscaling abilities that have been one of the key temptations to our management to switch off of cassandra. Has anyone done any numbers on how well dynamo will autoscale demand spikes, and how we could architect cassandra to compete with such abilities? We