Re: [ceph-users] pre-sharding s3 buckets

2018-06-29 Thread Sean Purdy
On Wed, 27 Jun 2018, Matthew Vernon said: > Hi, > > On 27/06/18 11:18, Thomas Bennett wrote: > > > We have a particular use case that we know that we're going to be > > writing lots of objects (up to 3 million) into a bucket. To take > > advantage of sharding, I'm wanting to shard buckets,

Re: [ceph-users] pre-sharding s3 buckets

2018-06-27 Thread Thomas Bennett
Hi Matthew, Thanks for your reply, much appreciated. Sorry, I meant to say that we're running on Luminous, so I'm aware of dynamic resharding - however, I'm worried that this does not suit our particular use case. What I also forgot to mention is that we could be resharding a bucket 30 times in

[ceph-users] pre-sharding s3 buckets

2018-06-27 Thread Thomas Bennett
Hi, We have a particular use case that we know that we're going to be writing lots of objects (up to 3 million) into a bucket. To take advantage of sharding, I'm wanting to shard buckets, without the performance hit of resharding. So far I've created an empty bucket and then used the