Re: [ceph-users] RGW bucket sharding in Jewel

2018-06-19 Thread David Turner
There have been some bugs in the past with dynamic resharding, but those seem to be the exception not the norm. I was surprised to find that some of our buckets had resharded themselves from 12 shards in Jewel to over 200 shards in luminous without me even realizing it. We would have resharded

Re: [ceph-users] RGW bucket sharding in Jewel

2018-06-19 Thread Matt Benjamin
The increased time to list sharded buckets is currently expected, yes. In turn other operations such as put and delete should be faster in proportion to two factors, the number of shards on independent PGs (serialization by PG), and the spread of shards onto independent OSD devices (speedup from

[ceph-users] RGW bucket sharding in Jewel

2018-06-19 Thread Matthew Vernon
Hi, Some of our users have Quite Large buckets (up to 20M objects in a bucket), and AIUI best practice would be to have sharded indexes for those buckets (of the order of 1 shard per 100k objects). On a trivial test case (make a 1M-object bucket, shard index to 10 shards, s3cmd ls s3://bucket