Hi Harald , We saw in our internal Veeam repo that only 4TB used created more than 10M objects.
I don't know if Veeam need to list content inside the bucket, that will make a 500 millions bucket not a good solution at least in our experience with sharding. I read someone in the IRC telling that they're using 1M objects per shard, that means that shard limit is a "soft" limit. And deployments with multi-site with a limit of 128 shards. Manuel -----Mensaje original----- De: ceph-users <ceph-users-boun...@lists.ceph.com> En nombre de Harald Staub Enviado el: lunes, 17 de junio de 2019 17:01 Para: Ceph Users <ceph-users@lists.ceph.com> Asunto: [ceph-users] Even more objects in a single bucket? There are customers asking for 500 million objects in a single object storage bucket (i.e. 5000 shards), but also more. But we found some places that say that there is a limit in the number of shards per bucket, e.g. https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/2/html/ob ject_gateway_guide_for_ubuntu/administration_cli It says that the maximum number of shards is 7877. But I could not find this magic number (or any other limit) on http://docs.ceph.com. Maybe this hard limit no longer applies to Nautilus? Maybe there is a recommended soft limit? Background about the application: Veeam (veeam.com) is a backup solution for VMWare that can embed a cloud storage tier with object storage (only with a single bucket). Just thinking loud: Maybe this could work with an indexless bucket. Not sure how manageable this would be, e.g. to monitor how much space is used. Maybe separate pools would be needed. Harry _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
