[ceph-users] ceph usage for very small objects
Hi all, I have a ceph cluster with 4+2 EC used as a secondary storage system for offloading big files from another storage system. Even if most of the files are big (at least 50MB), we have also some small objects - less than 4MB each. The current storage usage is 358TB of raw data and 237TB of 'usable' data which means an overhead of 66%. I was wondering if I can get more storage efficiency if I can get rid of all the small files by moving them on other storage systems. My understanding is that every file is splitted into stripe_unit chunks and then mapped into ceph objects which have a size of 4MB per object. So if I have a file with a size of 1MB, the file will be splitted into 4 x 256KB chunks, then added another 2 x 256KB chunks as overhead and every chunk will be mapped into a ceph object of 4MB size. This means a 1MB file will be stored as 6 ceph objects i.e the storage usage will be 24MB. Not sure if my understanding is correct though... Do you have any suggestions on this topic ? Does it really worth it to move the small files from ceph ? If yes, what is the minimum file size which I can safely store in ceph without loosing too much storage ? Thanks. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Second radosgw install
Hi all, I know that it seems like a stupid question, but I have some concerns about this, maybe someone can clear the things for me. I read in the offical docs that , when I create a rgw server with 'ceph-deploy rgw create', the rgw scripts will automatically create the rgw system pools. I'm not sure what happens with the existing system pools if I already have a working rgw server... Thanks. On 2/15/2019 6:35 PM, Adrian Nicolae wrote: Hi, I want to install a second radosgw to my existing ceph cluster (mimic) on another server. Should I create it like the first one, with 'ceph-deploy rgw create' ? I don't want to mess with the existing rgw system pools. Thanks. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Second radosgw install
Hi, I want to install a second radosgw to my existing ceph cluster (mimic) on another server. Should I create it like the first one, with 'ceph-deploy rgw create' ? I don't want to mess with the existing rgw system pools. Thanks. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Different write pools for RGW objects
Hi, I was wondering if I can have different destination pools for the S3 objects uploaded to Ceph via RGW based on the object's size. For example : - smaller S3 objects (let's say smaller than 1MB) should go to a replicated pool - medium and big objects should go to a EC pool Is there any way to do that ? I couldn't find such configuration option in the Crush Rules docs and the RGW docs. Thanks. ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
