It actually seems like these values aren't being honored, i actually see
many more objects being processed by gc (as well as kraken object
lifecycle), even though my values are at the default 32 objs.
19:52:44 root@<> /var/run/ceph $ ceph --admin-daemon
/var/run/ceph/ceph-client.<>.asok config show | grep 'gc\|lc'
"rgw_enable_gc_threads": "true",
"rgw_enable_lc_threads": "true",
"rgw_lc_lock_max_time": "60",
"rgw_lc_max_objs": "32",
"rgw_lc_debug_interval": "-1",
"rgw_gc_max_objs": "32",
"rgw_gc_obj_min_wait": "7200",
"rgw_gc_processor_max_time": "3600",
"rgw_gc_processor_period": "3600",
"rgw_objexp_gc_interval": "600",
gc: (this is all within one hour, so must be within one cycle)
19:49:17 root@<> /var/log/ceph $ grep 'gc::process: removing' client.<>.log
| wc -l
6908
lifecycle:
19:50:22 root@<> /var/log/ceph $ grep DELETED client.<>.log | wc -l
741
Yehuda, do you know if these settings are honored still? (personally i dont
want to limit it at all, I would rather it delete as many objects as it can
within its runtime)
Also curious if lifecycle deleted objects go through the garbage collector,
or are they just immediately deleted?
-Ben
On Mon, Apr 10, 2017 at 2:46 PM, Deepak Naidu <[email protected]> wrote:
> I still see the issue, where the space is not getting deleted. gc process
> works sometimes but sometimes it does nothing to clean the GC, as there are
> no items in the GC, but still the space is used on the pool.
>
>
>
> Any ideas what the ideal config for automatic deletion of these objects
> after the files are deleted.
>
> Currently set to
>
>
>
> "rgw_gc_max_objs": "97",
>
>
>
> --
>
> Deepak
>
>
>
> *From:* Deepak Naidu
> *Sent:* Wednesday, April 05, 2017 2:56 PM
> *To:* Ben Hines
> *Cc:* ceph-users
> *Subject:* RE: [ceph-users] ceph df space for rgw.buckets.data shows used
> even when files are deleted
>
>
>
> Thanks Ben.
>
>
>
> Is there are tuning param I need to use to fasten the process.
>
>
>
> "rgw_gc_max_objs": "32",
>
> "rgw_gc_obj_min_wait": "7200",
>
> "rgw_gc_processor_max_time": "3600",
>
> "rgw_gc_processor_period": "3600",
>
>
>
>
>
> --
>
> Deepak
>
>
>
>
>
>
>
> *From:* Ben Hines [mailto:[email protected] <[email protected]>]
> *Sent:* Wednesday, April 05, 2017 2:41 PM
> *To:* Deepak Naidu
> *Cc:* ceph-users
> *Subject:* Re: [ceph-users] ceph df space for rgw.buckets.data shows used
> even when files are deleted
>
>
>
> Ceph's RadosGW uses garbage collection by default.
>
>
>
> Try running 'radosgw-admin gc list' to list the objects to be garbage
> collected, or 'radosgw-admin gc process' to trigger them to be deleted.
>
>
>
> -Ben
>
>
>
> On Wed, Apr 5, 2017 at 12:15 PM, Deepak Naidu <[email protected]> wrote:
>
> Folks,
>
>
>
> Trying to test the S3 object GW. When I try to upload any files the space
> is shown used(that’s normal behavior), but when the object is deleted it
> shows as used(don’t understand this). Below example.
>
>
>
> Currently there is no files in the entire S3 bucket, but it still shows
> space used. Any insight is appreciated.
>
>
>
> ceph version 10.2.6
>
>
>
> *NAME ID USED
> %USED MAX AVAIL OBJECTS*
>
> default.rgw.buckets.data 49 51200M 1.08
> 4598G 12800
>
>
>
>
>
> --
>
> Deepak
> ------------------------------
>
> This email message is for the sole use of the intended recipient(s) and
> may contain confidential information. Any unauthorized review, use,
> disclosure or distribution is prohibited. If you are not the intended
> recipient, please contact the sender by reply email and destroy all copies
> of the original message.
> ------------------------------
>
>
> _______________________________________________
> ceph-users mailing list
> [email protected]
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
>
_______________________________________________
ceph-users mailing list
[email protected]
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
