Re: [ceph-users] a couple of radosgw questions
I see that the objects that were deleted last Friday are indeed gone now (via gc I guess). gc list does not show anything even after right after objects are deleted. I couldn't get temp remove to do anything. -- Tom > -Original Message- > From: Ben Hines [mailto:bhi...@gmail.com] > Sent: Saturday, August 29, 2015 5:27 PM > To: Brad Hubbard > Cc: Deneau, Tom; ceph-users > Subject: Re: [ceph-users] a couple of radosgw questions > > I'm not the OP, but in my particular case, gc is proceeding normally > (since 94.2, i think) -- i just have millions of older objects > (months-old) which will not go away. > > (see my other post -- > http://lists.ceph.com/pipermail/ceph-users-ceph.com/2015-August/003967.html > ) > > -Ben > > On Fri, Aug 28, 2015 at 5:14 PM, Brad Hubbard <bhubb...@redhat.com> wrote: > > - Original Message - > >> From: "Ben Hines" <bhi...@gmail.com> > >> To: "Brad Hubbard" <bhubb...@redhat.com> > >> Cc: "Tom Deneau" <tom.den...@amd.com>, "ceph-users" <ceph-us...@ceph.com> > >> Sent: Saturday, 29 August, 2015 9:49:00 AM > >> Subject: Re: [ceph-users] a couple of radosgw questions > >> > >> 16:22:38 root@sm-cephrgw4 /etc/ceph $ radosgw-admin temp remove > >> unrecognized arg remove > >> usage: radosgw-admin [options...] > >> commands: > >> > >> temp removeremove temporary objects that were created up > to > >> specified date (and optional time) > > > > Looking into this ambiguity, thanks. > > > >> > >> > >> On Fri, Aug 28, 2015 at 4:24 PM, Brad Hubbard <bhubb...@redhat.com> wrote: > >> > emove an object, it is no longer visible > >> >> from the S3 API, but the objects > >> >>that comprised it are still there in .rgw.buckets pool. When do > they > >> >>get > >> >>removed? > >> > > >> > Does the following command remove them? > >> > > >> > http://ceph.com/docs/master/radosgw/purge-temp/ > >> > > > > Does "radosgw-admin gc list" show anything? ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] a couple of radosgw questions
I'm not the OP, but in my particular case, gc is proceeding normally (since 94.2, i think) -- i just have millions of older objects (months-old) which will not go away. (see my other post -- http://lists.ceph.com/pipermail/ceph-users-ceph.com/2015-August/003967.html ) -Ben On Fri, Aug 28, 2015 at 5:14 PM, Brad Hubbard bhubb...@redhat.com wrote: - Original Message - From: Ben Hines bhi...@gmail.com To: Brad Hubbard bhubb...@redhat.com Cc: Tom Deneau tom.den...@amd.com, ceph-users ceph-us...@ceph.com Sent: Saturday, 29 August, 2015 9:49:00 AM Subject: Re: [ceph-users] a couple of radosgw questions 16:22:38 root@sm-cephrgw4 /etc/ceph $ radosgw-admin temp remove unrecognized arg remove usage: radosgw-admin cmd [options...] commands: temp removeremove temporary objects that were created up to specified date (and optional time) Looking into this ambiguity, thanks. On Fri, Aug 28, 2015 at 4:24 PM, Brad Hubbard bhubb...@redhat.com wrote: emove an object, it is no longer visible from the S3 API, but the objects that comprised it are still there in .rgw.buckets pool. When do they get removed? Does the following command remove them? http://ceph.com/docs/master/radosgw/purge-temp/ Does radosgw-admin gc list show anything? ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] a couple of radosgw questions
- Original Message - From: Tom Deneau tom.den...@amd.com To: ceph-us...@ceph.com Sent: Saturday, 29 August, 2015 4:01:08 AM Subject: [ceph-users] a couple of radosgw questions A couple of questions on the radosgw... 1. I noticed when I use s3cmd to put a 10M object into a bucket in the rados object gateway, I get the following objects created in .rgw.buckets: 0.5M 4M 4M 1.5M I assume the 4M breakdown is controlled by rgw obj stripe size. What causes the small initial 0.5M piece? Does this describe what you are seeing? http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-March/037736.html Also, is there any diagram showing which parts of this striping, if any, occur in parallel? 2. I noticed when I use s3cmd to remove an object, it is no longer visible from the S3 API, but the objects that comprised it are still there in .rgw.buckets pool. When do they get removed? Does the following command remove them? http://ceph.com/docs/master/radosgw/purge-temp/ -- Tom Deneau, AMD ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] a couple of radosgw questions
16:22:38 root@sm-cephrgw4 /etc/ceph $ radosgw-admin temp remove unrecognized arg remove usage: radosgw-admin cmd [options...] commands: temp removeremove temporary objects that were created up to specified date (and optional time) On Fri, Aug 28, 2015 at 4:24 PM, Brad Hubbard bhubb...@redhat.com wrote: emove an object, it is no longer visible from the S3 API, but the objects that comprised it are still there in .rgw.buckets pool. When do they get removed? Does the following command remove them? http://ceph.com/docs/master/radosgw/purge-temp/ ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] a couple of radosgw questions
A couple of questions on the radosgw... 1. I noticed when I use s3cmd to put a 10M object into a bucket in the rados object gateway, I get the following objects created in .rgw.buckets: 0.5M 4M 4M 1.5M I assume the 4M breakdown is controlled by rgw obj stripe size. What causes the small initial 0.5M piece? Also, is there any diagram showing which parts of this striping, if any, occur in parallel? 2. I noticed when I use s3cmd to remove an object, it is no longer visible from the S3 API, but the objects that comprised it are still there in .rgw.buckets pool. When do they get removed? -- Tom Deneau, AMD ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] a couple of radosgw questions
- Original Message - From: Ben Hines bhi...@gmail.com To: Brad Hubbard bhubb...@redhat.com Cc: Tom Deneau tom.den...@amd.com, ceph-users ceph-us...@ceph.com Sent: Saturday, 29 August, 2015 9:49:00 AM Subject: Re: [ceph-users] a couple of radosgw questions 16:22:38 root@sm-cephrgw4 /etc/ceph $ radosgw-admin temp remove unrecognized arg remove usage: radosgw-admin cmd [options...] commands: temp removeremove temporary objects that were created up to specified date (and optional time) Looking into this ambiguity, thanks. On Fri, Aug 28, 2015 at 4:24 PM, Brad Hubbard bhubb...@redhat.com wrote: emove an object, it is no longer visible from the S3 API, but the objects that comprised it are still there in .rgw.buckets pool. When do they get removed? Does the following command remove them? http://ceph.com/docs/master/radosgw/purge-temp/ Does radosgw-admin gc list show anything? ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
