Re: [ceph-users] Trying to understand the contents of .rgw.buckets.index

2016-01-29 Thread Gregory Farnum
On Fri, Jan 29, 2016 at 3:10 AM, Wido den Hollander wrote: > > > On 29-01-16 11:31, Micha Krause wrote: >> Hi, >> >> I'm having problems listing the contents of an s3 bucket with ~2M objects. >> >> I already found the new bucket index sharding feature, but I'm >> interested how these Indexes are s

Re: [ceph-users] Trying to understand the contents of .rgw.buckets.index

2016-01-29 Thread Micha Krause
Hi, > The index is stored in the omap of the object which you can list with> the 'rados' command. > > So it's not data inside the RADOS object, but in the omap key/value store. Thank you very much: rados -p .rgw.buckets.index listomapkeys .dir.default.55059808.22 | wc -l 2228777 So this dat

Re: [ceph-users] Trying to understand the contents of .rgw.buckets.index

2016-01-29 Thread Wido den Hollander
On 29-01-16 11:31, Micha Krause wrote: > Hi, > > I'm having problems listing the contents of an s3 bucket with ~2M objects. > > I already found the new bucket index sharding feature, but I'm > interested how these Indexes are stored. > > My index pool shows no space used, and all objects have

[ceph-users] Trying to understand the contents of .rgw.buckets.index

2016-01-29 Thread Micha Krause
Hi, I'm having problems listing the contents of an s3 bucket with ~2M objects. I already found the new bucket index sharding feature, but I'm interested how these Indexes are stored. My index pool shows no space used, and all objects have 0B. root@mon01:~ # rados df -p .rgw.buckets.index pool