[ceph-users] Re: Bucket usage per storage classes
Sending again, to you directly as well, I’m unsure if my email was rejected on the mailing list. — Hello, There is no such usage collected today, see [1] and [2] – where [2] is a specification on how one community member wanted to implement the feature but nobody has put in the work yet that we know of. [1] https://tracker.ceph.com/issues/47342 [2] https://tracker.ceph.com/issues/54972 Best regards Tobias > On 8 Apr 2024, at 10:39, Ondřej Kukla wrote: > > Does my example make sense or we are not on the same page still? > > Ondrej > >> On 4. 4. 2024, at 23:59, Ondřej Kukla wrote: >> >> Let's take for example a situation where I have a standart storage class >> backed by HDDs and a fast one on SSDs. The user will mix the classes in the >> bucket and I would like to know how much space Is he taking on the HDDs and >> how much on the SSDs so I can bill him. >> >> In this scenario I don't care that the head object is on HDDs. I would just >> like to transparently know how much Is stored where. >> >> I hope it makes sense. >> >> Ondrej >> >> >> On Apr 4, 2024 23:20, Anthony D'Atri wrote: >> A bucket may contain objects spread across multiple storage classes, and >> AIUI the head object is always in the default storage class, so I'm not sure >> *exactly* what you're after here. >> >>> On Apr 4, 2024, at 17:09, Ondřej Kukla wrote: >>> >>> Hello, >>> >>> I’m playing around with Storage classes in rgw and I’m looking for ways to >>> see per bucket statistics for the diferent storage classes (for billing >>> purposes etc.). >>> >>> I though that I would add another object to the bucket usage response like >>> for multiparts - rgw.multimeta, but it’s counted under the rgw.mainIs. >>> >>> Is there some option to get this info? >>> >>> Ondrej >>> >>> >>> Bucket usage I’m referring to >>> >>> "usage": { >>> "rgw.main": { >>> "size": 1333179575, >>> "size_actual": 1333190656, >>> "size_utilized": 1333179575, >>> "size_kb": 1301934, >>> "size_kb_actual": 1301944, >>> "size_kb_utilized": 1301934, >>> "num_objects": 4 >>> }, >>> "rgw.multimeta": { >>> "size": 0, >>> "size_actual": 0, >>> "size_utilized": 0, >>> "size_kb": 0, >>> "size_kb_actual": 0, >>> "size_kb_utilized": 0, >>> "num_objects": 0 >>> } >>> } >>> ___ >>> ceph-users mailing list -- ceph-users@ceph.io >>> To unsubscribe send an email to ceph-users-le...@ceph.io >> ___ >> ceph-users mailing list -- ceph-users@ceph.io >> To unsubscribe send an email to ceph-users-le...@ceph.io >> >> >> ___ >> ceph-users mailing list -- ceph-users@ceph.io >> To unsubscribe send an email to ceph-users-le...@ceph.io > > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: Bucket usage per storage classes
Does my example make sense or we are not on the same page still? Ondrej > On 4. 4. 2024, at 23:59, Ondřej Kukla wrote: > > Let's take for example a situation where I have a standart storage class > backed by HDDs and a fast one on SSDs. The user will mix the classes in the > bucket and I would like to know how much space Is he taking on the HDDs and > how much on the SSDs so I can bill him. > > In this scenario I don't care that the head object is on HDDs. I would just > like to transparently know how much Is stored where. > > I hope it makes sense. > > Ondrej > > > On Apr 4, 2024 23:20, Anthony D'Atri wrote: > A bucket may contain objects spread across multiple storage classes, and AIUI > the head object is always in the default storage class, so I'm not sure > *exactly* what you're after here. > > > On Apr 4, 2024, at 17:09, Ondřej Kukla wrote: > > > > Hello, > > > > I’m playing around with Storage classes in rgw and I’m looking for ways to > > see per bucket statistics for the diferent storage classes (for billing > > purposes etc.). > > > > I though that I would add another object to the bucket usage response like > > for multiparts - rgw.multimeta, but it’s counted under the rgw.mainIs. > > > > Is there some option to get this info? > > > > Ondrej > > > > > > Bucket usage I’m referring to > > > > "usage": { > >"rgw.main": { > >"size": 1333179575, > >"size_actual": 1333190656, > >"size_utilized": 1333179575, > >"size_kb": 1301934, > >"size_kb_actual": 1301944, > >"size_kb_utilized": 1301934, > >"num_objects": 4 > >}, > >"rgw.multimeta": { > >"size": 0, > >"size_actual": 0, > >"size_utilized": 0, > >"size_kb": 0, > >"size_kb_actual": 0, > >"size_kb_utilized": 0, > >"num_objects": 0 > >} > > } > > ___ > > ceph-users mailing list -- ceph-users@ceph.io > > To unsubscribe send an email to ceph-users-le...@ceph.io > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io > > > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: Bucket usage per storage classes
Hello, There is no such usage collected today, see [1] and [2] – where [2] is a specification on how one community member wanted to implement the feature but nobody has put in the work yet that we know of. [1] https://tracker.ceph.com/issues/47342 [2] https://tracker.ceph.com/issues/54972 Best regards Tobias > On 4 Apr 2024, at 23:59, Ondřej Kukla wrote: > > Let's take for example a situation where I have a standart storage class > backed by HDDs and a fast one on SSDs. The user will mix the classes in the > bucket and I would like to know how much space Is he taking on the HDDs and > how much on the SSDs so I can bill him. > > In this scenario I don't care that the head object is on HDDs. I would just > like to transparently know how much Is stored where. > > I hope it makes sense. > > Ondrej > > > On Apr 4, 2024 23:20, Anthony D'Atri wrote: > A bucket may contain objects spread across multiple storage classes, and AIUI > the head object is always in the default storage class, so I'm not sure > *exactly* what you're after here. > > > On Apr 4, 2024, at 17:09, Ondřej Kukla wrote: > > > > Hello, > > > > I’m playing around with Storage classes in rgw and I’m looking for ways to > > see per bucket statistics for the diferent storage classes (for billing > > purposes etc.). > > > > I though that I would add another object to the bucket usage response like > > for multiparts - rgw.multimeta, but it’s counted under the rgw.mainIs. > > > > Is there some option to get this info? > > > > Ondrej > > > > > > Bucket usage I’m referring to > > > > "usage": { > >"rgw.main": { > >"size": 1333179575, > >"size_actual": 1333190656, > >"size_utilized": 1333179575, > >"size_kb": 1301934, > >"size_kb_actual": 1301944, > >"size_kb_utilized": 1301934, > >"num_objects": 4 > >}, > >"rgw.multimeta": { > >"size": 0, > >"size_actual": 0, > >"size_utilized": 0, > >"size_kb": 0, > >"size_kb_actual": 0, > >"size_kb_utilized": 0, > >"num_objects": 0 > >} > > } > > ___ > > ceph-users mailing list -- ceph-users@ceph.io > > To unsubscribe send an email to ceph-users-le...@ceph.io > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io > > > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: Bucket usage per storage classes
Let's take for example a situation where I have a standart storage class backed by HDDs and a fast one on SSDs. The user will mix the classes in the bucket and I would like to know how much space Is he taking on the HDDs and how much on the SSDs so I can bill him.In this scenario I don't care that the head object is on HDDs. I would just like to transparently know how much Is stored where.I hope it makes sense.OndrejOn Apr 4, 2024 23:20, Anthony D'Atri wrote:A bucket may contain objects spread across multiple storage classes, and AIUI the head object is always in the default storage class, so I'm not sure *exactly* what you're after here. > On Apr 4, 2024, at 17:09, Ondřej Kukla wrote: > > Hello, > > I’m playing around with Storage classes in rgw and I’m looking for ways to see per bucket statistics for the diferent storage classes (for billing purposes etc.). > > I though that I would add another object to the bucket usage response like for multiparts - rgw.multimeta, but it’s counted under the rgw.mainIs. > > Is there some option to get this info? > > Ondrej > > > Bucket usage I’m referring to > > "usage": { > "rgw.main": { > "size": 1333179575, > "size_actual": 1333190656, > "size_utilized": 1333179575, > "size_kb": 1301934, > "size_kb_actual": 1301944, > "size_kb_utilized": 1301934, > "num_objects": 4 > }, > "rgw.multimeta": { > "size": 0, > "size_actual": 0, > "size_utilized": 0, > "size_kb": 0, > "size_kb_actual": 0, > "size_kb_utilized": 0, > "num_objects": 0 > } > } > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io
[ceph-users] Re: Bucket usage per storage classes
A bucket may contain objects spread across multiple storage classes, and AIUI the head object is always in the default storage class, so I'm not sure *exactly* what you're after here. > On Apr 4, 2024, at 17:09, Ondřej Kukla wrote: > > Hello, > > I’m playing around with Storage classes in rgw and I’m looking for ways to > see per bucket statistics for the diferent storage classes (for billing > purposes etc.). > > I though that I would add another object to the bucket usage response like > for multiparts - rgw.multimeta, but it’s counted under the rgw.mainIs. > > Is there some option to get this info? > > Ondrej > > > Bucket usage I’m referring to > > "usage": { >"rgw.main": { >"size": 1333179575, >"size_actual": 1333190656, >"size_utilized": 1333179575, >"size_kb": 1301934, >"size_kb_actual": 1301944, >"size_kb_utilized": 1301934, >"num_objects": 4 >}, >"rgw.multimeta": { >"size": 0, >"size_actual": 0, >"size_utilized": 0, >"size_kb": 0, >"size_kb_actual": 0, >"size_kb_utilized": 0, >"num_objects": 0 >} > } > ___ > ceph-users mailing list -- ceph-users@ceph.io > To unsubscribe send an email to ceph-users-le...@ceph.io ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io