Hello,
I’m going to mainly answer the practical questions Niklaus had.
Our standart setup is 12HDDs and 2 Enterprise NVMe per node which means we have
6 OSDs per 1 NVMe. For the partition we use LVM.
The fact that one one failed NVMe takes down 6 OSDs isn’t great but our
osd-node count is
Hello Sinan,
You could create a “master” account that will create all the buckets and “sub”
accounts that will have max_bucket set to 0 and using the master account create
a bucket policies that will allow the sub accounts to interact with the buckets.
One downside to this solution is that the
Hello,
If you have a quite large amount of data you can maybe try the Chorus from
CLYSO.
https://docs.clyso.com/blog/2024/01/24/opensourcing-chorus-project
Opensourcing Chorus project | Clyso GmbH
docs.clyso.com
https://github.com/clyso/chorus
clyso/chorus: s3 multi provider data lifecycle
Does my example make sense or we are not on the same page still?
Ondrej
> On 4. 4. 2024, at 23:59, Ondřej Kukla wrote:
>
> Let's take for example a situation where I have a standart storage class
> backed by HDDs and a fast one on SSDs. The user will mix the classes in the
&g
, so I'm not sure *exactly* what you're after here.
> On Apr 4, 2024, at 17:09, Ondřej Kukla wrote:
>
> Hello,
>
> I’m playing around with Storage classes in rgw and I’m looking for ways to see per bucket statistics for the diferent storage classes (for billing purposes
Hello,
I’m playing around with Storage classes in rgw and I’m looking for ways to see
per bucket statistics for the diferent storage classes (for billing purposes
etc.).
I though that I would add another object to the bucket usage response like for
multiparts - rgw.multimeta, but it’s
Hello I’m looking for suggestions how to track bucket creation over s3 api and
bucket usage (num of objects and size) of all buckets in time.
In our RGW setup, we have a custom client panel, where like 85% percent of
buckets are created which is easy for us to then track the newly created
Hello,
As a one solution you can create a bucket policy that would give the “subuser”
permissions to access the bucket. Just keep in mind that the second user is not
the bucket owner so he will not be able to see the bucket in his bucket list,
but when he access the bucket directly it will
of the running upload.
For the part size, client is uploading 500MiB parts so for the 750GiB it’s
~1500 parts.
Ondrej
> On 6. 2. 2024, at 7:53, Robin H. Johnson wrote:
>
> On Mon, Feb 05, 2024 at 07:51:34PM +0100, Ondřej Kukla wrote:
>> Hello,
>>
>> For some time now I
20:09, Anthony D'Atri wrote:
>
> Do you have sufficient capacity in the non-ec pool? Is it on fast media?
>
> You should be able to increase the timeout on your LB.
>
>> On Feb 5, 2024, at 13:51, Ondřej Kukla wrote:
>>
>> Hello,
>>
>> For som
Hello,
For some time now I’m struggling with the time it takes to
CompleteMultipartUpload on one of my rgw clusters.
I have a customer with ~8M objects in one bucket uploading quite a large files.
From 100GB to like 800GB.
I’ve noticed when they are uploading ~200GB files that the requests
s from RGW can answer this.
>
> [1] https://docs.ceph.com/en/quincy/man/8/radosgw-admin/#commands
>
> Thanks,
> Jayanth
>
> On Fri, Dec 22, 2023 at 7:29 PM Ondřej Kukla <mailto:ond...@kuuk.la>> wrote:
>> Hello,
>>
>> I would like to share a quite wor
Hello,
I would like to share a quite worrying experience I’ve just found on one of my
production clusters.
User successfully created a bucket with name of a bucket that already exists!
He is not bucket owner - the original user is, but he is able to see it when he
does ListBuckets over s3
Hello,
I’ve noticed that 304 response from s3 and s3website api is not RFC9110
compliant. This is an issue especially for caching the content when you have a
cache-control header set on the object.
There was an old Issue and PR from 2020 fixing this issue but it was completely
ignored.
I’ve
Hello Tim,
I was also struggling with this when I was configuring the object gateway for
the first time.
There is a few things that you should check to make sure the dashboard would
work.
1. You need to have the admin api enabled on all rgws with the rgw_enable_apis
option. (As far as I know
If you want to do it using CLI in one command then try this “radosgw-admin user
create --uid=test --display-name=“Test User" --max-buckets=-1”
Ondrej
> On 6. 10. 2023, at 9:07, Matthias Ferdinand wrote:
>
> On Fri, Oct 06, 2023 at 08:55:42AM +0200, Ondřej Kukla wrote:
>
Hello Matthias,
In our setup we have a set of users that are only use to read from certain
buckets (they have s3:GetObject set in the bucket policy).
When we create those read users using the Admin Ops API we add the
max-buckets=-1 parameter which disables bucket creation.
or the only
> issue i was able to identify
>
> On Wed, Sep 20, 2023 at 9:20 PM Ondřej Kukla wrote:
>>
>> I was checking the tracker again and I found already fixed issue that seems
>> to be connected with this issue.
>>
>> https://tracker.ceph.com/issues/44508
or the only
> issue i was able to identify
>
> On Wed, Sep 20, 2023 at 9:20 PM Ondřej Kukla wrote:
>>
>> I was checking the tracker again and I found already fixed issue that seems
>> to be connected with this issue.
>>
>> https://tracker.ceph.com/issues/44508
I was checking the tracker again and I found already fixed issue that seems to
be connected with this issue.
https://tracker.ceph.com/issues/44508
Here is the PR that fixes it https://github.com/ceph/ceph/pull/33807
What I’m still not understanding is why this is only happening when using
ion of the cluster when I’m able to replicate this is
ceph version 17.2.6 (d7ff0d10654d2280e08f1ab989c7cdf3064446a5) quincy (stable)
Regards,
Ondrej
> On 20. 9. 2023, at 11:25, Ondřej Kukla wrote:
>
> I was checking the tracker again and I found already fixed issue that seems
>
I was checking the tracker again and I found already fixed issue that seems to
be connected with this issue.
https://tracker.ceph.com/issues/44508
Here is the PR that fixes it https://github.com/ceph/ceph/pull/33807
What I’m still not understanding is why this is only happening when using
Hello,
In our deployment we are using the mix of s3 and s3website RGW. I’ve noticed
strange behaviour when sending range requests to the s3website RGWs that I’m
not able to replicate on the s3 ones.
I’ve created a simple wrk LUA script to test sending range requests on tiny
ranges so the
Hello,
We have a RGW setup that has a bunch of Nginx in front of RGWs to work as a LB.
I’m currently working on some metrics and log analysis from the LB logs.
At the moment I’m looking at possibilities to recognise the type of s3 request
on the LB. I know that matching the format shouldn’t be
Hello,
I’ve had a quite unpleasant experience today that I would like to share.
In our setup we use two set’s of RGW one that has only s3 and admin API and a
second set with s3website and admin API. I was changing the global quota
setting which means that I’ve then needed to commit the updated
Infrastructure Engineer
> ---
> Agoda Services Co., Ltd.
> e: istvan.sz...@agoda.com
> ---
>
> -Original Message-
> From: Ondřej Kukla
> Sent: Monday, July 3, 2023 2:25 PM
> To: Szabo, Istvan (Agoda)
> Subject:
Hello,
As a part of performance/HW utilization testing I would like to compare how a
VM with single RGW instance compares to a VM with 2 or more colocated RGWs.
I’m deploying Quincy using Ansible but I’m struggling with setting the config
to use the same port across all RGW instances, but to
Hello,
I have found out that the issue seems to be in this change -
https://github.com/ceph/ceph/pull/47207
When I’ve commented out the change and replaced it with the previous value the
dashboard works as expected.
Ondrej
___
ceph-users mailing
Hello,
I have found out that the issue seems to be in this change -
https://github.com/ceph/ceph/pull/47207
When I’ve commented out the change and replaced it with the previous value the
dashboard works as expected.
Ondrej
___
ceph-users mailing
Hello,
Lately I’ve been playing with Lua scripting on top of RGW.
I would like to implement a request blocking based on bucket name -> when there
is a dot in a bucket name return error code and a message that this name is
invalid.
Here is the code I was able to came up with.
if
Hello,
I’m planning a Ceph multisite deployment with two clusters. One being a primary
one the clients will be intereacting with and a second one with zone tier type
set as an archive one. There is also a one way sync from the primary zone set -
I would like to have this cluster as a "backup
Hi,
I have two Ceph clusters in a multi-zone setup. The first one (master zone)
would be accessible to users for their interaction using RGW.
The second one is set to sync from the master zone with the tier type of the
zone set as an archive (to version all files).
My question here is. Is
32 matches
Mail list logo
