[ceph-users] Re: [Ceph orch] Could not start rgw service with IPv6 network

2024-06-06 Thread Huy Nguyen
Hi, thanks for your reply. Yes, ceph.conf configuration works normally. But I'm learning Cephadm, and I'm trying not to use ceph.conf. Instead, I want to get used to the ceph config or the ceph spec file. But I still have not figured it out how to do that.

[ceph-users] [Ceph orch] Could not start rgw service with IPv6 network

2024-06-06 Thread Huy Nguyen
Hi, In traditional way, I can make the radosgw listen on IPv6 like this: # ceph.conf [...] rgw_frontends = beast port=8080 endpoint=[2405:f980:0:2:f816:3eff:fed9:8d16] In Cephadm, It seems specifying IPv6 network does not work (IPv4 does), and the rgw services do not become active. # rgw.yaml

[ceph-users] Ceph osd df tree takes a long time to respond

2024-05-21 Thread Huy Nguyen
Ceph version 14.2.7 Ceph osd df tree command take long time than usual but I can't find out what is the reason? The monitor node still has plenty of available RAM and CPU resources. I checked the monitor and mgr log but nothing seems useful. I checked an older cluster in version 13.2.10 but

[ceph-users] [RGW] Restrict a subuser to access only one specific bucket

2024-03-04 Thread Huy Nguyen
Hi community, I have a user that owns some buckets. I want to create a subuser that has permission to access only one bucket. What can I do to archive this? Thanks ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to

[ceph-users] Re: RGW: user modify default_storage_class does not work

2023-11-15 Thread Huy Nguyen
Thanks for your reply. You are right, newly-created bucket will now have "placement_rule": "default-placement/COLD". But then I have another question that can we specify the default storage class when creating a new bucket? I found a way to set placement but not with storage class:

[ceph-users] RGW: user modify default_storage_class does not work

2023-11-12 Thread Huy Nguyen
Hi community, I'm using Ceph version 16.2.13. I tried to set default_storage_class but seems like it didn't work. Here is steps I did: I already had a storage class name COLD, then I modify the user default_storage_class like this: radosgw-admin user modify --uid testuser --placement-id

[ceph-users] High iowait when using Ceph NVME

2023-11-09 Thread Huy Nguyen
Hi, Currently, I'm testing Ceph v17.2.7 with NVMe. When mapping an rbd image to physical compute host, "fio bs=4k iodepth=128 randwrite" give 150k IOPS. I have a VM that located within the compute host, and the fio give ~40k IOPS and with 50 %iowait. I know there is a bottleneck, I'm not sure

[ceph-users] RGW: How to trigger to recalculate the bucket stats?

2023-10-17 Thread Huy Nguyen
Hi, For some reason, I need to recalculate the bucket stats. Is this possible? Thanks ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] How to use STS Lite correctly?

2023-09-22 Thread Huy Nguyen
Hi, I have a Ceph cluster v16.2.10 To use STS lite, my configures are like the following: ceph.conf ... [client.rgw.ss-rgw-01] host = ss-rgw-01 rgw_frontends = beast port=8080 rgw_zone=backup-hapu admin_socket = /var/run/ceph/ceph-client.rgw.ss-rgw-01 rgw_sts_key = qekd3Rd5zXr0adQx

[ceph-users] Re: Problem when configuring S3 website domain go through Cloudflare DNS proxy

2023-08-24 Thread Huy Nguyen
This issue doesn't occur using S3 website domain of AWS. Seems like it only happens with Ceph. ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Problem when configuring S3 website domain go through Cloudflare DNS proxy

2023-08-24 Thread Huy Nguyen
Hi, Currently, I trying to create a CNAME record point to a s3 website, for example: s3.example.com => s3.example.com.s3-website.myceph.com. So in this way, my subdomain s3. will have https. But then only http works. If I go to https://s3.example.com, it shows the metadata of index.html: This

[ceph-users] Lost buckets when moving OSD location

2023-08-17 Thread Huy Nguyen
Hi, I'm using a v16.2.13 Ceph cluster. Yesterday, I just add some SSD node for replace HDD node. During the process, 1 SSD node have different MTU that cause the some PGs become unactive for a while. But after change the MTU, all the PGs is active+clean now. But after that, I can't access some

[ceph-users] Re: Multiple object instances with null version id

2023-07-27 Thread Huy Nguyen
Ok, I think the only possible way to fix this is to clone that bucket and remove the old bucket (rename the new bucket if needed) ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Multiple object instances with null version id

2023-07-24 Thread Huy Nguyen
Hi, I have a Ceph cluster in v16.2.13. I'm not sure why does this happen and how to clean it? [2023-07-12 21:23:13 +07] 299B STANDARD null v18 PUT index.txt [2023-07-12 21:27:54 +07] 299B STANDARD null v17 PUT index.txt [2023-07-12 21:48:01 +07] 299B STANDARD null v16 PUT index.txt

[ceph-users] Re: Workload that delete 100 M object daily via lifecycle

2023-07-17 Thread Huy Nguyen
Hi, You may want to check out this doc: https://docs.ceph.com/en/quincy/radosgw/config-ref/#lifecycle-settings As I understand it in short: - if there are thousands of buckets, we should increase the rgw_lc_max_worker. - if there are a few buckets that have hundreds of thousands of objects, we

[ceph-users] Re: RadosGW strange behavior when using a presigned url generated by SDK PHP

2023-07-02 Thread Huy Nguyen
Thanks for your support, Using tcpdump and wireshark, I can see both boto3 and PHP transactions have this field: Host: hn.ss.bfcplatform.vn\r\n Which does not contain 8084, so I'm still confused about how it appeared =) But anyway, this configuration in nginx was solved the problem:

[ceph-users] Re: RadosGW strange behavior when using a presigned url generated by SDK PHP

2023-06-29 Thread Huy Nguyen
Thanks for your reply, Yes, my setup is like the following: RGWs (port 8084) -> Nginx (80, 443) So this why it make me confuse when :8084 appear with the domain. And this behavior only occurs with PHP's generated url, not in Boto3 ___ ceph-users

[ceph-users] RadosGW strange behavior when using a presigned url generated by SDK PHP

2023-06-29 Thread Huy Nguyen
Hi, I tried to generate a presigned url using SDK PHP, but it doesn't work. (I also tried to use boto3 with the same configures and the url works normally) Here is my php code: '2006-03-01', 'region' => 'us-east-1', 'signature_version' => 'v4', 'use_path_style_endpoint' =>

[ceph-users] How to show used size of specific storage class in Radosgw?

2023-06-05 Thread Huy Nguyen
Hi, I'm not able to find the information about used size of a storage class. - bucket stats - usage show - user stats ... Does Radosgw support it? Thanks ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to

[ceph-users] RGW: bucket notification issue with Kafka

2023-06-05 Thread Huy Nguyen
Hi, In Ceph Radosgw 15.2.17, I get this issue when trying to create a push endpoint to Kafka Here is push endpoint configuration: endpoint_args = 'push-endpoint=kafka://abcef:123456@kafka.endpoint:9093=true=/etc/ssl/certs/ca.crt' attributes = {nvp[0] : nvp[1] for nvp in

[ceph-users] How to specify to only build ceph-radosgw package from source?

2023-05-31 Thread huy nguyen
Hi, I usually install the SRPM and then build from ceph.spec like this: rpmbuild -bb /root/rpmbuild/SPECS/ceph.spec --without ceph_test_package But it take a long time and contain many packages that I don't need. So is there a way to optimize this build process for only needed package, for

[ceph-users] Can lifecycle transition cause a high load if many buckets do transition at the same time?

2023-05-28 Thread huy nguyen
Hi, I have a plan to use the second storage class for cold data in the near future. But I have a question: if many old buckets with many objects are set to transition at the same time, can Ceph handle it by default, or do I have to configure QoS to avoid the high load? Thanks!

[ceph-users] RGW: How to restore the index and metadata of a bucket

2023-05-24 Thread huy nguyen
There is a test bucket, I have removed its index and metadata: radosgw-admin bi purge --bucket abccc --yes-i-really-mean-it radosgw-admin metadata rm bucket.instance:abccc:17a4ce99-009e-40f2-a2d2-2afc218ebd9b.425824299.4 Now the index and metadata is gone, but how to clean its data? Or is there

[ceph-users] RGW: are there any ways to limit access from user to a storage class?

2023-05-23 Thread huy nguyen
There are tags for placement, so any user that has the tag is allowed to access the placement. But I can't find how to do it for storage class? Anyone have any ideal? Thanks. ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an

[ceph-users] Re: RGW: request fields in Lua script return wrong data?

2023-05-19 Thread huy nguyen
Thanks, postRequest context is what I actually need. The Request.Object.Size is now correct, but MTime is still wrong. Beside that, I also want to print the owner name of bucket or object using Request.User.Tenant, but it doesn't return anything. Script: if Request.HTTP.StorageClass == 'COLD'

[ceph-users] Re: CEPH Version choice

2023-05-17 Thread huy nguyen
Hi, as I understand, Pacific+ is having a performance issue that does not exist in older releases? So that why Ceph's new release (Reef) is delayed in this year? ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to