[ceph-users] Re: Problem with multi zonegroup configuration

Someone got any ideas? I am not even sure if I am thinking it correctly. I only want to have users and bucketname synced, so they are unique. But not the data. I don't want to have redundance. The documentation reads like I need multiple zonegroups with a single zone each. Am Mo., 13. Sept. 2021

[ceph-users] Re: The best way of backup S3 buckets

Be aware of rclone's limitations regarding metadata (ACLs, versions, etc.), e.g., https://github.com/rclone/rclone/issues/1776 https://github.com/rclone/rclone/issues/4683 It is designed for efficient data transfer for a wide variety of backends, not for S3 or Ceph specifically. On Fri, 10 Sept 20

[ceph-users] Re: How many concurrent users can be supported by a single Rados gateway

Maybe i am foolish here, i am wondering what is the major benifit of running multiple RGWs instead of a single one on baremetal machine? Is it because that a single RGW has some inherent limitations on using multi threads? thanks, samuel huxia...@horebdata.cn From: Szabo, Istvan (Agoda)

[ceph-users] Re: Smarter DB disk replacement

I've been eyeing a similar icydock product (https://www.icydock.com/goods.php?id=309 ) for make M.2 drives more serviceable. While M.2 isn't ideal, if you have a 2U/4U box with a ton of available slots in the back, you could use these with some Micron 7

[ceph-users] Re: Cannot create a container, mandatory "Storage Policy" dropdown field is empty

Update /usr/lib/python3.6/site-packages/swiftclient/client.py and restart container horizon. This is to fix the error message on dashboard when it tries to retrieve policy list. -parsed = urlparse(urljoin(url, '/info')) +parsed = urlparse(urljoin(url, '/swift/info')) Tony _

[ceph-users] Re: [Suspicious newsletter] Problem with multi zonegroup configuration

I don't see any sync rule like you want to do directional sync between 2 zones, no pipe and no flow also. Istvan Szabo Senior Infrastructure Engineer --- Agoda Services Co., Ltd. e: istvan.sz...@agoda.com

[ceph-users] Re: ceph fs re-export with or without NFS async option

Hi Jeff, when exporting the file system with option sync, I would expect/accept maybe a factor of 2 slower, but not 10. I'm wondering if there is IO operations splitting going on. The r/wsizes on the nfs mount are at the max of 1MB, so copying a large file should go fast despite the sync option

[ceph-users] Re: Multiple OSD crashing within short timeframe in production cluster running pacific

Den mån 13 sep. 2021 kl 16:18 skrev Kári Bertilsson : > > Hello everyone, > errors. Yesterday the whole cluster was restarted, 2 OSD's in one server > would not come back up, while all other OSD's were fine. Since most PG's > had 10/10 available and a few had 9/10, I wasn't very worried and wiped t

[ceph-users] Health check failed: 1 pools ful

Hi all, I recently had a strange blip in the ceph logs: 2021-09-09 04:19:09.612111 [INF] Health check cleared: POOL_NEAR_FULL (was: 1 pools nearfull) 2021-09-09 04:13:18.187602 [INF] Health check cleared: POOL_FULL (was: 1 pools full) 2021-09-09 04:13:18.187566 [WRN] Health check failed: 1 p

[ceph-users] Multiple OSD crashing within short timeframe in production cluster running pacific

Hello everyone, I have been running ceph for the last 2 years, with great experience so far. Yesterday I started encountering some strange issues. All OSD's are part of an erasure coding pool with k=8 m=2 and host failure domain. Neither the crashing OSD's yesterday nor today show any symptoms of

[ceph-users] Re: MDS daemons stuck in resolve, please help

Hi Dan and Patrick, I created a tracker item for the snapshot issue: https://tracker.ceph.com/issues/52581 Patrick, could you please take a quick look at it? Thanks and best regards, = Frank Schilder AIT Risø Campus Bygning 109, rum S14

[ceph-users] Re: Octopus: Cannot delete bucket

How to properly ask for investigation on this bug? It looks like is not fixed. -- Paul On Wed, Sep 8, 2021 at 9:07 AM Paul JURCO wrote: > Hi! > I have upgraded to 15.2.14 in order to be able to delete an old bucket > stuck at: > > > *2021-09-08T08:47:15.216+0300 7f96ddfe7080 0 abort_bucket_mul

[ceph-users] Re: [Suspicious newsletter] Problem with multi zonegroup configuration

I don't want to sync data between zones. I only want to sync the metadata. This is meant to have users and buckets unique over multiple datacenter, but not build a mirror for data. Am Mo., 13. Sept. 2021 um 13:14 Uhr schrieb Szabo, Istvan (Agoda) < istvan.sz...@agoda.com>: > I don't see any sync

[ceph-users] data rebalance super slow

Hi, I have a 4:2 erasure coded data pool which based on host and have 6 data nodes. I've increased the pg from 32 to 128 but the recovery operation is less than 10MB/s. The server has bonded 25GB nic cards. In octopus I don't have to initiate the pgp_increase because it automatically adjust up,

[ceph-users] Re: How many concurrent users can be supported by a single Rados gateway

Yeah, 5 instances on different ports on each baremetal machines. Istvan Szabo Senior Infrastructure Engineer --- Agoda Services Co., Ltd. e: istvan.sz...@agoda.com --- Fr

[ceph-users] Fwd: Module 'devicehealth' has failed

Hi David It's hard to say with so little information what could be wrong, and I have not seen any response yet, so I thought I could give you something that might help you. I've done a video about setting up the Ceph, Grafana, and Prometheus triangle from scratch, the components responsible for h

[ceph-users] Problem with multi zonegroup configuration

Dear ceph community, I am still stuck with the multi zonegroup configuration. I did these steps: 1. Create realm (company), zonegroup(eu), zone(eu-central-1), sync user on the site fra1 2. Pulled the realm and the period in fra2 3. Creted the zonegroup(eu-central-2), zone (eu-central-2), modified

[ceph-users] Re: Ignore Ethernet interface

Am 10.09.21 um 20:06 schrieb Dominik Baack: For various reasons the network interfaces are mapped to the same IP range e.g. x.x.x.15y (eno1), x.x.x.17y (ib1), x.x.x.18y (ib2) with x constant for all ports and server and only "y" changing for individual server. Don't do this. The Linux kernel

[ceph-users] Ceph advisor for objectstore

Hi, Our cluster is getting more critical and I might want to revisit the design deeply from even the os tuning part so curious is there any company who is known as an objectstore expert? Thank you. ___ ceph-users mailing list -- ceph-users@ceph.io To

[ceph-users] Cannot create a container, mandatory "Storage Policy" dropdown field is empty

Hello team , I am replacing swift by Ceph Radosgateway , and I am successful by creating containers through openstack and ceph CLI side . but once trying to create through the horizon dashboard I get errors: *Error: *Unable to fetch the policy details. , Unable to get the Swift service info

[ceph-users] OSD based ec-code

Hi, What's your take on an osd based ec-code setup? I've never been brave enough to use OSD based crush rule because scared host failure but in the last 4 years we have never had any host issue so I'm thinking to change to there and use some more cost effective EC. Also what is the "optimal" l

[ceph-users] Re: How many concurrent users can be supported by a single Rados gateway

Dear Istvan, Thanks a lot for sharing. I have a question: How do you run 15 RGW on 3 nodes? using VM or container, or on physical machine. I am not sure whether it is good (if possible) to run multiple RGW directly on physical machine... best regards, Samuel huxia...@horebdata.cn From: