[ceph-users] Re: How to solve data fixity

, Anthony D'Atri wrote: You could use Lua scripting perhaps to do this at ingest, but I'm very curious about scrubs -- you have them turned off completely? On Feb 9, 2024, at 04:18, Michal Strnad wrote: Hi all! In the context of a repository-type project, we need to address a situation where we

[ceph-users] How to solve data fixity

Hi all! In the context of a repository-type project, we need to address a situation where we cannot use periodic checks in Ceph (scrubbing) due to the project's nature. Instead, we need the ability to write a checksum into the metadata of the uploaded file via API. In this context, we are

[ceph-users] How to replace a disk with minimal impact on performance

Hi guys! Based on our observation of the impact of the balancer on the performance of the entire cluster, we have drawn conclusions that we would like to discuss with you. - A newly created pool should be balanced before being handed over to the user. This, I believe, is quite evident.

[ceph-users] Re: blustore osd nearfull but no pgs on it

~23c60] = 0x23c60 : using 0x39630000(918 MiB) : bluestore has 0x46e2d(18 GiB) available when i recreate the osd the osd gets full again any suggestion? thx & best regards ___ ceph-users mailing list -- ceph-users@ceph.io To unsu

[ceph-users] Re: Quincy 17.2.6 - Rados gateway crash -

. BR Wolfgang -Ursprüngliche Nachricht- Von: Michal Strnad Gesendet: Sonntag, 17. September 2023 19:43 An: Berger Wolfgang ; ceph-users@ceph.io Betreff: Re: [ceph-users] Re: Quincy 17.2.6 - Rados gateway crash - Hi. Has anyone encountered the same error in the Reef version? At least Quincy

[ceph-users] Re: Quincy 17.2.6 - Rados gateway crash -

Hi. Has anyone encountered the same error in the Reef version? At least Quincy (17.2.5) is still suffering from this even when using the latest version of Veeam. Michal Strnad On 8/17/23 15:12, Wolfgang Berger wrote: Hi, I've just checked Veeam backup (build 12.0.0.1420) to reef 18.2.0

[ceph-users] Re: Listing S3 buckets of a tenant using admin API

Hi. Did you manage to access the specific bucket? Is it possible and if so, how to obtain information about a bucket storage_class and placement through the API, in addition to the regular information? Thanks Michal On 2/1/22 18:01, Daniel Iwan wrote: It seems that REST API and CLI

[ceph-users] Re: Patch change for CephFS subvolume

lists/ceph-users/msg72341.html Zitat von Michal Strnad : Hi! I'm trying to figure out how to specify the path for a CephFS subvolume, as it's intended to represent a user's home directory. By default, it's located at /volumes/_nogroup/$NAME/$UUID. Is it possible to change this pa

[ceph-users] Patch change for CephFS subvolume

Michal Strnad smime.p7s Description: S/MIME Cryptographic Signature ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Re: Dedicated radosgw gateways

Hi, thank you for the response. That sounds like a reasonable solution. Michal On 5/15/23 14:15, Konstantin Shalygin wrote: Hi, On 15 May 2023, at 14:58, Michal Strnad wrote: at Cephalocon 2023, it was mentioned several times that for service tasks such as data deletion via garbage

[ceph-users] Dedicated radosgw gateways

Hi all, at Cephalocon 2023, it was mentioned several times that for service tasks such as data deletion via garbage collection or data replication in S3 via zoning, it is good to do them on dedicated radosgw gateways and not mix them with gateways used by users. How can this be achieved? How

[ceph-users] Testing to simulate real-world usage scenarios

Hi everyone, how do you test features that are used by your users before updating/upgrading to a newer version of Ceph? For example, if you have users or customers using RBD images with special sets of permissions/caps, or users/customers using S3 with versioning... None of these should be

[ceph-users] Re: Disks are filling up even if there is not a single placement group on them

Hi. Thank you for the explanation. I get it now. Michal On 4/10/23 20:44, Alexander E. Patrakov wrote: On Sat, Apr 8, 2023 at 2:26 PM Michal Strnad wrote: cluster: id: a12aa2d2-fae7-df35-ea2f-3de23100e345 health: HEALTH_WARN ... pgs: 1656117639/32580808518

[ceph-users] Re: Disks are filling up even if there is not a single placement group on them

;osd_failsafe_full_ratio": "0.97", "osd_pool_default_cache_target_full_ratio": "0.80", "paxos_stash_full_interval": "25", ceph osd dump | grep ratio full_ratio 0.9 backfillfull_ratio 0.85 nearfull_ratio 0.8 Thank you Michal

[ceph-users] Disks are filling up even if there is not a single placement group on them

Hi all, Our SSD disks are filling up, even if there is not a single placement group on them. How is that possible please? IDCLASS WEIGHTREWEIGHT SIZE RAW USE DATA OMAP META AVAIL%USE VAR PGS STATUS 1997ssd 1.15269 1.0 1.2 TiB 943 GiB 942 GiB

[ceph-users] Strange behavior when using storage classes

rage-clx.rgw.replicated.data" } }, "data_extra_pool": "storage-clx.rgw.EC.non-ec", "index_type": 0 } }, { "key": "default-placement", "val": { "index_pool": "storage-clx.rgw.EC.index", "storage_classes": { "STANDARD": { "data_pool": "storage-clx.rgw.EC.data" } }, "data_extra_pool": "storage-clx.rgw.EC.non-ec", "index_type": 0 } }, { "key": "replicated", "val": { "index_pool": "storage-clx.rgw.replicated.index", "storage_classes": { "STANDARD": { "data_pool": "storage-clx.rgw.replicated.data" } }, "data_extra_pool": "", "index_type": 0 } } ], "realm_id": "87a9217-7e8d-4a1b-b508-eb634cc55647", "notif_pool": "storage-clx.rgw.log:notif" } Thank you Regards, Michal Strnad ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Too strong permission for RGW in OpenStack

any advice. Best regards, Michal Strnad ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] Re: Multipath and cephadm

rash:z -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /tmp/ceph-tmpthn_t0il:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmprygbv15w:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.io/ceph/ceph:v15 lvm batch --no-auto /dev/dm-19 --yes --no-

[ceph-users] Re: CephFS keyrings for K8s

Ad. We are using Nautilus on Ceph side. Michal Strnad On 1/20/22 9:26 AM, Michal Strnad wrote: Hi, We are using CephFS in our Kubernetes clusters and now we are trying to optimize permissions/caps in keyrings. Every guide which we found contains something like - Create the file system

[ceph-users] CephFS keyrings for K8s

to the entire file system ... Is there better way where we don't need admin key, but restricted key only? What are you using in your environments? Multiple file systems isn't option for us. Thanks for your help Regards, Michal Strnad ___ ceph-users

[ceph-users] Re: Multipath and cephadm

Hi David. I can't find any special character and command file show ASCII text. file osd-spec-serverX.yml osd-spec-serverX.yml: ASCII text Problem is probably elsewhere. Does anyone use multipath with cephadm? Thank you -- Michal Strnad On 12/24/21 12:47 PM, David Caro wrote: I did

[ceph-users] Re: CentOS 7 and CentOS 8 Stream dependencies for diskprediction module

Did anyone have the same problem? We come across this on every cluster. Thank you -- Michal Strnad On 10/11/21 4:23 PM, Michal Strnad wrote: Hi, Did anyone get the diskprediction-local plugin working on CentOS 7.9 or CentOS 8 Stream? We have the same problem under both version of CentOS

[ceph-users] UID/GID-mapping with cephfs

Hi all, We are trying to use UID/GID-mapping with cephfs over ceph-fuse client, but we have not succeeded. The "module=idmap" option seems not to be supported by ceph-fuse: ceph-fuse ... /mnt/cephfs -o modules=idmap -o umap=user.map fuse: unknown option `modules=idmap' ceph-fuse[..]: fuse

[ceph-users] CentOS 7 and CentOS 8 Stream dependencies for diskprediction module

Hi, Did anyone get the diskprediction-local plugin working on CentOS 7.9 or CentOS 8 Stream? We have the same problem under both version of CentOS. When we enable the plugin with 15.2.14 ceph version we get following error. Module 'diskprediction_local' has failed: No module named

[ceph-users] Smarter DB disk replacement

Hi all, We are discussing different approaches how to replace a disk with DB (typically SSD or NVMe disk) for BlueStore. When the disk with DB died it will cause inaccessibility of all depended OSDs (six or eight in our environment), so we are looking for a way to minimize data loss or time

[ceph-users] Re: Howto upgrade AND change distro

/lib/ceph, where you have to persist proper rights ceph:ceph 4. Start systemd units Michal Strnad On 8/30/21 5:49 PM, Francois Legrand wrote: Thanks, My point is how to reattach safely an osd from the previous server to the new installed distro ! Is there a detailed howto réinstall

[ceph-users] CentOS 7 dependencies for diskprediction module

Hi, Did anyone get the diskprediction-local plugin working on CentOS 7.9? When we enable the plugin with v14.2.19 we get following error. Module 'diskprediction_local' has failed: No module named sklearn.svm.classes If the package is installed it brings in several dependencies but apparently

[ceph-users] Re: How to organize data in S3

Thank you. So we can create millions of buckets associated to only one S3 account without any limitation or side effect? Does anyone use it this way? Many thanks in advance. Michal On 5/23/21 9:42 PM, Janne Johansson wrote: > Many buckets. > > Den sön 23 maj 2021 kl 20:53 skrev Mich

[ceph-users] How to organize data in S3

Hi all, We need to store millions of files using S3 protocol in Ceph (version Nautilus), but have projects where isn't appropriate or possible to create a lot of S3 accounts. Is it better to have multiple S3 buckets or one bucket with sub folders? For example AWS service from Amazon allows you

[ceph-users] Backups of monitor

and three monitors on every cluster. Ad. We don't want to use more monitors than thee. Thank you Cheers Michal -- Michal Strnad smime.p7s Description: S/MIME Cryptographic Signature ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send

[ceph-users] Re: Speed of S3 Ceph gateways

Thank you! s5cmd do the trick :-). -- Michal On 2/8/21 5:46 PM, Konstantin Shalygin wrote: > Try s5cmd > > > k > >> On 30 Jan 2021, at 17:00, michal.str...@cesnet.cz >> wrote: >> >> We are testing our S3 Ceph endpoints and we are not satisfied with its >>

[ceph-users] Proper solution of slow_ops

Hi all, we are looking for a proper solution of slow_ops. When the disk failed, node is restated ... a lot of slow operations appear. Even if disk (OSD) or node is back again most of slow_ops are still there. On the internet we found only advice that we have to restart monitor. But this is not

[ceph-users] Speed of S3 Ceph gateways

uter power and bandwidth to internet then it is used right now. Thank you Regards Michal Strnad ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io