[ceph-users] Re: db_devices doesn't show up in exported osd service spec

2021-02-09 Thread Tony Liu
With db_devices.size, db_devices shows up from "orch ls --export", but no DB device/lvm created for the OSD. Any clues? Thanks! Tony From: Jens Hyllegaard (Soft Design A/S) Sent: February 9, 2021 01:16 AM To: ceph-users@ceph.io Subject: [ceph-users] Re:

[ceph-users] How is DB handled when remove/replace and add OSD?

2021-02-09 Thread Tony Liu
Hi, I'd like to know how DB device is expected to be handled by "orch osd rm". What I see is that, DB device on SSD is untouched when OSD on HDD is removed or replaced. "orch device zap" removes PV, VG and LV of the device. It doesn't touch the DB LV on SSD. To remove an OSD permanently, do I

[ceph-users] How to debug container upgrade issue?

2021-02-09 Thread Darrin Hodges
HI all, Upgrading ceph containers is failing, how do I debug it? 'cephadm pull' seems to work on the node, but the upgrade fails. $ ceph orch upgrade start --ceph-version 15.2.8 "message": "Error: UPGRADE_FAILED_PULL: Upgrade: failed to pull target image thanks Darrin -- CONFIDENTIALITY

[ceph-users] Announcing go-ceph v0.8.0

2021-02-09 Thread John Mulligan
I'm happy to announce another release of the go-ceph API bindings. This is a regular release following our every-two-months release cadence. https://github.com/ceph/go-ceph/releases/tag/v0.8.0 Changes in the release are detailed in the link above. The bindings aim to play a similar role to

[ceph-users] Re: share haproxy config for radosgw [EXT]

2021-02-09 Thread Matthew Vernon
On 07/02/2021 22:19, Marc wrote: I was wondering if someone could post a config for haproxy. Is there something specific to configure? Like binding clients to a specific backend server, client timeouts, security specific to rgw etc. Ours is templated out by ceph-ansible; to try and condense

[ceph-users] MultiSite Sync Problem and Shard Number Relation?

2021-02-09 Thread George Yil
Hi, I am sort of newby to RGW multisite. I guess there is an important limitation about bucket index sharding if you run multisite. I would like to learn better or correct myself. And I also want to leave a bookmark here for future cephers if possible. I apologize if this is asked before

[ceph-users] Re: Proper solution of slow_ops

2021-02-09 Thread Milan Kupcevic
On 2/9/21 7:29 AM, Michal Strnad wrote: > > we are looking for a proper solution of slow_ops. When the disk failed, > node is restated ... a lot of slow operations appear. Even if disk (OSD) > or node is back again most of slow_ops are still there. On the internet > we found only advice that we

[ceph-users] Re: Speed of S3 Ceph gateways

2021-02-09 Thread Michal Strnad
Thank you! s5cmd do the trick :-). -- Michal On 2/8/21 5:46 PM, Konstantin Shalygin wrote: > Try s5cmd > > > k > >> On 30 Jan 2021, at 17:00, michal.str...@cesnet.cz >> wrote: >> >> We are testing our S3 Ceph endpoints and we are not satisfied with its >>

[ceph-users] Proper solution of slow_ops

2021-02-09 Thread Michal Strnad
Hi all, we are looking for a proper solution of slow_ops. When the disk failed, node is restated ... a lot of slow operations appear. Even if disk (OSD) or node is back again most of slow_ops are still there. On the internet we found only advice that we have to restart monitor. But this is not

[ceph-users] using secondary OSDs for reading

2021-02-09 Thread mj
Hi, Quoting the page https://docs.ceph.com/en/latest/architecture/ location query over a chatty session. The CRUSH algorithm allows a client to compute where objects should be stored, and enables the client to contact the primary OSD to store or retrieve the objects. So clients contact the

[ceph-users] Re: db_devices doesn't show up in exported osd service spec

2021-02-09 Thread Jens Hyllegaard (Soft Design A/S)
Hi Tony. I assume they used a size constraint instead of rotational. So if all your SSD's are 1TB or less , and all HDD's are more than that you could use: spec: objectstore: bluestore data_devices: rotational: true filter_logic: AND db_devices: size: ':1TB' It was usable in my

[ceph-users] Re: Can see objects with "rados ls" but cannot delete them with "rados rm"

2021-02-09 Thread Nick Janus
Hi James, I don't have any experience past Nautilus, but I suspect the rados cli (and/or the client calls its using) still does not handle c strings well when listing objects with null characters in their keys. That would explain the repeated keys you're seeing. I've noticed a similar issue