[ceph-users] Re: "Incomplete" pg's

2022-03-07 Thread Eugen Block
Hi, IIUC the OSDs 3,4,5 have been removed while some PGs still refer to them, correct? Have the OSDs been replaced with the same IDs? If not (so there are currently no OSDs with IDs 3,4,5 in your osd tree) maybe marking them as lost [1] would resolve the stuck PG creation, although I

[ceph-users] Re: Cephadm is stable or not in product?

2022-03-07 Thread Martin Verges
Some say it is, some say it's not. Every time I try it, it's buggy as hell and I can destroy my test clusters with ease. That's why I still avoid it. But as you can see in my signature, I am biased ;). -- Martin Verges Managing director Mobile: +49 174 9335695 | Chat: https://t.me/MartinVerges

[ceph-users] Cephadm is stable or not in product?

2022-03-07 Thread norman.kern
Dear Ceph folks, Anyone is using cephadm in product(Version: Pacific)? I found several bugs on it and I really doubt it. ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an email to ceph-users-le...@ceph.io

[ceph-users] octopus (15.2.16) OSDs crash or don't answer heathbeats (and get marked as down)

2022-03-07 Thread Boris Behrens
Hi, we've had the problem with OSDs marked as offline since we updated to octopus and hope the problem would be fixed with the latest patch. We have this kind of problem only with octopus and there only with the big s3 cluster. * Hosts are all Ubuntu 20,04 and we've set the txqueuelen to 10k *

[ceph-users] Re: "Incomplete" pg's

2022-03-07 Thread Kyriazis, George
Ok, I saw that there is now a “ceph old force-create-pg” command. Not sure if it is a replacement of “ceph pg force_create_pg” or if it does something different. I tried it, and it looked like it worked: # ceph osd force-create-pg 1.353 --yes-i-really-mean-it pg 1.353 now creating, ok # But

[ceph-users] Re: Num objects: 18446744073709551603

2022-03-07 Thread Casey Bodley
Eric fixed https://tracker.ceph.com/issues/51560 which caused an underflow of rgw.none stats. i see that its backport tickets have remained untouched for over 4 months now On Mon, Mar 7, 2022 at 1:28 PM Paul Emmerich wrote: > > Yeah, that happens occasionally, see

[ceph-users] Re: "Incomplete" pg's

2022-03-07 Thread Kyriazis, George
After some thought, I decided to try “ceph pg force_create_pg” on the incomplete pgs, as suggested by name online sources. However, I got: # ceph pg force_create_pg 1.353 no valid command found; 10 closest matches: pg stat pg getmap pg dump [all|summary|sum|delta|pools|osds|pgs|pgs_brief...] pg

[ceph-users] ceph-16.2.7 build fail

2022-03-07 Thread 杜承峻
Hi all, OS:centos8.5.2111 My steps are as follows: ./install-deps.sh # add -pg for using gprofile vim CMakeLists.txt SET(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -pg") SET(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -pg") SET(CMAKE_EXE_LINKER_FLAGS "${CMAKE_EXE_LINKER_FLAGS} -pg")

[ceph-users] Re: Ceph in kubernetes

2022-03-07 Thread ceph . novice
Hi Hans.   any chance you could write up a blog, GitHub Gist, wiki, to describe WHAT exactly you run and HOW... with (config) examples?!? I wanted to also run the same kind of setup @ home, but hadn't the time to even start thinking / reading how to setup CEPH at home (OK, I had an CEPH

[ceph-users] Re: Retrieving cephx key from ceph-fuse

2022-03-07 Thread Dan van der Ster
On Fri, Mar 4, 2022 at 2:07 PM Robert Vasek wrote: > > Is there a way for an attacker with sufficient privileges to retrieve the > key by somehow mining it off of the process memory of ceph-fuse which is > now maintaining the volume mount? Yes, one should assume that if they can gcore dump the

[ceph-users] Re: Ceph in kubernetes

2022-03-07 Thread Hans van den Bogert
Just to add to warm fuzzy feeling, although just in a homelab, I'm using rook for many years now, it's awesome. I trust* it with the family photo's on a selfhosted nextcloud. All on K8s/Ceph/RGW. Hans * I have backups though ;) On 3/7/22 09:45, Bo Thorsen wrote: Hi Nico and Janne, Thank

[ceph-users] Re: Failed in ceph-osd -i ${osd_id} --mkfs -k /var/lib/ceph/osd/ceph-${osd_id}/keyring

2022-03-07 Thread Eugen Block
I don't think that's an issue here unless you tried the same for osd.1 but mixed up the error output from osd.3 and osd.1. But the error messages clearly state that there's no block device for osd.1 although you seem to try to create osd.3: [...] bluestore(/var/lib/ceph/osd/ceph-1/block)

[ceph-users] Re: How often should I scrub the filesystem ?

2022-03-07 Thread Arnaud M
Hello Does anyone have some infos about filesystem scrubbing ? As it is a generic thread (not specific to my cluster) I think the answers can help a lot of admin :) It would be awesome if someone can answer some of these questions. And maybe complete the doc. All the best Arnaud Le sam. 5

[ceph-users] Re: Ceph in kubernetes

2022-03-07 Thread Anthony D'Atri
Convergence by any other name: Proxmox, VSAN, etc. Sure, why not? Performance might not be stellar, but it sounds like you probably don’t need it to be. Look into dedicating a couple of cores to Ceph if you can, to avoid contention with compute tasks. How many nodes do you have? > > I'm