[ceph-users] Re: Questions about rbd flatten command

2024-04-01 Thread Henry lol
I'm not sure, but it seems that read and write operations are performed for all objects in rbd. If so, is there any method to apply qos for flatten operation? 2024년 4월 1일 (월) 오후 11:59, Henry lol 님이 작성: > > Hello, > > I executed multiple 'rbd flatten' commands simultaneously on a client. > The

[ceph-users] Replace block drives of combined NVME+HDD OSDs

2024-04-01 Thread Zakhar Kirpichenko
Hi, Unfortunately, some of our HDDs failed and we need to replace these drives which are parts of "combined" OSDs (DB/WAL on NVME, block storage on HDD). All OSDs are defined with a service definition similar to this one: ``` service_type: osd service_id: ceph02_combined_osd service_name:

[ceph-users] Re: S3 Partial Reads from Erasure Pool

2024-04-01 Thread Joshua Baergen
I think it depends what you mean by rados objects and s3 objects here. If you're talking about an object that was uploaded via MPU, and thus may comprise many rados objects, I don't think there's a difference in read behaviors based on pool type. If you're talking about reading a subset byte range

[ceph-users] Re: ceph status not showing correct monitor services

2024-04-01 Thread Adiga, Anantha
# ceph mon stat e6: 2 mons at {a001s017=[v2:10.45.128.27:3300/0,v1:10.45.128.27:6789/0],a001s018=[v2:10.45.128.28:3300/0,v1:10.45.128.28:6789/0]}, election epoch 162, leader 0 a001s018, quorum 0,1 a001s018,a001s017 # ceph orch ps | grep mon mon.a001s016a001s016

[ceph-users] Re: ceph status not showing correct monitor services

2024-04-01 Thread Adiga, Anantha
root@a001s016:/var/run/ceph/604d56db-2fab-45db-a9ea-c418f9a8cca8# ceph tell mon.a001s016 mon_status Error ENOENT: problem getting command descriptions from mon.a001s016 a001s016 is outside quorum see below root@a001s016:/var/run/ceph/604d56db-2fab-45db-a9ea-c418f9a8cca8# ceph tell

[ceph-users] Re: ceph status not showing correct monitor services

2024-04-01 Thread Adiga, Anantha
Both methods are not update the mon map, is there a way to inject mon.a001s016 into the current mon map? # ceph mon dump dumped monmap epoch 6 epoch 6 fsid 604d56db-2fab-45db-a9ea-c418f9a8cca8 last_changed 2024-03-31T23:54:18.692983+ created 2021-09-30T16:15:12.884602+ min_mon_release

[ceph-users] Re: ceph status not showing correct monitor services

2024-04-01 Thread Adiga, Anantha
Thank you. I will try the export and import method first. Thank you, Anantha -Original Message- From: Eugen Block Sent: Monday, April 1, 2024 1:57 PM To: Adiga, Anantha Cc: ceph-users@ceph.io Subject: Re: [ceph-users] Re: ceph status not showing correct monitor services I have two

[ceph-users] Re: ceph status not showing correct monitor services

2024-04-01 Thread Eugen Block
I have two approaches in mind, first one (and preferred) would be to edit the mon spec to first remove mon.a001s016 and have a clean state. Get the current spec with: ceph orch ls mon --export > mon-edit.yaml Edit the spec file so that mon.a001s016 is not part of it, then apply: ceph orch

[ceph-users] Re: ceph status not showing correct monitor services

2024-04-01 Thread Adiga, Anantha
Hi Eugen, Yes that is it. OSDs were restarted since mon a001s017 was reporting is low on available space. How to update the mon map to add mon.a001s016 as it is already online? And how to update mgr map to include standby mgr.a001s018 as it is also running. ceph mon dump dumped

[ceph-users] Re: ceph status not showing correct monitor services

2024-04-01 Thread Eugen Block
Maybe it’s just not in the monmap? Can you show the output of: ceph mon dump Did you do any maintenance (apparently OSDs restarted recently) and maybe accidentally removed a MON from the monmap? Zitat von "Adiga, Anantha" : Hi Anthony, Seeing it since last after noon. It is same with

[ceph-users] Re: ceph status not showing correct monitor services

2024-04-01 Thread Adiga, Anantha
Hi Anthony, Seeing it since last after noon. It is same with mgr services as , "ceph -s" is reporting only TWO instead of THREE Also mon and mgr shows " is_active: false" see below. # ceph orch ps --daemon_type=mgr NAME HOST PORTS STATUS REFRESHED AGE MEM

[ceph-users] Re: ceph status not showing correct monitor services

2024-04-01 Thread Anthony D'Atri
> a001s017.bpygfm(active, since 13M), standbys: a001s016.ctmoay Looks like you just had an mgr failover? Could be that the secondary mgr hasn't caught up with current events. ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe send an

[ceph-users] ceph status not showing correct monitor services

2024-04-01 Thread Adiga, Anantha
Hi Why is "ceph -s" showing only two monitors while three monitor services are running ? # ceph versions { "mon": {"ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 2 }, "mgr": { "ceph version 16.2.5

[ceph-users] Re: Can setting mds_session_blocklist_on_timeout to false minize the session eviction?

2024-04-01 Thread Yongseok Oh
The solution can be found here. https://ceph.io/en/news/blog/2020/automatic-cephfs-recovery-after-blacklisting/ When a session eviction occurs on the client side and then the recovery is performed, the client's caps and dirty data are dropped and the server also releases the client's caps, so

[ceph-users] Drained A Single Node Host On Accident

2024-04-01 Thread adam.ther
Hello, I have a single node host with a VM as a backup MON,MGR,ect. This has caused all OSD's to be pending as 'deleting', can i safely cancel this deletion request? Regards, Adam ___ ceph-users mailing list -- ceph-users@ceph.io To unsubscribe

[ceph-users] Questions about rbd flatten command

2024-04-01 Thread Henry lol
Hello, I executed multiple 'rbd flatten' commands simultaneously on a client. The elapsed time of each flatten job increased as the number of jobs increased, and network I/O was nearly full. so, I have two questions. 1. isn’t the flatten job running within the ceph cluster? Why is client-side