[ceph-users] No active MDS after upgrade to 16.2.6

Hi - I have a 3 node cluster, and ran the upgrade to 16.2.6 yesterday. All looked like it was going well, but the MDS servers are not coming up Ceph status shows 2 failed daemons and 3 standby. ceph status cluster: id: fe3a7cb0-69ca-11eb-8d45-c86000d08867 health: HEALTH_ERR

[ceph-users] Error ceph-mgr on fedora 36

OS: Fedora 36 (rawhide) Ceph: 16.2.6 Python: 3.10 When start ceph-mgr he is try load core python modules but crash with error: Sep 18 15:11:35 ceph-master0 ceph-mgr[71463]: 2021-09-18T15:11:35.086+0300 6adb4530 -1 mgr load Failed to construct class in 'balancer' Sep 18 15:11:35

[ceph-users] 回复: No active MDS after upgrade to 16.2.6

Hi Robert, You may hit the same bug as me. You can read this thread for details https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/KQ5A5OWRIUEOJBC7VILBGDIKPQGJQIWN/ In short, ensure you have no active MDS, then run: ceph fs compat add_incompat 7 "mds uses inline data" Weiwen Hu

[ceph-users] Error: UPGRADE_FAILED_PULL: Upgrade: failed to pull target image

Hi, As usual upgrade procedurefrom 16.2.5 -> 16.2.6, I get that error. Anyone have any suggestions? Thanks. root@ceph100:~# ceph orch upgrade status { "target_image": "docker.io/ceph/ceph:v16.2.6", "in_progress": true, "services_complete": [], "progress": "", "message":

[ceph-users] Re: Buffered io +/vs osd memory target

Hi, Yes, the "osd target" settings is a resident memory, "buffered_io" is a cached memory (that can be freed by kernel when kernel receives malloc signal) k > On 18 Sep 2021, at 11:29, Szabo, Istvan (Agoda) > wrote: > > If we are using buffered_io does the osd memory target settings still

[ceph-users] Buffered io +/vs osd memory target

Hi, If we are using buffered_io does the osd memory target settings still makes any sense (or vice-versa)? Istvan Szabo Senior Infrastructure Engineer --- Agoda Services Co., Ltd. e: istvan.sz...@agoda.com

[ceph-users] ceph mgr alert mail using tls

Hi, I am trying to configure Ceph (version 15.2.3) mgr alert email using office365 account I get the below error. [WRN] ALERTS_SMTP_ERROR: unable to send alert email [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:1056) Configured SMTP server and port 587. I have followed the

[ceph-users] Re: Error: UPGRADE_FAILED_PULL: Upgrade: failed to pull target image

They really need to update the upgrade doc, as they’ve quit using Docker Hub for images (https://hub.docker.com/r/ceph/ceph). I can’t say I blame them, considering the silliness that Docker has been up to. Anyway, you need to specify the quay.io registry: ceph orch upgrade start --image

[ceph-users] Re: Cephfs - MDS all up:standby, not becoming up:active

Hi Patrick Thanks a lot! After setting ceph fs compat cephfs add_incompat 7 "mds uses inline data" the filesystem is working again. So should I leave this setting as it is now, or do I have to remove it again in a future update? On Sat, Sep 18, 2021 at 2:28 AM Patrick Donnelly wrote: > On

[ceph-users] Re: Cephfs - MDS all up:standby, not becoming up:active

在 2021年9月18日，22:50，Eric Dold 写道： Hi Patrick Thanks a lot! After setting ceph fs compat cephfs add_incompat 7 "mds uses inline data" the filesystem is working again. So should I leave this setting as it is now, or do I have to remove it again in a future update? If I understand it[1]

[ceph-users] Re: HEALTH_WARN: failed to probe daemons or devices after upgrade to 16.2.6

Hi! > no problem. Maybe you played around and had this node in the placement > section previously? Or did it have the mon label? I'm not sure, but > the important thing is that you can clean it up. Yes! I did play with another cluster before and forgot to completely clear that node! And the

[ceph-users] Re: No active MDS after upgrade to 16.2.6

Thanks- that worked for me. From: 胡 玮文 Sent: Saturday, September 18, 2021 11:02 AM To: Robert W. Eckert ; Ceph Users Subject: 回复: No active MDS after upgrade to 16.2.6 Hi Robert, You may hit the same bug as me. You can read this thread for details

[ceph-users] Re: anyone using cephfs or rgw for 'streaming' videos?

It may be a bit off from your use case, but I’m using CephFS with my Plex environment. Well, the Plex DB is on an RDB volume. All the media is on CephFS, and specifically on an EC pool just for Plex media. It’s been working pretty well for a few years now. I keep meaning to setup RGW, but so far

[ceph-users] Re: HEALTH_WARN: failed to probe daemons or devices after upgrade to 16.2.6

Hi, Hmm. 'cephadm ls' running directly on the node does show that there is mon. I don't quite understand where it came from and I don't understand why 'ceph orch ps' didn't show this service. Thank you very much for your help. no problem. Maybe you played around and had this node in the

[ceph-users] Re: Error: UPGRADE_FAILED_PULL: Upgrade: failed to pull target image

Here is the detail error. Thanks. root@ceph100:~# ceph health detail HEALTH_WARN Upgrade: failed to pull target image [WRN] UPGRADE_FAILED_PULL: Upgrade: failed to pull target image host ceph100 `cephadm pull` failed: cephadm exited with an error code: 1, stderr:Pulling container image

[ceph-users] anyone using cephfs or rgw for 'streaming' videos?

Currently I am bit testing with gstreamer, and thought about archiving streams in multiple formats, like hls and mkv. I thought it would be nice to use rgw to store files via an s3fs mount, and maybe have the proxy server cache the recent writes so clients would not even need to get data from

[ceph-users] Cache tiering adding a storage tier

Hi Everyone. I'm "new" to Ceph, only been administrating a cluster for about a year now, so there is a lot more for me to learn about the subject. The latest concept I've been looking into is Cache Tiering. I added it to my home cluster without a problem and didn't see a degradation in