[ceph-users] Re: cephfs ha mount expectations

2022-10-27 Thread Eugen Block
Hi, Thanks for the interesting discussion. Actually it's a bit disappointing to see that also cephfs with multiple MDS servers is not as HA as we would like it. it really depends on what you're trying to achieve since there are lots of different scenarios how to setup and configure one

[ceph-users] Re: cephfs ha mount expectations

2022-10-26 Thread mj
Hi all, Thanks for the interesting discussion. Actually it's a bit disappointing to see that also cephfs with multiple MDS servers is not as HA as we would like it. I read also that filover time depends on the number of clients. We will only have three, and they will not do heavy IO. So

[ceph-users] Re: cephfs ha mount expectations

2022-10-26 Thread Eugen Block
Just one comment on the standby-replay setting: it really depends on the use-case, it can make things worse during failover. Just recently we had a customer where disabling standby-replay made failovers even faster and cleaner in a heavily used cluster. With standby-replay they had to

[ceph-users] Re: cephfs ha mount expectations

2022-10-26 Thread Robert Gallop
I use this very example, few more servers. I have no outage windows for my ceph deployments as they support several production environments. MDS is your focus, there are many knobs, but MDS is the key to client experience. In my environment, MDS failover takes 30-180 seconds, depending on how

[ceph-users] Re: cephfs ha mount expectations

2022-10-26 Thread William Edwards
> Op 26 okt. 2022 om 10:11 heeft mj het volgende > geschreven: > > Hi! > > We have read https://docs.ceph.com/en/latest/man/8/mount.ceph, and would like > to see our expectations confirmed (or denied) here. :-) > > Suppose we build a three-node cluster, three monitors, three MDSs, etc, in