The “Network Configuration Reference” is always a good place to start: https://docs.ceph.com/en/latest/rados/configuration/network-config-ref/
Multiple client networks are possible ( see the “public_network” configuration option ) I believe you’d configure 2 “public_network”s: 1. For actual clients reading / writing data 2. For replication You might also consider dedicating a network for object replication ( “cluster_network” ). RGW multisite: https://docs.ceph.com/en/quincy/radosgw/multisite/ RBD mirroring: https://docs.ceph.com/en/latest/rbd/rbd-mirroring/ Hope that helps. Eric From: Jan Marek <[email protected]> Date: Monday, November 28, 2022 at 8:36 AM To: [email protected] <[email protected]> Subject: [EXTERNAL] [ceph-users] Ceph networking Hello, I have a CEPH cluster with 3 MONs and 6 OSD nodes with 72 OSDs. I would like to have multiple client and backed networks. I have now 2x 10Gbps and 2x25Gbps NIC in the nodes and my idea is to have: - 2 client network, for example 192.168.1.0/24 on 10Gbps NICs and 192.168.2.0/24 on 25Gbps NICs. One for my clients, one for asynchronous syncing to another cluster - 2 backend networks, say 10.0.1.0/24 on 10Gbps NICs and 10.0.2.0/24 on 25Gbps NICs to have multiple backend paths and/or more throughput. Is this scenario real? If my clients will be on 192.168.1.0/24 network, will mon give them a addresses of OSD nodes from 192.168.1.0/24 network, or it will give them addresses randomly? Please, have someone advice, how to set this networking optimally? Thanks a lot. Sincerely Jan Marek -- Ing. Jan Marek University of South Bohemia Academic Computer Centre Phone: +420389032080 http://www.gnu.org/philosophy/no-word-attachments.cs.html _______________________________________________ ceph-users mailing list -- [email protected] To unsubscribe send an email to [email protected]
