Re: [ceph-users] mount cephfs from a public network ip of mds

2018-10-01 Thread Joshua Chen
Thank you for all your reply. I will consider changing the design or negotiate with my colleagues for the topology issue. Or if all are not working, try to come back to this solution. Cheers Joshua On Mon, Oct 1, 2018 at 9:05 PM Paul Emmerich wrote: > No, mons can only have exactly one IP

Re: [ceph-users] mount cephfs from a public network ip of mds

2018-10-01 Thread Paul Emmerich
No, mons can only have exactly one IP address and they'll only listen on that IP. As David suggested: check if you really need separate networks. This setup usually creates more problems than it solves, especially if you have one 1G and one 10G network. Paul Am Mo., 1. Okt. 2018 um 04:11 Uhr

Re: [ceph-users] mount cephfs from a public network ip of mds

2018-10-01 Thread John Petrini
Multiple subnets are supported. http://docs.ceph.com/docs/master/rados/configuration/network-config-ref/#id1 ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] mount cephfs from a public network ip of mds

2018-09-30 Thread David Turner
I doubt you have a use case that requires you to have a different public and private network. Just use 1 network on the 10Gb nics. There have been plenty of mailing list threads in the last year along with testing and production experience that indicate that having the networks separated is not

Re: [ceph-users] mount cephfs from a public network ip of mds

2018-09-30 Thread Joshua Chen
Hello Paul, Thanks for your reply. Now my clients will be from 140.109 (LAN, the real ip network 1Gb/s) and from 10.32 (SAN, a closed 10Gb network). Could I make this public_network to be 0.0.0.0? so mon daemon listens on both 1Gb and 10Gb network? Or could I have public_network =

Re: [ceph-users] mount cephfs from a public network ip of mds

2018-09-29 Thread David Turner
The cluster/private network is only used by the OSDs. Nothing else in ceph or its clients communicate using it. Everything other than osd to osd communication uses the public network. That includes the MONs, MDSs, clients, and anything other than an osd talking to an osd. Nothing else other than

Re: [ceph-users] mount cephfs from a public network ip of mds

2018-09-29 Thread Paul Emmerich
All Ceph clients will always first connect to the mons. Mons provide further information on the cluster such as the IPs of MDS and OSDs. This means you need to provide the mon IPs to the mount command, not the MDS IPs. Your first command works by coincidence since you seem to run the mons and

[ceph-users] mount cephfs from a public network ip of mds

2018-09-29 Thread Joshua Chen
Hello all, I am testing the cephFS cluster so that clients could mount -t ceph. the cluster has 6 nodes, 3 mons (also mds), and 3 osds. All these 6 nodes has 2 nic, one 1Gb nic with real ip (140.109.0.0) and 1 10Gb nic with virtual ip (10.32.0.0) 140.109. Nic1 1G<-MDS1->Nic2 10G 10.32.