On 23-10-15 14:58, Jon Heese wrote: > Hello, > > > > We have two separate networks in our Ceph cluster design: > > > > 10.197.5.0/24 - The "front end" network, "skinny pipe", all 1Gbe, > intended to be a management or control plane network > > 10.174.1.0/24 - The "back end" network, "fat pipe", all OSD nodes use 2x > bonded 10Gbe, intended to be the data network > > > > So we want all of the OSD traffic to go over the "back end", and the MON > traffic to go over the "front end". We thought the following would do that: > > > > public network = 10.197.5.0/24 # skinny pipe, mgmt & MON traffic > > cluster network = 10.174.1.0/24 # fat pipe, OSD traffic > > > > But that doesn't seem to be the case -- iftop and netstat show that > little/no OSD communication is happening over the 10.174.1 network and > it's all happening over the 10.197.5 network. > > > > What configuration should we be running to enforce the networks per our > design? Thanks! > >
Do the OSD nodes have a IP in 10.174.1.0/24? And are you sure this is in ceph.conf? What does 'ip a' show on the OSD nodes? > > /Jon Heese/ > /Systems Engineer/ > *INetU Managed Hosting* > P: 610.266.7441 x 261 > F: 610.266.7434 > www.inetu.net <https://www.inetu.net> > > /** This message contains confidential information, which also may be > privileged, and is intended only for the person(s) addressed above. Any > unauthorized use, distribution, copying or disclosure of confidential > and/or privileged information is strictly prohibited. If you have > received this communication in error, please erase all copies of the > message and its attachments and notify the sender immediately via reply > e-mail. **/ > > > > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > _______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
