Hi Erwin, > So, my question is how do the clients know to use my infiniband > interconnect when communicating directly with the OSDs. > > Obviously, I have specified an IP address for the MDS, so the clients > know that they have to talk to the MDS via that route, but > > the communication channel between the client (kernel client) and the > OSDs have not been directly specified.
The monitor's IP is specified via monmaptool when the monmap is generated. By default, everything else determines it's address during it's initial communication with the monitor as it starts up: cmon looks at the remote address for the socket, and passes that address back to osd or mds or client. So in your situation, it just depends what source IP your other nodes use when contacting the 10.whatever IPoIB address. You can also specify the address to bind to manually on the command line with '--bind $ip', if the autodetection behavior doesn't work in your environment for some reason. sage ------------------------------------------------------------------------- Check out the new SourceForge.net Marketplace. It's the best place to buy or sell services for just about anything Open Source. http://sourceforge.net/services/buy/index.php _______________________________________________ Ceph-devel mailing list Ceph-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ceph-devel
