I have been able to successfully set up a "small test cluster" using
your instructions on the wiki.
Currently, I have 8 different machines all interconnected with Ethernet
and Infiniband.
To have the clients talk to the MDS over the ethernet, i simply set up
my MDS via the command:
monmaptool --create --clobber --add 172.22.8.14:12345 --print
.ceph_monmap
I am runing IP over the infiniband, so if i want my MDS to be set up
using the infiniband, i type the command:
"monmaptool --create --clobber --add 10.0.1.14:12345 --print
.ceph_monmap"
Where 172.22.8.14 is the IP address of the MDS over ethernet, and
10.0.1.14 is the address over infiband.
As I have read a little bit about how Ceph works, I understand that
communication between the client and the
MDS is only necessary for such operations such as open(), close(),
etc...
For operations that involve reading and writing directly to files, the
clients can communicate directly with the OSDs.
So, my question is how do the clients know to use my infiniband
interconnect when communicating directly with the OSDs.
Obviously, I have specified an IP address for the MDS, so the clients
know that they have to talk to the MDS via that route, but
the communication channel between the client (kernel client) and the
OSDs have not been directly specified.
Thanks,
-Brock
-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://sourceforge.net/services/buy/index.php
_______________________________________________
Ceph-devel mailing list
Ceph-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ceph-devel
