Hello, Kev! AFAIK, it's definitely better to have 50 nodes with 1 OSD than 5 nodes with 10 OSDs each. In the first case your OSD will not compete for resources (CPU, memory, network and controller bandwidth etc) with another OSDs. You will need to sacrifice to ceph only a little part of your compute node resources. At the same time you'll have better failure resolution: in case of any of your node failure it will be necessary to recover data from the only one drive (in opposite to 10 drives in the second case). And so on.
Best regards, Vladimir 2017-05-22 21:36 GMT+05:00 kevin parrikar <[email protected]>: > hello All, > I have 50 compute nodes in my environment which are running virtual > machines.I can add one more 10k RPM SAS disk and 1X10G interface to each > server and thus there will be 50 OSD running on 50 compute nodes. Its not > easy to obtain more servers for running Ceph nor taking away servers from > existing pool. > > *Question:* > Will there be performance impact running 1 OSD process each on 50 servers > *vs* 10 OSD process each on 5 servers? > > I asked some of the guys who have worked on ceph in large scale before, > but they all say i should run more OSD process per node to get performance > over 1 OSD per node but they are not able to justify it. > > can someone please clarify about the performance difference between these > two. > > Regards, > Kev > > > _______________________________________________ > ceph-users mailing list > [email protected] > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > >
_______________________________________________ ceph-users mailing list [email protected] http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
