> looking at tcpdump all the traffic is going exactly where it is supposed to > go, in particular an osd on the 192.168.228.x network appears to talk to an > osd on the 192.168.229.x network without anything strange happening. I was > just wondering if there was anything about ceph that could make this > non-optimal, assuming traffic was reasonably balanced between all the osd's > (eg all the same weights). I think the only time it would suffer is if writes > to other osds result in a replica write to a single osd, and even then a > single OSD is still limited to 7200RPM disk speed anyway so the loss isn't > going to be that great.
Should be fine given you only have a 1:1 ratio of link to disk. > I think I'll be moving over to bonded setup anyway, although I'm not sure if > rr or lacp is best... rr will give the best potential throughput, but lacp > should give similar aggregate throughput if there are plenty of connections > going on, and less cpu load as no need to reassemble fragments. One of the DreamHost clusters is using a pair of bonded 1GbE links on the public network and another pair for the cluster network, we configured each to use mode 802.3ad. -- Kyle _______________________________________________ ceph-users mailing list [email protected] http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
