On Wed, Jan 18, 2012 at 07:37, Andrey Stepachev <[email protected]> wrote: > I've test ceph against laggy network. (0ms-400ms delays).
400ms? Are you circling the Earth once with every packet? For reference, west coast of US <-> Europe is less than 200ms. Ceph is not suitable for a WAN / satellite / etc setups. It assumes the cluster is co-located, and just honestly is aimed at network speeds upwards from 1Gbps. Anything else would require completely different caching and replication mechanisms. You can't maintain cache coherency across such huge latencies, without making the user experience slow (as you observed). > After such strange hangouts i found, that rm -rf on filesystem > (mounted via kernel), > fs shows, that 210Gb still in use. Looking at /data/osd.x i found many > objects inside. > So: > a) looks like some errors lead us to orphaned objects in rados > b) i can't find utility, which can check that orpaned data (and cleanup it) Object removal is done in the background. Give it some time, and good networking, and you should get the free space back. -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to [email protected] More majordomo info at http://vger.kernel.org/majordomo-info.html
