Re: is zookeeper suitable for my application?

2010-10-08 Thread Ted Dunning
ZK provides all of the coordination you need for this problem, but you should store your data elsewhere. Any key-data store with decent read-write speed will suffice. Memcache would be reasonable for that if you don't need persistence in the presence of failure. Voldemort would be another altern

Re: is zookeeper suitable for my application?

2010-10-08 Thread Milind Parikh
There are existing recipes that you will be able to modify for your needs. Ymmv but look at the double barrier recipe. The key thing to design around in high. Scalability based solution is the herding effect. Perhaps look @ couchdb to store your files for znode? Regards Milind On Oct 8, 2010 3:31

is zookeeper suitable for my application?

2010-10-08 Thread Li Li
hi all, I am a newbie of zookeeper and want to know whether zookeeper is suitable for my application. If it does, then I will try to learn more about it. My problem can be described as a producer-consumer problem. There is a thread that continue producing data files untill the queue is