I am a newbie of zookeeper and want to know whether zookeeper is
suitable for my application. If it does, then I will try to learn more
My problem can be described as a producer-consumer problem.
There is a thread that continue producing data files untill the
queue is full and then waiting consumer. Consumers can be divided into
2 categories -- Master and Slave. The data can not be removed from
queue unless it's consumed by master. The data will be removed
immediately if it consumed by all the consumers. But if the queue is
full, it will remove data that are consumed by Master. There will be
only one Master and many Slaves. The count of Slaves will change(it
seems zookeeper provide Ephemeral ZNode).
it seems that znode's size should less than 1 mb. but I will need
save large data file in a znode. Is there any solution for this?