I've seen a number of these built as proprietary solutions using
ZooKeeper. It would be great to see something open sourced. HBase/ZK
seems like a good fit. You might also consider ZooKeeper/BookKeeper.
Patrick
On 06/18/2010 11:01 AM, Thomas Koch wrote:
http://stackoverflow.com/questions/3072042/free-software-solution-to-
continuously-load-a-large-number-of-feeds-with-several
I need a system that schedules and conducts the loading of a large number of
Feeds. The scheduling should consider priority values for feeds provided by me
and the history of past publish frequency of the feed. Later the system should
make use of pubsub where available.
Currently I'm planning to implement my own system based on HBase and
ZooKeeper. If there isn't any free software solution by now, then I'd propose
at work to develop our solution as Free Software.
Thank you for any hints,
Thomas Koch, http://www.koch.ro
