Re: Free Software Solution to continuously load a large number of feeds with several servers?
You don't say what you mean by feed. The bixo system might be helpful to you. http://bixolabs.com/ On Fri, Jun 18, 2010 at 11:01 AM, Thomas Koch wrote: > http://stackoverflow.com/questions/3072042/free-software-solution-to- > continuously-load-a-large-number-of-feeds-with-several > > I need a system that schedules and conducts the loading of a large number > of > Feeds. The scheduling should consider priority values for feeds provided by > me > and the history of past publish frequency of the feed. Later the system > should > make use of pubsub where available. > Currently I'm planning to implement my own system based on HBase and > ZooKeeper. If there isn't any free software solution by now, then I'd > propose > at work to develop our solution as Free Software. > > Thank you for any hints, > > Thomas Koch, http://www.koch.ro >
Re: Free Software Solution to continuously load a large number of feeds with several servers?
I've seen a number of these built as proprietary solutions using ZooKeeper. It would be great to see something open sourced. HBase/ZK seems like a good fit. You might also consider ZooKeeper/BookKeeper. Patrick On 06/18/2010 11:01 AM, Thomas Koch wrote: http://stackoverflow.com/questions/3072042/free-software-solution-to- continuously-load-a-large-number-of-feeds-with-several I need a system that schedules and conducts the loading of a large number of Feeds. The scheduling should consider priority values for feeds provided by me and the history of past publish frequency of the feed. Later the system should make use of pubsub where available. Currently I'm planning to implement my own system based on HBase and ZooKeeper. If there isn't any free software solution by now, then I'd propose at work to develop our solution as Free Software. Thank you for any hints, Thomas Koch, http://www.koch.ro
Free Software Solution to continuously load a large number of feeds with several servers?
http://stackoverflow.com/questions/3072042/free-software-solution-to- continuously-load-a-large-number-of-feeds-with-several I need a system that schedules and conducts the loading of a large number of Feeds. The scheduling should consider priority values for feeds provided by me and the history of past publish frequency of the feed. Later the system should make use of pubsub where available. Currently I'm planning to implement my own system based on HBase and ZooKeeper. If there isn't any free software solution by now, then I'd propose at work to develop our solution as Free Software. Thank you for any hints, Thomas Koch, http://www.koch.ro
