Feed Aggregation is becoming an entire business niche. - The most popular open source aggregator is Planet:Planet. But it's Python.
- There are a number of plugins for the various popular blog engines for the smaller scale needs. But nothing CF there. - Then there's the big business aggregators like NewsGator that offer both online aggregators or Enterprise installs and Private Label customized options. Their enterprise version is .NET but appears to have an API and webservices for integrating into intranet portals and such. Not much to get you started in CF, unfortunately. As for implementations for keeping the feeds current, I've seen three approaches: 1. Scheduled polling like you mentioned. This is the easiest to do, but obviously it's a brute force approach that puts the most strain on all the resources involved. 2. User triggered retrieve and cache. When someone actually looks at the aggregator information for a particular content area, do a lookup at that point and then cache that for a period of time so that it's not updating for each user hit. This is similar to how many desktop aggregator tools work. 3. Webservice triggers in the blogs you poll. For instance, in the WordPress software there's a screen in the admin to add any webservices you want to notify of updates to the blog. This is the most elegant technically, but obviously only works with feeds that can notify a webservice of updates. And of course, there's the mix and blend of all the above. For instance, using method 2's user triggers to make sure that blogs being aggregated are actually of use to the viewer and then adding it to method 1's scheduled polling queue for a period of time. Here's a blog covering the Aggregation industry. http://www.niallkennedy.com/blog/archives/software/feed_aggregators/ Have fun! --- Kevin Graeme Cooperative Extension Technology Services University of Wisconsin-Extension > -----Original Message----- > From: Yves Arsenault [mailto:[EMAIL PROTECTED] > Sent: Tuesday, March 07, 2006 7:08 PM > To: CF-Talk > Subject: RSS site like fullasagoog.com > > Hey there, > > I'm considering attempting to build a similar site to fullasagoog.com. > > Basically, pull in feeds from many different blogs and sort > them (DESC). > > I'm wondering if anyone has built something similar and would > maybe have > some suggestions on what to look out for. > > Also, I guess I'm not sure what the best approach would be. > > Pulling the feeds and storing into a database, then display and sort. > Should I run a script every few minutes to check the feeds > for new entries? > And when the page is loaded, I would use some query caching > so as not to . > > Having never done a whole lot with rss feeds other than > simply displaying > their contents... just trying to find the most efficiant way > to go about. > > Thanks, > > -- > Yves Arsenault > > "Love is the only force capable of transforming an enemy into > a friend". > --Martin Luther King, Jr. > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Message: http://www.houseoffusion.com/lists.cfm/link=i:4:234600 Archives: http://www.houseoffusion.com/cf_lists/threads.cfm/4 Subscription: http://www.houseoffusion.com/lists.cfm/link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4 Donations & Support: http://www.houseoffusion.com/tiny.cfm/54
