What it means is that if you have a big database, get ready for Google to eat your CPU and bandwidth with mostly meaningless searches of your database. I will consider blocking any bots from searching my databases.
We had this exact problem at a former employer just with the standard Google bot. There were a couple of links on the site that led directly the searches in the search system, and the bot used them to jump into the search. It added a HUGE load to the search systems (Google Appliances, ironically enough) and the application servers. On Mon, Feb 23, 2009 at 9:53 AM, Ian S wrote: > > > As a web developer who routinely ties databases to my web sites to serve > dynamic information, what is this going to mean about how I build my > sites, what is going to happen when the data mining bots show up and > start churning through my data and what control am I going to have of my > data once it gets digested? > > So I am definitely split between, 'Wow, cool idea' and 'Oh my god, the > horrors! Won't anybody think of the data!?!' > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to date Get the Free Trial http://ad.doubleclick.net/clk;207172674;29440083;f Archive: http://www.houseoffusion.com/groups/cf-community/message.cfm/messageid:289565 Subscription: http://www.houseoffusion.com/groups/cf-community/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.5
