> Does anyone else see CFerrors from Yahoo's spider / bot > Slurp? We monitor all CFerrors that are generated on our > servers. It seems that Yahoo! Slurp is responsible for over > 60% of the errors per week that are thrown by our production > webservers. It looks like Slurp is appending almost random > values to the query strings. id=5%E2%84%91=2 or it may > append an old URL var that has not been used for years like > "view=archive". (This one throws a "CF_SQL_NUMERIC" error > now.) Does anyone know of a way I can get Slurp to stop > hitting these pages with invalid URL vars? And still keep > Slurp indexing the site normaly?
robots.txt? Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ Fig Leaf Software provides the highest caliber vendor-authorized instruction at our training centers in Washington DC, Atlanta, Chicago, Baltimore, Northern Virginia, or on-site at your location. Visit http://training.figleaf.com/ for more information! ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Discover CFTicket - The leading ColdFusion Help Desk and Trouble Ticket application http://www.houseoffusion.com/banners/view.cfm?bannerid=48 Message: http://www.houseoffusion.com/lists.cfm/link=i:4:195779 Archives: http://www.houseoffusion.com/cf_lists/threads.cfm/4 Subscription: http://www.houseoffusion.com/lists.cfm/link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4 Donations & Support: http://www.houseoffusion.com/tiny.cfm/54
