I have put a robots.txt file in the root of my site to stop it from accessing subdirectories. But GoogleBot is still accessing all the files in my root bit some of the files do not run without passing a variable to them. So my Application Logfile is full of errors.
So I want to know if it is a good idea to put this in my Application.cfm file? <cfif HTTP_USER_AGENT IS 'Googlebot/2.1 (+http://www.googlebot.com/bot.html)'> <html> <head> <title>Site Title</title> <meta tags> </head> <body> Text from the About page </body> </html> <cfabort> </cfif> This way Google gets to spider all pages and I don't get any errors. Rick ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4 Subscription: http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribe&forumid=4 FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Structure your ColdFusion code with Fusebox. Get the official book at http://www.fusionauthority.com/bkinfo.cfm
