Rick,
I can help you out with this. I would need to know more info
about your situation. Email me off list at [EMAIL PROTECTED] and I
will be able to help u out.
==============================
Joel Blanchette
IT and System Specialist
Point of Impact Technologies Inc.
Tel: (204) 989-0013
Email: [EMAIL PROTECTED]
==============================
-----Original Message-----
From: cfhelp [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, November 26, 2002 7:15 PM
To: CF-Talk
Subject: GoogleBot Robot.txt
I have put a robots.txt file in the root of my site to stop it from
accessing subdirectories. But GoogleBot is still accessing all the files
in my root bit some of the files do not run without passing a variable
to them. So my Application Logfile is full of errors.
So I want to know if it is a good idea to put this in my Application.cfm
file?
<cfif HTTP_USER_AGENT IS 'Googlebot/2.1
(+http://www.googlebot.com/bot.html)'>
<html>
<head>
<title>Site Title</title>
<meta tags>
</head>
<body>
Text from the About page
</body>
</html>
<cfabort>
</cfif>
This way Google gets to spider all pages and I don't get any errors.
Rick
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Archives: http://www.houseoffusion.com/cf_lists/index.cfm?forumid=4
Subscription:
http://www.houseoffusion.com/cf_lists/index.cfm?method=subscribe&forumid=4
FAQ: http://www.thenetprofits.co.uk/coldfusion/faq
Your ad could be here. Monies from ads go to support these lists and provide more
resources for the community. http://www.fusionauthority.com/ads.cfm
