I've thought about that... but, what's the best way to implement it?
Maybe...
don't append cfid/cftoken
append cfid/cftoken
Without keeping a massive list of search engine UA's, is there a another way
to check for spiders? Or, would you just comprise a list of the top
crawlers, and if so, any suggestions on a list of (popular) words to test
against?
-Brad
-Original Message-
From: Thomas Chiverton [mailto:[EMAIL PROTECTED]
Sent: Friday, March 19, 2004 8:40 AM
To: CF-Talk
Subject: Re: Search Engines & CFID/CFTOKEN
On Friday 19 Mar 2004 13:22 pm, Brad Roberts wrote:
> append cfid/cftoken to every url. However, I don't want search engines
to
> index my sites with a cfid/cftoken. Any way around this?
Check the browser string and do something different if it's a spider.
--
Tom Chiverton
Advanced ColdFusion Programmer
Tel: +44(0)1749 834997
email: [EMAIL PROTECTED]
BlueFinger Limited
Underwood Business Park
Wookey Hole Road, WELLS. BA5 1AF
Tel: +44 (0)1749 834900
Fax: +44 (0)1749 834901
web: www.bluefinger.com
Company Reg No: 4209395 Registered Office: 2 Temple Back East, Temple
Quay, BRISTOL. BS1 6EG.
*** This E-mail contains confidential information for the addressee
only. If you are not the intended recipient, please notify us
immediately. You should not use, disclose, distribute or copy this
communication if received in error. No binding contract will result from
this e-mail until such time as a written document is signed on behalf of
the company. BlueFinger Limited cannot accept responsibility for the
completeness or accuracy of this message as it has been transmitted over
public networks.***
[Todays Threads]
[This Message]
[Subscription]
[Fast Unsubscribe]
[User Settings]
