Sure. But it depends on what the OP's requirements are. If he is simply
trying to prevent search engines from indexing certain folders, he should be
fine?

Will

-----Original Message-----
From: Claude Schneegans [mailto:[EMAIL PROTECTED] 
Sent: 13 February 2008 17:09
To: CF-Talk
Subject: Re: OT: How to stop bots indexing my dev sites

 >>Use robots.txt:

This is correct to control good bots, but bad bots don't read it.
Some (very) bad bots even exploit what is in the file to read what's
forbidden.



~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Adobe® ColdFusion® 8 software 8 is the most important and dramatic release to 
date
Get the Free Trial
http://ad.doubleclick.net/clk;160198600;22374440;w

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:298903
Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm
Unsubscribe: 
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4

Reply via email to