> -----Original Message-----
> From: Che Vilnonis [mailto:[EMAIL PROTECTED]
> Sent: Friday, May 27, 2005 7:30 AM
> To: CF-Talk
> Subject: Robot.txt question... security issue?
> 
> A client of ours recently had a security audit on their web site. The
> audit
> recommended that we remove all 'disallow: /xyz/' entries since a potential
> hacker could read the robots.txt file and surmise which folders may be
> sensitive.
> 
> Here's my question, if I remove all of the [disallow: /xyz/] lines from
> the
> robots.txt file, how do I stop the search engines from indexing those
> directories?

I would personally ignore the recommendation.  ;^)

(Or more specifically, consider the ramifications of the recommendation and
the choose not to follow it.)

It's like saying that putting a lock on a door let's thieves know that
there's something to protect behind it.  While it may be true that doesn't
mean you don't put a lock on it.

In other words they are correct in that the contents of the Robots.txt might
give hackers a clue, but so will form actions and many other things - that
doesn't mean you shouldn't use them.

Jim Davis





~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Logware (www.logware.us): a new and convenient web-based time tracking 
application. Start tracking and documenting hours spent on a project or with a 
client with Logware today. Try it for free with a 15 day trial account.
http://www.houseoffusion.com/banners/view.cfm?bannerid=67

Message: http://www.houseoffusion.com/lists.cfm/link=i:4:207868
Archives: http://www.houseoffusion.com/cf_lists/threads.cfm/4
Subscription: http://www.houseoffusion.com/lists.cfm/link=s:4
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Donations & Support: http://www.houseoffusion.com/tiny.cfm/54

Reply via email to