Ken Moffat wrote:
Anyone know the function of robots.txt? I have seen attempted access to it in my apache logs.

Ah, never mind, I found a page describing this functionality.


http://www.robotstxt.org/wc/exclusion.html

--
Ken Moffat
[EMAIL PROTECTED]


_______________________________________________
Linux-users mailing list
[EMAIL PROTECTED]
Unsubscribe/Suspend/Etc -> http://www.linux-sxs.org/mailman/listinfo/linux-users

Reply via email to