>ht://Dig follows the robots exclusion standard. Create a robots.txt
>file in your server root directory (it is also required by most www
>search engines, which won't index your site correctly if this file
>is not present).
I thought this file was only necessary if one wanted to EXclude files, so
most of my sites don't have it. Where can I get more information on this
file and its format, etc?
c
--
Chris Lott <[EMAIL PROTECTED]> p907.474.6350 f907.474.6841
IT Specialist - University of Alaska Fairbanks
http://itdc.elmer.uaf.edu/chris/
"This sentence has threee erors."
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the SUBJECT of the message.
