On Sun, Oct 13, 2002, [EMAIL PROTECTED] wrote:
> On one of the websites I run I'm getting a whole series of access log
> entries eg:
> 
> 209.237.238.162 - - [11/Oct/2002:20:20:52 +1000] "GET /booklist.htm
> HTTP/1.0" 200 36942 "-" "ia_archiver"
> 
> Has anyone run across this "ia_archiver" and have any info on it?

It's the robot that saves archives of your pages for
http://www.archive.org/, which is a site aiming to preserve "snapshots"
of the web for posterity.

If you aren't particularly interested in having it archive your website
(reasons include not liking the idea generally, privacy concersn etc
etc) you can keep it out with /robots.txt. Details are at
http://www.archive.org/about/exclude.php

Follow-ups to slug-chat please.

-Mary
-- 
SLUG - Sydney Linux User's Group - http://slug.org.au/
More Info: http://lists.slug.org.au/listinfo/slug

Reply via email to