Have you checked your error_log? .... It's probably asking for /robots.txt
and similiar ....
---
David Zverina
Alt Key Pty. Ltd.
http://www.altkey.com
PO Box 3121, Parramatta, 2124, Australia
> -----Original Message-----
> From: [EMAIL PROTECTED]
> [mailto:[EMAIL PROTECTED]]On Behalf Of Terry Collins
> Sent: Saturday, 29 January 2000 15:01
> To: Slug
> Subject: [SLUG] Search engine activity
>
>
> Hello Folks
>
> I'm looking for an ideal to find out exactly what a search engine is
> looking for. ix5.fast-search.net (209.67.247.157) is logged as coming
> in through my tcpgate (http redirector) on the firewall about every 10
> minutes, but a request only shows up on the WWW server
> httpd/access_log every 20-30 minutes. (it is currently indexing (?)
> the slug archives for May/99).
>
> Is there some way of showing what is happening to the other requests?
>
> It is not the only search engine that seems to hang around for days
> like a bad smell.
>
> --
> Terry Collins {:-)}}} Ph(02) 4627 2186 Fax(02) 4628 7861
> email: [EMAIL PROTECTED] www: http://www.woa.com.au
> WOA Computer Services <lan/wan, linux/unix, novell>
> snail: PO Box 1047, Campbelltown, NSW 2560.
>
> "People without trees are like fish without clean water"
> --
> SLUG - Sydney Linux Users Group Mailing List - http://www.slug.org.au
> To unsubscribe send email to [EMAIL PROTECTED] with
> unsubscribe in the text
>
--
SLUG - Sydney Linux Users Group Mailing List - http://www.slug.org.au
To unsubscribe send email to [EMAIL PROTECTED] with
unsubscribe in the text
