Looks like you are running the default access log settings.
For logging of user-agent and referer (when given) try:
CustomLog logs/access_log combined
http://httpd.apache.org/docs/1.3/logs.html#accesslog
HTH,
Jon
Scott Purcell wrote:
I really would like to find out how my (and if my site)
Markus Schönhaber wrote:
Then you might want to take a look at this link
http://www.robotstxt.org/wc/active.html
Better start here:
http://www.robotstxt.org/wc/robots.html
This is what Tim really posted.
Regards
mks
-
To
Hi Scott,
look at awstats ( http://awstats.sourceforge.net ). This projects
parses Apache httpd's logs and can determine who's bot and who's not.
Maybe you find there some insteresting informations.
PETR
On 3/27/06, Jon Wingfield [EMAIL PROTECTED] wrote:
Looks like you are running the default
What I do is look at the IP addresses that access robots.txt and
consider any similar IP address to be a robot. Similar means the
same first 3 bytes - often the requests for pages come from a
different machine than the one that checked robots.txt. It's not
perfect but it works pretty well.
You
