On 2/21/2009 1:27 PM, Iain Hunneybell wrote:

As for page counts, my best rationalisation is that the high overnight count
is spiders and so analog is correctly showing page requests that aren't
being recorded by the page view 'bug'. Then over day proxies are causing the
page bug to record higher page views than seen by the servers. It's the best
rationalisation I've come up with so far!

You should be able to test that by using FROM and TO and doing a log analysis for an hour in the middle of the night, and looking at the Full Browser report. Most well behaved spiders identify themselves.

You can also do a Full Browser report on requests for /robots.txt and then use that to create a list of BROWEXCLUDE commands so that you can see if the human-driven traffic patterns make more sense.

Aengus
+------------------------------------------------------------------------
|  TO UNSUBSCRIBE from this list:
|    http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+------------------------------------------------------------------------

Reply via email to