> :Are all your log file formats the same? If one file does not have any byte
> :counts it may not be included in the Directory Report if the DIRFLOOR is set
> :by bytes (I am guessing, I don't know if this is true or not).

All the log files are the same.  The format is dictated in the global 
httpd.conf file, and all logs apart from that use that file for their log 
format, so they are all in CLF.

I'm okay with the ones that have no bytes in them not being included, but 
the problem is that logs with massive amounts of transfers from legit, 
non-excluded hosts that should be counted, aren't.

> :You could turn on debugging and watch the output from Analog and make sure
> :it's reading all the log files.

Good point.  I'll give this a try, though the output is already pretty 
verbose since I get a ton of "May be duplicate counting" type messages 
which I know are expected and legit, but already verbose :-)

> :If you start with one of the problem files and start adding other files is
> :there some identifiable point when it stops showing results for the problem
> :file?

I actually did this already.  I removed all files but one and ran analog.  
When that ran fine, I added another.  I did this repetedly until I noticed 
that files were missing that were there before.  Upon removing the file I 
just added and re-running analog, the file did not re-appear which was 
strange.

In all of my experiments, there seemed to be no definitive break point for 
the program to start excluding files from what I can tell.

However, is there anything that anyone has noticed that causes analog to 
bug out like this that maybe I could examine?  Excessive log line sizes? 
(not excessive log file sizes, just line lengths).

Thanks for your assistance so far, Jeremy.

--Larry

> :-- 
> :Jeremy Wadsack
> :Seven Simple Machines
> :
> :
> :Larry Reckner wrote:
> :
> :> I have an analog setup where I gather stats for our shared hosting from
> :> seperate logs.  Each client has their own transfer log, and it is easier to
> :> combine it all into one place to look at each customer.
> :> 
> :> Running off of the example from
> :> http://www.analog.cx/how-to/vhosts1/index.html I created a config file that
> :> looks something like:
> :> 
> :> OUTFILE /home/ea/website/html/stats/shared-stats.html
> :> 
> :> # from the beginning of last month
> :> FROM -00-0101
> :> # to the end of last month
> :> TO -00-0131
> :> 
> :> HOSTNAME "Shared Customers"
> :> LASTSEVEN OFF
> :> 
> :> HOSTEXCLUDE 209.23.*
> :> HOSTEXCLUDE 216.207.137.*
> :> HOSTEXCLUDE *.5points.net
> :> 
> :> LOGFILE /var/log/httpd/*customer1.com.access*   http://www.customer1.com
> :> 
> :> LOGFILE /var/log/httpd/*customer2.org.access*   http://www.customer2.org
> :> 
> :> LOGFILE /var/log/httpd/*customer3.access*       http://www.customer3.com
> :> 
> :> <more of the same removed for space>
> :> 
> :> SUBDIR http://*
> :> 
> :> DIRFLOOR 0b
> :> REQFLOOR 1R
> :> 
> :> DIRCOLS PBR
> :> DIRSORTBY BYTES
> :> 
> :> 
> :> Now, the problem that I have is that not all of the customers show up in 
> the
> :> output.  Most of them do, but not all of them.  13 or so out of the 60 
> don't
> :> show up at all.  Now, originally I figured that it was because they had no
> :> stats at all, and for some this is the case but not most that aren't 
> showing
> :> up.  Many have a lot of page hits and should register.
> :> 
> :> I removed *all* of the LOGFILE entries except one of the problimatic
> :> clients, and it worked fine.  Put them back in and they no longer register.
> :> 
> :> Is there some setting that I'm missing, or something that is wrong in what
> :> I'm doing, or has anyone run across the same problem?
> :> 
> :> I'm currently running Analog 6.0 on a Linux box, but the problem has 
> existed
> :> since version 5 (when I first started doing this stats trick).
> :> 
> :> Thanks for any assistance in advance.
> :> 
> :> --Larry
> :
> :
> :+------------------------------------------------------------------------
> :|  TO UNSUBSCRIBE from this list:
> :|    http://lists.meer.net/mailman/listinfo/analog-help
> :|
> :|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
> :|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
> :+------------------------------------------------------------------------
> :
+------------------------------------------------------------------------
|  TO UNSUBSCRIBE from this list:
|    http://lists.meer.net/mailman/listinfo/analog-help
|
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
+------------------------------------------------------------------------

Reply via email to