>>> [EMAIL PROTECTED] 05/03/01 09:21pm >>>
> That process would be possible, but because of various
computational
> complexity issues it would only be 1 or 2 percent faster than
simply
> running Analog with a date range of one day for each one day period
you
> want numbers for. Since there is so little to be gained, it is
simpler to
> just run Analog many times.
I do not agree on that.
Let's say you have a 2 GB log file per month. You have to run
analog 30
times on this file. This means that analog parses the 2GB file 30
times
(because analog do not presume that lines are ordered by date in log
files -
I _hope_ I'm wronk on that).
Of course you can break the file in 30 chuncks (with bash,
perl, etc) and
run analog 30 times on coresponding chunk and then build up the
result file
from the partial result files.
And now to have the full picture of the mess, let's say you
have 30
web-sites with thousands of visitors.
I'm going to come to the developers' defence on this. As it stands,
Analog performs all of its processing in memory. This enhancement is
just short of requiring a database or series of temporary files. We
already have the very major potential for conflicts involving pie
charts when two users are running simultaneously. Imagine the chaos
if two or three users are trying to process against a series of files
in /tmp or some other location. Unix users have it over NT users in
that filenames can be suffixed with the process id. (Yes, you can do
the same with NT.) Is it worth the expense of already valueable disk
space to stream copies of 20-30GB logs into temporary storage?
Michael Mohr
UNIX Systems Administrator
Auckland University of Technology
Private Bag 92006
Auckland, NZ
Tel: (649) 917-9999, ext 8133
Fax: (649) 917-9901
+------------------------------------------------------------------------
| This is the analog-help mailing list. To unsubscribe from this
| mailing list, go to
| http://lists.isite.net/listgate/analog-help/unsubscribe.html
|
| List archives are available at
| http://www.mail-archive.com/[email protected]/
| http://lists.isite.net/listgate/analog-help/archives/
| http://www.tallylist.com/archives/index.cfm/mlist.7
+------------------------------------------------------------------------
