On Tuesday, January 31, 2006 1:57 PM [EDT],
Sean O Sullivan <[EMAIL PROTECTED]> wrote:

> Aengus wrote:
>> On Tuesday, January 31, 2006 12:54 PM [EDT],
>> Sean O Sullivan <[EMAIL PROTECTED]> wrote:
>>
>>>> You may need to split your report in two - for example, turn off
>>>> the host and domain report in your main run, to free up the memory
>>>> they take up, and then run a second report with everything turned
>>>> off except those reports.
>>> If I did this - I would have to manually put report/html file
>>> together? - since it just overwrites each report file, that or
>>> create multiple reports/html files ...
>>
>> If you wanted them ll in a single file, you'd have to cut and paste.
>> Just use "OUTFILE hosts.html" for the report that uses Host data
>> (Host, Domain, Organization), etc. You could also create a seperate
>> report for Browser and OS information, as that's usually a bit more
>> static, and not usually as critical.
>>
>> The commands that will llow you to maximize this 2 report strategy
>> are listed in http://analog.cx/docs/lowmem.html
>>
>>>> How long does Analog take to generate the reports?
>>> Start of the month ~16-20mins, end of the month 2+hours.
>>> Dual 3Ghz machine (with HT), and 4GB memory.
>>
>> Then running a second report isn't out of the question, if it solves
>> the problem.
>>
>>> p.s. just ran analog off just cache files with FILEEXCLUDE option
>>> instead of REQEXCLUDE - just bombed out due to lack of memory.
>>
>> I'm surprised, though I suppose the total number of unique files
>> isn't likely to be that large, compared to the number of unique
>> hosts, for example (given the size of your logs), so maybe it's not
>> that surprising.
>
> I'll take a look at doing multiple reports then, and hopefully will
> solve issue.
>
> I assume then that the low memory issue would also be what is causing
> the empty 7-day results I mentioned?
> Just to give example :
>
> Failed Referrer Report:
>
> This report lists the referrers containing broken links to the site.
> Listing referring URLs with at least 1 failed request in the last 7
> days, sorted by the number of failed requests in the last 7 days.
>
> reqs 7-day reqs URL
> 17,163,077 0 [not listed: 30,923 URLs]
>
> I can only assume this relates to memory - since if it was a case
> where it couldn't do last 7-day totals, it would/should at the very
> least give a non-null number, since it has at minimum one day of logs
> which it is working with.

Unless you specify a TO, the last 7 days are the 7 days before today. If the
log files are from January 16th and 17th, then there haven't been any
requests in the last 7 days. (Analog doesn't know what the last day in the
log is until it has read the whole logfile, and by then it's too late to go
back and figure out which requests were in the last 7 days, so it assumes
it's today unless you explicitly tell it to use an earlier date).

Aengus

+------------------------------------------------------------------------
|  TO UNSUBSCRIBE from this list:
|    http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+------------------------------------------------------------------------

Reply via email to