Hi,

Some progress ... I combined the daily cache files into several weekly ones, then analysed them at the end of the month, and the job reduced from 10 hours to 3 ...

In relation to Aengus' suggestion (below) to fool analog into thinking the actual URLs accessed are Referrer links...

I tried replacing the %r with a %f, and switched on the REF and REFSITE reports, but analog keeps saying it's switching off the two reports since they're empty. I'm using CLF with a locally defined LOGFORMAT ...

LOGFORMAT (%S %j - [%d/%M/%Y:%h:%n:%j] "%j %f %j" %c %b)
LOGFORMAT (%S %j %u [%d/%M/%Y:%h:%n:%j] "%j %f %j" %c %b)

Any suggestions?

Wallace.

Aengus wrote:
On Tuesday, November 30, 2004 11:56 AM [GMT],
Wallace Nicoll <[EMAIL PROTECTED]> wrote:

  
Hi,

I'm using Analog to analyse outgoing web requests through a proxy
server, and daily logs in native format are around 200Mb. I analog
them and create a daily cache file (about 60Mb). However, I'm trying
to analyse a month's worth of data and it takes about 10 hours to run
(from midnight), which is now impacting on normal daily activities on
the box.
    

Off the top of my head, I'd look at changing your LOGFORMAT command to
interpret the URL field as a referrer field, and then use the Referring
Site report (REFSITE ON) to generate the report you're looking for.

Aengus
  

-- 
======================================================================
 Wallace Nicoll                           [EMAIL PROTECTED]
 BT Consulting and Systems Integration,      [EMAIL PROTECTED]
 Telephone House, 357 Gorgie Road,              Phone : 0131 345 4823
 Edinburgh, EH11 2RP, Scotland                    Fax : 0131 313 3582
 [From overseas                                     [P]+441313454823]
======================================================================


What's new on www.edinburgh.gov.uk
View building warrants online www.edinburgh.gov.uk/building
Keeping people up-to-date with Council decisions and business www.edinburgh.gov.uk/cpol
Is your garden a potential winner? www.edinburgh.gov.uk/keepedinburghgrowing
**********************************************************************
This Email and files transmitted with it are confidential and are intended for the sole use of the individual or organisation to whom they are addressed. If you have received this Email in error please notify the sender immediately and delete it without using, copying, storing, forwarding or disclosing its contents to any other person. The Council has endeavoured to scan this Email message and attachments for computer viruses and will not be liable for any losses incurred by the recipient.
**********************************************************************
+------------------------------------------------------------------------
|  TO UNSUBSCRIBE from this list:
|    http://lists.meer.net/mailman/listinfo/analog-help
|
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
+------------------------------------------------------------------------

Reply via email to