Hi,
I'm using Analog to analyse outgoing web requests through a proxy server, and daily logs in native format are around 200Mb. I analog them and create a daily cache file (about 60Mb). However, I'm trying to analyse a month's worth of data and it takes about 10 hours to run (from midnight), which is now impacting on normal daily activities on the box.
I have most of the LOWMEM options set to 3, apart from FILE and USER which are set to 2. The USER report is fine, but my question relates to the FILE section. I realise analog is intended for analysing incoming requests, so this is a slightly unusual use.
My required output is to report total traffic going to each remote website, as in ...
reqs: pages: bytes: directory -------: ------: -----------: --------- 7882103: 499445: 60151240840: http:// 54609: 4170: 1315170232: http://news.bbc.co.uk/ 150548: 6645: 688841636: http://www.bbc.co.uk/ 113084: 26: 655929238: http://ad.uk.doubleclick.net/ 24205: 692: 510716781: http://by101fd.bay101.hotmail.msn.com/
It looks as though the cache file for each day contains a line for for every URL on each site, when what I want in the cache file is the hostname section of the URL. Any idea how this can be achieved? Perhaps some format of rewrite? I archive the native log files so I don't need the cachefile for reference.
Thanks for any assistance anyone can suggest.
Wallace
-- ====================================================================== Wallace Nicoll [EMAIL PROTECTED] BT Consulting and Systems Integration, [EMAIL PROTECTED] Telephone House, 357 Gorgie Road, Phone : 0131 345 4823 Edinburgh, EH11 2RP, Scotland Fax : 0131 313 3582 [From overseas [P]+441313454823] ======================================================================
What's new on www.edinburgh.gov.uk
View building warrants online www.edinburgh.gov.uk/building
Keeping people up-to-date with Council decisions and business www.edinburgh.gov.uk/cpol
Is your garden a potential winner? www.edinburgh.gov.uk/keepedinburghgrowing **********************************************************************
This Email and files transmitted with it are confidential and are intended for the sole use of the individual or organisation to whom they are addressed. If you have received this Email in error please notify the sender immediately and delete it without using, copying, storing, forwarding or disclosing its contents to any other person. The Council has endeavoured to scan this Email message and attachments for computer viruses and will not be liable for any losses incurred by the recipient.
**********************************************************************
+------------------------------------------------------------------------ | TO UNSUBSCRIBE from this list: | http://lists.meer.net/mailman/listinfo/analog-help | | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +------------------------------------------------------------------------
