On Sun, 20 May 2001, Jonathan B. Horen wrote:

> Shalom!
> 
> Our site has three NetCache Applicances -- proxy/caching servers, each
> one produces a daily CLF logfile of ~100-115MB, of which we save an
> ongoing 7-day period.  Although Analog/5.0 works splendidly and
> generates a daily logfile analysis, things unravel rather quickly when
> trying to generate cumulative statistics.
> 
> Yes, I read the section on cachefiles.  I created a separate .cfg file
> for creating a cachefile:
> 
> INPUT         OUTPUT          POST
> ================================================================
> LOGFILE               OUTCACHFILE     mv OUTCACHEFILE OUTCACHEFILE.OLD
> ----------------------------------------------------------------
> NEWLOGFILE +  OUTCACHEFILE    mv OUTCACHEFILE OUTCACHEFILE.OLD
> OUTCACHEFILE.OLD
> ----------------------------------------------------------------
> lather, rinse, repeat
> ================================================================
> 
> After three iterations Analog ran out of memory (1GB).  Cache files are
> a nice idea, and disk space is not an issue.  Memory is an issue.  If,
> after three days, the cachefile has grown to 482MB, what is left to do? 
> Sure, I can max-out RAM, but that'll only be a total of 2GB...
> 
> The only solution I can see is running Analog on one of our
> supercomputers, in order to utilize massive amounts of shared memory...
> 
> Any hints, tips, suggestions?

Yeah, docs/lowmem.html.

-- 
Stephen Turner               http://www.statslab.cam.ac.uk/~sret1/
  Statistical Laboratory, Wilberforce Road, Cambridge, CB3 0WB, England
  "Your account can only be used for a single internet session at any one
   time and for no more than 24 hours in any one day." (NTL terms of use)

+------------------------------------------------------------------------
|  This is the analog-help mailing list. To unsubscribe from this
|  mailing list, go to
|    http://lists.isite.net/listgate/analog-help/unsubscribe.html
|
|  List archives are available at
|    http://www.mail-archive.com/[email protected]/
|    http://lists.isite.net/listgate/analog-help/archives/
|    http://www.tallylist.com/archives/index.cfm/mlist.7
+------------------------------------------------------------------------

Reply via email to