Sue wrote:
> We ran top and came up with some figures and I was hoping that I could run
> them by you to see if they are coherent with your experiences.
>
> On my 133 MHz, linux : 460 000 lines used up approximately 43 MB
> On his Sun Ultra 5 : 2 280 000 lines used up about 230 MB
>
> Is our system simply not capable of coping with the data load? You wrote
> that you were uncompressing and processing 2 million lines per minute and
> that a site was using it on over 250 million lines. What do we do?
Well, it certainly looks as if your memory requirement is about linear in
the number of lines read, which is good. The exact number of MB needed per
line is very site-dependent: it depends on the number of unique files you
have and where your visitors come from. Yours looks rather high though. Do
you have a lot of unique filenames, e.g. dynamically generated?
You didn't say the memory of your computers, but it looks as if you may just
be running out of memory. One of the LOWMEM commands should help.
--
Stephen Turner [EMAIL PROTECTED] http://www.statslab.cam.ac.uk/~sret1/
Statistical Laboratory, 16 Mill Lane, Cambridge CB2 1SB, England
"Due to the conflict in Kosovo, we will not be showing the movie Wag the
Dog. Instead, we will show Mortal Kombat: Annihilation." Cable & Wireless
------------------------------------------------------------------------
This is the analog-help mailing list. To unsubscribe from this
mailing list, send mail to [EMAIL PROTECTED]
with "unsubscribe analog-help" in the main BODY OF THE MESSAGE.
List archived at http://www.mail-archive.com/[email protected]/
------------------------------------------------------------------------
