John Oliver wrote:
So I wrote a bash script that goes through Apache log files, looks for
certain elements, counts how many times each element appears, and prints
out the result. It took 4 hours to run against ~470MB of logs, which
were accumulated in seven days with not much going on, compared to what
we expect to see in the coming months.
I suppose it really depends on what you're counting, and how you're
counting it.
I only have about 30MiB of logs to run my scans through to find (for
example) the most common referrers, google search terms, unique IP
connects etc...
But it only takes a few seconds to get me the results.
But your logs are more than 15 times larger, and I don't know what you
are looking for
--
Michael O'Keefe | [EMAIL PROTECTED]
Live on and Ride a 03 BMW F650GSDakar| [EMAIL PROTECTED] / |
I like less more or less less than |Work:+1 858 845 3514 / |
more. UNIX-live it,love it,fork() it |Fax :+1 858 845 2652 /_p_|
My views are MINE ALONE, blah, blah, |Home:+1 760 788 1296 \`O'|
blah, yackety yack - don't come back |Fax :+1 858 _/_\|_,
--
[email protected]
http://www.kernel-panic.org/cgi-bin/mailman/listinfo/kplug-list
