Several things come to mind:
1) This (log file analysis) job of processing large files is not well
suited to an interactive environment, such as a web application...
better done off-line/.
2) A Java application may be the best way to provide a custom solution.
That said, there might be another approach:
If you can participate in, or back-end the application generating the logs,
you may be able to capture the information you need directly into a database.
This could be simple log entries, or merely updating a few counters for each
customer session... neither would add much overhead to a session.
Then, you would have a relatively simple approach to processing
interactively,manipulate the data with SQL... and you only need pass
the ID of the customer.
HTH
Dick
At 4:15 PM -0400 9/4/00, Bud wrote:
>Hi. I have this situation. I'm creating a program for someone where
>their customer's will be billed based on the amount of instances
>(sessions) in a log file. There will eventually be hundreds or
>thousands of customers with each one using up to hundreds of
>sessions. There will be a line in the log file for each session used
>for each customer. Figuring the test file I'm using is 4,000 lines
>long and 400 Kb, 2,000 customers using 200 sessions each will result
>in <gasp>400,000 lines</gasp>. Extrapolating, that gives me a 50 MB
>file.
>
>Now, this is probably extreme, but you never know.
>
>What I want to do is show about 50 - 100 customers per page and have
>it go through the cffile variable and count the lines for each file.
>Then of course, I'll have to click Next to bring up the next group of
>customers.
>
>Reading this 400 Kb file seems to happen pretty well instantaneously.
>But when it gets very large, I'd rather not read the file every
>single time. I don't want to store a HUGE variable in the client
>variable database and I've sworn off session variables.
>
>My question: Do you think the performance hit will be worse reading
>the file at every page load, or passing the variable from page to
>page after initially reading it. And it is even POSSIBLE to pass a
>HUGE variable with a form. And if so, what would be the best way?
>Write a query and store it in a structure or array and pass that? If
>I do it that way, I could just pass the customer ID and the number of
>sessions used (rather than a record for each session used).
>
>Suggestions? Ideas? :)
>--
>
>Bud Schneehagen - Tropical Web Creations
>
------------------------------------------------------------------------------
Archives: http://www.mail-archive.com/[email protected]/
To Unsubscribe visit
http://www.houseoffusion.com/index.cfm?sidebar=lists&body=lists/cf_talk or send a
message to [EMAIL PROTECTED] with 'unsubscribe' in the body.
