Hello David, > The file itself here is the issue since it is 300 MB. All I did was read the > file and write to a local cache and even that took 5+ minutes. > Only when I switched to reading a batch of lines at a time did I get the > time down. Beforehand, I was writing and reading line by line and it took > more than 7 minutes.
If you are processing files of this size, you must either read them in blocks or use a buffered stream/reader. You also have to disable the wire log, because otherwise that will add megabytes of log output that needs to be written somewhere, too. I don't know what kind of processing you have to do on the fly, it's up to you to decide whether it can be done fast enough. Depending on the server capabilities and your application, you can also consider to request only parts of the file at a time, using the HTTP 1.1 "Range:" header. cheers, Roland --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
