thought about writing it in smaller chunks maybe? Like on a schedule. eg, user makes req, log the req, have a scheduled job run every say 10 mins, each time it hits a req work maybe 3000 rows, then when all done send user an email link to the file. just a thought. Had this issue there with magnys alot. ....oops internal info...hehe
Doug On Mon, 22 Nov 2004 17:07:01 -0600, Greg Morphis <[EMAIL PROTECTED]> wrote: > I can understand if it took 600+ seconds.. but it's not even loading.. > The <cffile works but the output is messed up. It's reversed.. very weird.. > > > > > On Mon, 22 Nov 2004 16:58:09 -0600, Russell Patterson <[EMAIL PROTECTED]> > wrote: > > Hello Greg, > > > > Don't forget that IIS and most web servers can throttle the output. I > > worked in an environment where we would have users loading small text files > > to extremely large (> 300 MB) and it takes time for the web server to upload > > it. A 10 MB file would take about 600 to 700 seconds for it to load; and > > this was all on an private internal network with an ATM backbone. > > > > On a side note, it was probably one of the largest intranets that I have > > ever worked on. At last check, it was hosting close to 3.4 million reports > > that took up about 4.5 Terabytes of storage space. We used an IBM Shark for > > the SAN. All this thanks to HIPAA and internal company requirements. %^) > > > > Russell > > > > > > > > ----- Original Message ----- > > From: "Greg Morphis" <[EMAIL PROTECTED]> > > To: "CF-Talk" <[EMAIL PROTECTED]> > > Sent: Monday, November 22, 2004 4:31 PM > > Subject: Re: Write large amount of data to text.. > > > > > Man this is messed up... the Dev server can create this file load > > > 11,000+ rows (it's a 10 MB text file) in close to 10 seconds. > > > The Prod server takes 30 seconds for the query and 660 for loading the > > > text file.. if it loads it.. > > > Is this possibly due to the load from people/users on the Prod server? > > > > > > > > > > > > On Mon, 22 Nov 2004 12:24:52 -0600, Greg Morphis <[EMAIL PROTECTED]> > > > wrote: > > >> Thanks guys! > > >> I went with > > >> <cffile action="WRITE" file="#g_EcountFileDirectory#\#eCountFilename#" > > >> output="#ecount_header#" addnewline="Yes"> > > >> <cfloop query="fetchReferrals"> > > >> <cffile action="APPEND" > > >> file="#g_EcountFileDirectory#\#eCountFilename#" output="#record_data#" > > >> addnewline="Yes"> > > >> </cfloop> > > >> <cffile action="APPEND" > > >> file="#g_EcountFileDirectory#\#eCountFilename#" > > >> output="#ecount_footer#" addnewline="Yes"> > > >> > > >> Still takes a few minutes but it didnt crap out on me this time. > > >> Thanks! > > >> > > >> > > >> > > >> > > >> On Mon, 22 Nov 2004 10:03:29 -0800, Ian Skinner > > >> <[EMAIL PROTECTED]> wrote: > > >> > This won't help with your timeout issue, but you can see how far you > > >> > are getting. > > >> > > > >> > <cfloop query="fetchReferrals"> > > >> > <cfif fetchReferrals.currentRow EQ 1> > > >> > <cffile action="WRITE" > > >> > file="#g_EcountFileDirectory#\#eCountFilename#" > > >> > output="#ecount_header##ecount_file##ecount_footer#" addnewline="Yes"> > > >> > <cfelse> > > >> > <cffile action="APPEND" file="#g_EcountFileDirectory#\#eCountFilename#" > > >> > output="#ecount_header##ecount_file##ecount_footer#" addnewline="Yes"> > > >> > </cfif> > > >> > > > >> > This would at least write out each row. Give you an idea of how much > > >> > you need to increase your timeout in the administrator to allow this > > >> > process to run. > > >> > > > >> > -------------- > > >> > Ian Skinner > > >> > Web Programmer > > >> > BloodSource > > >> > www.BloodSource.org > > >> > Sacramento, CA > > >> > > > >> > "C code. C code run. Run code run. Please!" > > >> > - Cynthia Dunning > > >> > > > >> > Confidentiality Notice: This message including any > > >> > attachments is for the sole use of the intended > > >> > recipient(s) and may contain confidential and privileged > > >> > information. Any unauthorized review, use, disclosure or > > >> > distribution is prohibited. If you are not the > > >> > intended recipient, please contact the sender and > > >> > delete any copies of this message. > > >> > > > >> > > > >> > > > > > > > > > > > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Special thanks to the CF Community Suite Gold Sponsor - CFHosting.net http://www.cfhosting.net Message: http://www.houseoffusion.com/lists.cfm/link=i:4:185102 Archives: http://www.houseoffusion.com/cf_lists/threads.cfm/4 Subscription: http://www.houseoffusion.com/lists.cfm/link=s:4 Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4 Donations & Support: http://www.houseoffusion.com/tiny.cfm/54
