Yeah, I usually pass through a start and offset variable, so it knows which records to call in, and I use the DB to paginate through.
Mark On Thu, Mar 10, 2011 at 1:45 PM, <[email protected]> wrote: > > This sounds like a good solution. Do you just call the same page over > and over with the cfhttp at the bottom passing a record variable until > you reach the end of file or you doing something different? > > > > > > -----Original Message----- > From: Mark Mandel [mailto:[email protected]] > Sent: Wednesday, March 09, 2011 9:03 PM > To: cf-talk > Subject: Re: Performance Issue with CFLOOP > > > Batch stuff like this, I tend to break into chunks, and call each chunk > via a cfhttp call. (maybe 1000 records or so per chunk?) > > That way you get a single request, that can be entirely gc'd after each > request. > > Worked well for me in the past. > > Mark > > On Thu, Mar 10, 2011 at 10:26 AM, Michael Grant <[email protected]> wrote: > > > > > Good luck. > > > > On Wed, Mar 9, 2011 at 4:44 PM, <[email protected]> wrote: > > > > > > > > Ok I tried this. I took all the flushes out but one so only one > > > timer per loop and ran it over 5000 records. > > > > > > With all the flushes in place total execution time was 111905 ms > > > With only one flush total execution time for the same query was > > > 74622 ms > > > > > > A difference of a little over 37 seconds > > > > > > With no flushing at all total execution time was 70520 ms > > > > > > A total difference of a little over 41 seconds > > > > > > So it does appear the flushing is the cause of some of the slowdown. > > > > > > However I tried running the loop over 10k records and I run into > > > this error > > > > > > GC overhead limit exceeded null > > > > > > I have increase my maximum heap size to 1500mb so will try again. :( > > > > > > -----Original Message----- > > > From: Michael Grant [mailto:[email protected]] > > > Sent: Wednesday, March 09, 2011 4:12 PM > > > To: cf-talk > > > Subject: Re: Performance Issue with CFLOOP > > > > > > > > > Are you sure it's actually the loop slowing down or is it your > > > browser slowing down from all the cfflush-ing? Try removing the > > > cfflush and track the time it takes by writing the execution time to > > > > an array then dump out the array after the loop completes and > compare your results. > > > That will at least help you narrow down if it's truly a problem with > > > > the loop. > > > > > > > > > > > > On Wed, Mar 9, 2011 at 4:03 PM, <[email protected]> wrote: > > > > > > > > > > > Looking for any ideas here. > > > > > > > > > > > > > > > > I'm running a cfloop over a query from a database with a little > > > > over > > > > 60,000 records in it on MSSQL. I am doing a cfflush so I can watch > > > > > what record it is on so I can keep up with how quickly or slowly > > > > the loop is running. The problem is after about 4850ish records > > > > the loop slows waaay down. Any idea why the speed change or how I > > > > can stop it > > > from happening? > > > > All I am doing is querying 2 columns and based on the data in > > > > those 2 I am updating 3 other columns. So it looks up the data > > > > then loops over > > > > > > > it then updates each record with some new data. Runs great till > > > > about 95% of the loop. Looking for any ideas out there. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:342878 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
