How about using cfthread and processing multiple items with each request, that will at least half the time it takes.
Regards Russ Michaels >From my mobile On 31 Oct 2011 19:57, "Matt Blatchley" <m...@bridgeleaf.com> wrote: > > Greeting all, > > I'm running into an issue and was wondering if someone could give me > some sort of feedback if this can be accomplished. > > Background: > > The project I'm working on involves running a CFC that calls the > Google AdWords API for a number of specific accounts and then dumps > the data into a table. In total we make about 200 calls to the API > throughout the course of the night to gather this data for reporting > purposes. This part works great when the API is running quickly > (right now I have it timeout after 5 minutes) > > To do this I created a Queue and a Queue manager. The Queue manager > runs twice a day to insert or re-insert items into the queue that need > to be updated (reports, API calls, alerts etc). The queue itself is > executed by a single scheduled task that runs every 5 minutes and so > far that runs smoothly, but it takes about 10-12 hours to finish > everything in the queue. And I need to somehow cut that time in half. > > So my question is this: Is it possible to have multiple queues > running on different machines and dumping the data into the same > table? > > Using cftransaction, the second queue attempts to run but has to wait > until the main Queue finishes before the secondary queue starts. I've > read into the Isolation attribute in the cftransaction tag and the > READ_COMMITTED but still not getting far. > > Would I have to use TEMP tables or is there some other way of > accomplishing this? > > I'm currently using CF9 on the main machine and CF7 on the other. > > Thanks, > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Order the Adobe Coldfusion Anthology now! http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:348384 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm
