I'm with Dave. It sounds like you want to suck the data into a temporary table in your DBMS, and then use a SP to process it (or a trigger to process each row perhaps) moving or updating rows as needed. This type of processing is what DBMS' were designed and built to do.
--- Ben -----Original Message----- From: Dave Watts [mailto:[EMAIL PROTECTED] Sent: Tuesday, March 27, 2007 12:55 PM To: CF-Talk Subject: RE: Validation Question > I have a project that requires a fair amount of validation. > I will be process several dozen text files each night. Each > text file contains 8500 records. Each record contains 35 > fields. Each field requires at least some basic validation, > other fields the validation gets more involved. A little > math, 8500 records times 35 fields, at a bare minimum that's > nearly 300,000 validation processes per file. The reality is > probably 3- 4 times that number. > > I have a couple of questions. Some of the required validation > can be re-used within the project so I am considering writing > a cfc for each field. That would be 35 cfcs with two to > several validations per cfc based on the requirements for > the field in question. If I have a master validation cfc > that calls the other 35 cfcs and stores them in memory will > that reduce the overhead of calling each one 8500 times per file? > Is there a better way to handle this? If possible, don't use CF for this. There are often much better ways to do this kind of batch processing functionality. CF isn't designed to do this sort of thing well. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ Fig Leaf Software provides the highest caliber vendor-authorized instruction at our training centers in Washington DC, Atlanta, Chicago, Baltimore, Northern Virginia, or on-site at your location. Visit http://training.figleaf.com/ for more information! This email has been processed by SmoothZap - www.smoothwall.net ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| ColdFusion MX7 by Adobe® Dyncamically transform webcontent into Adobe PDF with new ColdFusion MX7. Free Trial. http://www.adobe.com/products/coldfusion?sdid=RVJV Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:273878 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
