>> CF may be able to do the same thing, but the fact that Ben Forta >> didn't mention it doesn't bode well for that being true.
It's doable, via the text ODBC driver, but it's slow, and the SQL is a pain. I still think the best option is to do this in the DBMS. --- Ben -----Original Message----- From: James Wolfe [mailto:[EMAIL PROTECTED] Sent: Tuesday, June 12, 2007 10:55 AM To: CF-Talk Subject: Re: Large CSV File If you have MS SQL at your disposal, load the stuff into a table and query that. You can use DTS (though that's harder to do on the fly) or you can simply use the "BULK INSERT" command which is super fast and is very easy. If you dont have a database available to you, you can use ASP (let the flaming begin). ASP can load a CSV file into a recordset using a custom query and is pretty fast at doing it. You can even customize the field names and field types using an config file. CF may be able to do the same thing, but the fact that Ben Forta didn't mention it doesn't bode well for that being true. >I've got a vendor that's going to FTP product data files directly into a >folder on a site. From there, I need to be able to run several different >queries on this to come up with a list of PIN numbers which then get >used elsewhere. > >I got my first glimpse at one of the 'files' yesterday. It's a 75 to 80 >meg CSV text file! They FTP a new one once a week. > >What would be considered "best practice" in handling this file so i can >run queries on it? Import the needed bits into a database (still a big >chunk of data)? Something else? > >You can't directly query a CSV file, correct? ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Deploy Web Applications Quickly across the enterprise with ColdFusion MX7 & Flex 2 Free Trial http://www.adobe.com/products/coldfusion/flex2/?sdid=RVJU Archive: http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:280782 Subscription: http://www.houseoffusion.com/groups/CF-Talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
