the format of the text file is not very consistent. It's a comma delimited list, but the last field is itself a comma delimited list and fields 8 and 9 contain one double quote instead of a pair like every other field. It's very strange and I can't get the writers of this text file to explain their logic or change it so far. I don't think an automated solution will work for these reason, so I am parsing each line piece by piece and saving as individual variables.
> Another option.. Why not open it as an ODBC data source, and let the > ODBC > drivers worry about the size of the file? We recently did something > like > this with VB for a text file, only a few lines/records though. But it > should still work well with larger files. > > > -----Original Message----- > From: Chris Giminez [mailto:[EMAIL PROTECTED]] > Sent: Thursday, January 24, 2002 6:56 PM > To: CF-Talk > Subject: Re: extracting data from a huge text file > > > It's called CFX_ReadLine and with an initial test, it looks like it's > going > to do the trick. > thanks very much!! > > Chris > > > > > > > > >I'm trying to retrieve data and put it into a database from a text > file. > > >The text file is over 100MB with (I'm guessing) around 260,000 > records, > each record contains 85 > > >fields. > > > > > >I tried to create a conditional loop at each line break, which works > fine > if I am working on a > > >smaller version of the file, but chokes on the 100MB monster. Is > there a > more efficient way to > deal > > >with this other than looping through it or is there a way to break > this > file up into smaller > chunks > > >and deal with it piece by piece? > > > > > > Been a while since I used it but I wrote a cfx called... hmm.. I > don't > > recall what it was called /-) ... anyway, the cfx was to read in log > > files one line at a time. > > > > Which is what it does, one carriage-deliminated line per call, not > the > > entire file all at once. > > > > It's somewhere at http://www.intrafoundation.com/freeware.html. > > > > --min > > > > ______________________________________________________________________ Get Your Own Dedicated Windows 2000 Server PIII 800 / 256 MB RAM / 40 GB HD / 20 GB MO/XFER Instant Activation � $99/Month � Free Setup http://www.pennyhost.com/redirect.cfm?adcode=coldfusionb FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/[email protected]/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
