His performance is normal when using SQL it is v.poor at this kind of thing.







"This e-mail is from Reed Exhibitions (Oriel House, 26 The Quadrant,
Richmond, Surrey, TW9 1DL, United Kingdom), a division of Reed Business,
Registered in England, Number 678540.  It contains information which is
confidential and may also be privileged.  It is for the exclusive use of the
intended recipient(s).  If you are not the intended recipient(s) please note
that any form of distribution, copying or use of this communication or the
information in it is strictly prohibited and may be unlawful.  If you have
received this communication in error please return it to the sender or call
our switchboard on +44 (0) 20 89107910.  The opinions expressed within this
communication are not necessarily those expressed by Reed Exhibitions." 
Visit our website at http://www.reedexpo.com

-----Original Message-----
From: Jenny Gavin-Wear <[EMAIL PROTECTED]>
To: CF-Talk <[email protected]>
Sent: Wed Jul 26 21:26:40 2006
Subject: RE: reading large text file

Hi Martin,

Just gone through a similar process with a 2.65gb csv with the uk post code
db. (27 million records)

I used DTS and it did take a while, but 74mb should process quite quickly.
Might be worth checking the server spec?

Best of luck,

Jenny



-----Original Message-----
From: Martin Thorpe [mailto:[EMAIL PROTECTED]
Sent: 26 July 2006 13:36
To: CF-Talk
Subject: reading large text file


Hello all.

 

I am uploading a 74 + MB tab delimited text file that I am then reading
and inserting the values into a database.  The problem is it always
times out, or just takes too long (did not finish over night!!!!) to
read the file.  It is uploaded fine.

 

Any suggestions about how I may approach this to make it work with such
large files?

 

I looked at a bit of Java code someone had posted here but it went no
quicker really.

 

I was thinking of maybe chopping the file into slices and then
processing but not too sure how I would approach this.

 

Any opinions or ideas/tips would be gratefully accepted.

 

Thanks for reading.

Cheers

Martin 








~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Introducing the Fusion Authority Quarterly Update. 80 pages of hard-hitting,
up-to-date ColdFusion information by your peers, delivered to your door four 
times a year.
http://www.fusionauthority.com/quarterly

Archive: 
http://www.houseoffusion.com/groups/CF-Talk/message.cfm/messageid:247834
Subscription: http://www.houseoffusion.com/lists.cfm/link=s:4
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4

Reply via email to