Hi,
Here's what I was told. Does this help?
It will compromise the performance of the server somewhat, but it is the
only way to deal with the dilemma that is the employee discount program.
At issue of the sheer size of the file, over 65000 characters long. SQL is
simply not retrieving all of the information. In order for SQL to retrieve
all of the text we need to enable it to do so at the ColdFusion
level. There is an option in CF admin to do this:
Long Text
Retrieval Settings Enable retrieval of long text - Enable this
option only if you want to retrieve all the data for a long text field.
If the option is not selected ColdFusion retrieves the number of characters
specified in the long text buffer size. Enabling this option may compromise
performance.
Long Text
Buffer Size characters
You must set the buffer size to something over 80000 characters to allow
for the extreme length of the employee discount file.
I'm not sure what the actual impact of emabling the retrieval of long text
will be, we should monitor the performance of the server once this is done.
"Mark Warrick" <[EMAIL PROTECTED]> on 06/30/2000 01:19:49 PM
Please respond to [EMAIL PROTECTED]
To: [EMAIL PROTECTED]
cc: (bcc: Diana Burns/US/UNIPHASE)
Subject: RE: reading text files
I ran into the same problem in the past with a 50 MB text file that I need
to import into SQL.
I tried making it a spreadsheet and importing to Access first, but it cuts
of at something like 65,000 lines. Same problem with importing directly
into Access, it just bombs. Also, I tried importing directly into SQL, but
SQL just froze up after 15 minutes of processing.
I ended up solving the problem but cutting up the text file into smaller
pieces and doing a whole lot of imports. It was a tedious task, but it
worked.
If anyone knows the right way to do it and can direct us both to perhaps
SQL help docs that describe it, I know we would both appreciate it.
---mark
--------------------------------------------------------------
Mark Warrick
Phone: (714) 547-5386
Efax.com Fax: (801) 730-7289
Personal Email: [EMAIL PROTECTED]
Personal URL: http://www.warrick.net
Business Email: [EMAIL PROTECTED]
Business URL: http://www.fusioneers.com
ICQ: 346566
--------------------------------------------------------------
> -----Original Message-----
> From: Jason Egan [mailto:[EMAIL PROTECTED]]
> Sent: Friday, June 30, 2000 1:10 PM
> To: Cf-Talk
> Subject: reading text files
>
>
> I have a rather large text file (145mb) that I need to read into a dB.
>
> The part I'm having trouble with is the READING of the file part. I am
> using a line by line tag from the dev site to read in say 1000 lines at a
> time, but some times it bombs at line 500... then I'll run it again and
it
> works, then I run it again and it bombs at 532 or something like that...
I
> examine the lines and they are properly formatted, I've even taken out
the
> inserts and I still receive the errors when only reading the
> files in... any
> ideas why?
>
> Is it the file size?
>
> thanks,
> je
>
> ------------------------------------------------------------------
> ------------
> Archives: http://www.eGroups.com/list/cf-talk
> To Unsubscribe visit
> http://www.houseoffusion.com/index.cfm?sidebar=lists&body=lists/cf
> _talk or send a message to [EMAIL PROTECTED] with
> 'unsubscribe' in the body.
---------------------------------------------------------------------------
---
Archives: http://www.eGroups.com/list/cf-talk
To Unsubscribe visit
http://www.houseoffusion.com/index.cfm?sidebarlists&bodylists/cf_talk or
send a message to [EMAIL PROTECTED] with 'unsubscribe' in
the body.
------------------------------------------------------------------------------
Archives: http://www.eGroups.com/list/cf-talk
To Unsubscribe visit
http://www.houseoffusion.com/index.cfm?sidebar=lists&body=lists/cf_talk or send a
message to [EMAIL PROTECTED] with 'unsubscribe' in the body.
