Re: [PHP-DB] Loading large volumes of data

2004-10-07 Thread Andrew Kreps
On Thu, 7 Oct 2004 09:05:55 +0200, Evan Morris <[EMAIL PROTECTED]> wrote: > I have a text file containing strings. The text file is pretty massive, > about 895 MB. I need to load the words in the text file into the database in > such a way that there is a single occurrence of each word in the table

Re: [PHP-DB] Loading large volumes of data

2004-10-07 Thread Evan Morris
;Evan Morris" <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]> Sent: Thursday, October 07, 2004 9:33 AM Subject: Re: [PHP-DB] Loading large volumes of data > I'd think you want to index the table. Since you are doing a search on > an un-index table for each word, that overhead

Re: [PHP-DB] Loading large volumes of data

2004-10-07 Thread graeme
I'd think you want to index the table. Since you are doing a search on an un-index table for each word, that overhead will be more than creating an entry in an index table. Entering an index entry will require the routine to determine where the entry should be but it will be looking for that in

[PHP-DB] Loading large volumes of data

2004-10-07 Thread Evan Morris
This is more a process question that is not specific to PHP, but maybe someone can help me. I have a text file containing strings. The text file is pretty massive, about 895 MB. I need to load the words in the text file into the database in such a way that there is a single occurrence of each word