Re: [PHP] CSV speed

2008-03-11 Thread Arvids Godjuks
I should say that running 7 quueries against 200MB table with ~600 000 rows for 4 seconds looks to me as if there was no indexes and very poor database design (i mean that CVS file is dumped into database incorrectly). Or you'r server is Pentium 100 :) P.S. Having myself a 1.5GB database with

Re: [PHP] CSV speed

2008-03-11 Thread Ray Hauge
Wolf wrote: Danny Brow wrote: I have about 10 csv files I need to open to access data. It takes a lot of time to search each file for the values I need. Would it be best to just dump all the cvs files to an SQL db and then just grab what I need from there? I'm starting to think it would make a

[PHP] CSV speed

2008-03-10 Thread Danny Brow
I have about 10 csv files I need to open to access data. It takes a lot of time to search each file for the values I need. Would it be best to just dump all the cvs files to an SQL db and then just grab what I need from there? I'm starting to think it would make a lot of sense. What do you guys

Re: [PHP] CSV speed

2008-03-10 Thread TG
cumbersome to search. You could try out a few scenarios and see how they work speed-wise and impact on system memory and such. -TG - Original Message - From: Danny Brow [EMAIL PROTECTED] To: PHP php-general@lists.php.net Date: Mon, 10 Mar 2008 21:09:15 -0400 Subject: [PHP] CSV speed I have

Re: [PHP] CSV speed

2008-03-10 Thread Wolf
Danny Brow wrote: I have about 10 csv files I need to open to access data. It takes a lot of time to search each file for the values I need. Would it be best to just dump all the cvs files to an SQL db and then just grab what I need from there? I'm starting to think it would make a lot of sense.

Re: [PHP] CSV speed

2008-03-10 Thread Danny Brow
On Mon, 2008-03-10 at 22:36 -0400, Wolf wrote: Danny Brow wrote: I have about 10 csv files I need to open to access data. It takes a lot of time to search each file for the values I need. Would it be best to just dump all the cvs files to an SQL db and then just grab what I need from

Re: [PHP] CSV speed

2008-03-10 Thread Larry Garfield
to search. You could try out a few scenarios and see how they work speed-wise and impact on system memory and such. -TG - Original Message - From: Danny Brow [EMAIL PROTECTED] To: PHP php-general@lists.php.net Date: Mon, 10 Mar 2008 21:09:15 -0400 Subject: [PHP] CSV speed I have about

Re: [PHP] CSV speed

2008-03-10 Thread Greg Donald
On Mon, Mar 10, 2008 at 8:09 PM, Danny Brow [EMAIL PROTECTED] wrote: I have about 10 csv files I need to open to access data. It takes a lot of time to search each file for the values I need. Would it be best to just dump all the cvs files to an SQL db and then just grab what I need from

Re: [PHP] CSV speed

2008-03-10 Thread Wolf
Danny Brow wrote: On Mon, 2008-03-10 at 22:36 -0400, Wolf wrote: Danny Brow wrote: I have about 10 csv files I need to open to access data. It takes a lot of time to search each file for the values I need. Would it be best to just dump all the cvs files to an SQL db and then just grab what I

Re: [PHP] CSV speed

2008-03-10 Thread Wolf
Greg Donald wrote: On Mon, Mar 10, 2008 at 8:09 PM, Danny Brow [EMAIL PROTECTED] wrote: I have about 10 csv files I need to open to access data. It takes a lot of time to search each file for the values I need. Would it be best to just dump all the cvs files to an SQL db and then just grab