[PHP] Can php/mysql handle 10000s of records
From: Adam Gerson [EMAIL PROTECTED] Date: Wed Jul 9, 2003 9:48:20 AM America/New_York To: [EMAIL PROTECTED] Subject: Can php/mysql handle 1000's of records? I know this questions is a little of topic, but I figured the members of this list would have experience in this area. I am writing an attendance system in php/mysql for my school. We have a little less then 1000 students. For every day of the school year one record will be entered into a table for each student representing their attendance status (present, absent, late, etc...). I also have several other supporting tables for relationships. When it comes to reporting and querying this DB I am worried that it will very quickly become very large and slow. Can mysql handle this? Are there any techniques to speed it up? I will trying indexing major columns. I have also considered keeping all previous days attendance in a separate table from the current days attendance and moving things over in the middle of the night. This way any operations on the current days data will go quickly, but reports on long term things will still be slow. Good idea? Thanks, Adam --- Adam Gerson Systems Administrator / Computer Teacher Columbia Grammar and Prep School 212-749-6200 [EMAIL PROTECTED] www.cgps.org -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
RE: [PHP] Can php/mysql handle 10000s of records
[snip] I am writing an attendance system in php/mysql for my school. We have a little less then 1000 students. For every day of the school year one record will be entered into a table for each student representing their attendance status (present, absent, late, etc...). I also have several other supporting tables for relationships. When it comes to reporting and querying this DB I am worried that it will very quickly become very large and slow. Can mysql handle this? Are there any techniques to speed it up? I will trying indexing major columns. I have also considered keeping all previous days attendance in a separate table from the current days attendance and moving things over in the middle of the night. This way any operations on the current days data will go quickly, but reports on long term things will still be slow. Good idea? [/snip] The short answer is that 1s of records is no problem dependent upon the server, good coding, and good database optimization. We process millions of records each day with PHP and MySQL (today there are 58M records to be processed). Over time we have found bottlenecks and cleared them up. This is being done on a sub-1Ghz server (but I am looking forward to an updrade!). HTH! Jay -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] Can php/mysql handle 10000s of records
It can handle 1,000,000 records without breaking a sweat. On Wed, 2003-07-09 at 09:54, Adam Gerson wrote: From: Adam Gerson [EMAIL PROTECTED] Date: Wed Jul 9, 2003 9:48:20 AM America/New_York To: [EMAIL PROTECTED] Subject: Can php/mysql handle 1000's of records? I know this questions is a little of topic, but I figured the members of this list would have experience in this area. I am writing an attendance system in php/mysql for my school. We have a little less then 1000 students. For every day of the school year one record will be entered into a table for each student representing their attendance status (present, absent, late, etc...). I also have several other supporting tables for relationships. When it comes to reporting and querying this DB I am worried that it will very quickly become very large and slow. Can mysql handle this? Are there any techniques to speed it up? I will trying indexing major columns. I have also considered keeping all previous days attendance in a separate table from the current days attendance and moving things over in the middle of the night. This way any operations on the current days data will go quickly, but reports on long term things will still be slow. Good idea? Thanks, Adam --- Adam Gerson Systems Administrator / Computer Teacher Columbia Grammar and Prep School 212-749-6200 [EMAIL PROTECTED] www.cgps.org -- Adam Voigt ([EMAIL PROTECTED]) Linux/Unix Network Administrator The Cryptocomm Group -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
RE: [PHP] Can php/mysql handle 10000s of records
Suprisingly MySQL is very good, as the others have said... I've been involved in a few sites that have been known to hammer the DB pretty hard.. And it's stood up to the test... Hmmm... I am sure others here can validate this... But I think the size limit for the database is about 4 gigs!!! That's a ton... The last company I had worked for had a huge customer database... But on a different system... But similar.. And it was only 280 megs!!! It contain records for over 58,000 customers... And inventory, accounting... Blah blah Probably the most critical thing to remember is efficient code... And optimizd use of MySQL... If you follow that, MySQL and PHP will scream... There are somethings you can do for MySQL... I was trying to locate an article for you that I read just the other day... But they were talking about indexing MySQL... I am sure the other members of this board can point you in the right direction... Have a great day Joe Harman http://www.HarmanMedia.com Everything is funny as long as it is happening to somebody else. - Will Rogers -Original Message- From: Adam Gerson [mailto:[EMAIL PROTECTED] Sent: Wednesday, July 09, 2003 9:54 AM To: [EMAIL PROTECTED] Subject: [PHP] Can php/mysql handle 1s of records From: Adam Gerson [EMAIL PROTECTED] Date: Wed Jul 9, 2003 9:48:20 AM America/New_York To: [EMAIL PROTECTED] Subject: Can php/mysql handle 1000's of records? I know this questions is a little of topic, but I figured the members of this list would have experience in this area. I am writing an attendance system in php/mysql for my school. We have a little less then 1000 students. For every day of the school year one record will be entered into a table for each student representing their attendance status (present, absent, late, etc...). I also have several other supporting tables for relationships. When it comes to reporting and querying this DB I am worried that it will very quickly become very large and slow. Can mysql handle this? Are there any techniques to speed it up? I will trying indexing major columns. I have also considered keeping all previous days attendance in a separate table from the current days attendance and moving things over in the middle of the night. This way any operations on the current days data will go quickly, but reports on long term things will still be slow. Good idea? Thanks, Adam --- Adam Gerson Systems Administrator / Computer Teacher Columbia Grammar and Prep School 212-749-6200 [EMAIL PROTECTED] www.cgps.org -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
RE: [PHP] Can php/mysql handle 10000s of records
[snip] Suprisingly MySQL is very good, as the others have said... I've been involved in a few sites that have been known to hammer the DB pretty hard.. And it's stood up to the test... Hmmm... I am sure others here can validate this... But I think the size limit for the database is about 4 gigs!!! That's a ton... [/snip] Actually you can set tables to exceed 4Gb ... some of the tables we have are currently in excess of 45Gb -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
