Re: [PHP] Close MySQL Result
Interesting, I don't have any numerical benchmarks, but I saw a performance benefit moving my result set into an array. My case may have been extreme, I was creating a table 350 rows by 350 columns, several megabytes of output, and I found that building the output directly from the query too slow. When I moved my results into an array before I started, it moved to a reasonable build time. My theory was that I was not getting proper use out of my indexes in my data set, or that the interface I was using to get to my MS-SQL tables was inefficient in some other way. I may not have proof, but I will be inclined to use this for a performance boost when working with large sets of data. On 1/21/2010 6:45 PM, Nathan Rixham wrote: Shawn McKenzie wrote: Daevid Vincent wrote: -Original Message- From: Nathan Rixham [mailto:nrix...@gmail.com] you'll also find a performance upgrade if you load all sql results in to an array and close up the query / free the results before working on them. query for() { $results[] = $row; } close stuff work on results Do you have any proof of this? What would be the logic here? Got some example benchmarks? Got a URL of a whitepaper or something that discusses this? I would think the only things that the mysql calls are doing is holding pointers to the next record and DB handle. I can't imagine they are using that much resources, nor would they be just spinning and waiting tying up CPU cycles either. I've never heard this to be the case. I have proof to the contrary :-) ?php echo number_format(memory_get_usage()) . Bytes used before query\n; $conn = mysql_connect('localhost', 'x', 'x'); $result = mysql_query(SELECT * FROM table_name); $count = mysql_num_rows($result); echo $count . rows returned\n; echo number_format(memory_get_usage()) . Bytes used after query\n; while($rows[] = mysql_fetch_assoc($result)) { } echo number_format(memory_get_usage()) . Bytes used after array creation\n; mysql_free_result($result); echo number_format(memory_get_usage()) . Bytes used after mysql_free_result\n; ? 65,588 Bytes used before query 6940 rows returned 67,264 Bytes used after query 6,376,612 Bytes used after array creation 6,376,756 Bytes used after mysql_free_result yup appears i was talking bollocks :D lolol - confusion came on my part from optimisation of a high traffic site over the past few years! correction: on simple scripts it is slower, marginally, (due to two for loops and more data in memory) however - in real world applications where such nasty practises as escaping in and out of html to render results and secondary per row queries or api calls are taken in to account this method of getting everything out of the db in a single swift action gives the performance boost - and more over on high traffic sites freeing up the connection / query resources as quickly as possible makes a rather noticeable impact, too many open connections and queries can be very nasty when your getting a few hundred / thousand requests per second. sorry 'bout that! -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] Close MySQL Result
Always found the same myself on large datasets and when working with high traffic sites; but cant replicate in a non-live environment or with simple grinder style tests; so just follow the procedure as standard practise in all my code now - likewise with dropping keep alive times on apache servers and some other little tweaks. regards! Michael Schaefer wrote: Interesting, I don't have any numerical benchmarks, but I saw a performance benefit moving my result set into an array. My case may have been extreme, I was creating a table 350 rows by 350 columns, several megabytes of output, and I found that building the output directly from the query too slow. When I moved my results into an array before I started, it moved to a reasonable build time. My theory was that I was not getting proper use out of my indexes in my data set, or that the interface I was using to get to my MS-SQL tables was inefficient in some other way. I may not have proof, but I will be inclined to use this for a performance boost when working with large sets of data. On 1/21/2010 6:45 PM, Nathan Rixham wrote: Shawn McKenzie wrote: Daevid Vincent wrote: -Original Message- From: Nathan Rixham [mailto:nrix...@gmail.com] you'll also find a performance upgrade if you load all sql results in to an array and close up the query / free the results before working on them. query for() { $results[] = $row; } close stuff work on results Do you have any proof of this? What would be the logic here? Got some example benchmarks? Got a URL of a whitepaper or something that discusses this? I would think the only things that the mysql calls are doing is holding pointers to the next record and DB handle. I can't imagine they are using that much resources, nor would they be just spinning and waiting tying up CPU cycles either. I've never heard this to be the case. I have proof to the contrary :-) ?php echo number_format(memory_get_usage()) . Bytes used before query\n; $conn = mysql_connect('localhost', 'x', 'x'); $result = mysql_query(SELECT * FROM table_name); $count = mysql_num_rows($result); echo $count . rows returned\n; echo number_format(memory_get_usage()) . Bytes used after query\n; while($rows[] = mysql_fetch_assoc($result)) { } echo number_format(memory_get_usage()) . Bytes used after array creation\n; mysql_free_result($result); echo number_format(memory_get_usage()) . Bytes used after mysql_free_result\n; ? 65,588 Bytes used before query 6940 rows returned 67,264 Bytes used after query 6,376,612 Bytes used after array creation 6,376,756 Bytes used after mysql_free_result yup appears i was talking bollocks :D lolol - confusion came on my part from optimisation of a high traffic site over the past few years! correction: on simple scripts it is slower, marginally, (due to two for loops and more data in memory) however - in real world applications where such nasty practises as escaping in and out of html to render results and secondary per row queries or api calls are taken in to account this method of getting everything out of the db in a single swift action gives the performance boost - and more over on high traffic sites freeing up the connection / query resources as quickly as possible makes a rather noticeable impact, too many open connections and queries can be very nasty when your getting a few hundred / thousand requests per second. sorry 'bout that! -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] Close MySQL Result
Ashley Sheridan wrote: On Wed, 2010-01-20 at 13:24 -0800, Daevid Vincent wrote: http://www.php.net/manual/en/function.mysql-free-result.php mysql_free_result($myresult); NOTE: mysql_free_result() only needs to be called if you are concerned about how much memory is being used for queries that return large result sets. All associated result memory is automatically freed at the end of the script's execution. http://us2.php.net/manual/en/function.unset.php unset($Row); -Original Message- From: Slack-Moehrle [mailto:mailingli...@mailnewsrss.com] Sent: Wednesday, January 20, 2010 1:21 PM To: php-general@lists.php.net Subject: [PHP] Close MySQL Result I think I am a dork. How do I close a MySQL result set to free memory? Given something like this: $gsql = Select * from resources where queryName = 'Production';; $myresult = mysql_query($gsql) or die('Cannot execute Query: ' . mysql_error()); $Row = mysql_fetch_assoc($myresult); if ($Row == true) { $_SESSION['PRODUCTION'] = $Row['queryValue']; } else { $_SESSION['PRODUCTION'] = TRUE; } How do I free up $myresult and $Row? -ML -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php And you can unset() $row if you want to free memory used by that variable, although it should be noted that once unset, it's up to PHP's garbage collection to free the memory, but using unset() on the variable tells PHP that it can free it if necessary. If you're that worried about memory as well, try to optimise your queries a little bit. For example, instead of retrieving all the results in a table and using PHP to output only what you need, use the WHERE and LIMIT clauses in MySQL to narrow down the results to only those that you actually need. you'll also find a performance upgrade if you load all sql results in to an array and close up the query / free the results before working on them. query for() { $results[] = $row; } close stuff work on results -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
RE: [PHP] Close MySQL Result
-Original Message- From: Nathan Rixham [mailto:nrix...@gmail.com] you'll also find a performance upgrade if you load all sql results in to an array and close up the query / free the results before working on them. query for() { $results[] = $row; } close stuff work on results Do you have any proof of this? What would be the logic here? Got some example benchmarks? Got a URL of a whitepaper or something that discusses this? I would think the only things that the mysql calls are doing is holding pointers to the next record and DB handle. I can't imagine they are using that much resources, nor would they be just spinning and waiting tying up CPU cycles either. I've never heard this to be the case. -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] Close MySQL Result
Daevid Vincent wrote: -Original Message- From: Nathan Rixham [mailto:nrix...@gmail.com] you'll also find a performance upgrade if you load all sql results in to an array and close up the query / free the results before working on them. query for() { $results[] = $row; } close stuff work on results Do you have any proof of this? What would be the logic here? Got some example benchmarks? Got a URL of a whitepaper or something that discusses this? I would think the only things that the mysql calls are doing is holding pointers to the next record and DB handle. I can't imagine they are using that much resources, nor would they be just spinning and waiting tying up CPU cycles either. I've never heard this to be the case. I have proof to the contrary :-) ?php echo number_format(memory_get_usage()) . Bytes used before query\n; $conn = mysql_connect('localhost', 'x', 'x'); $result = mysql_query(SELECT * FROM table_name); $count = mysql_num_rows($result); echo $count . rows returned\n; echo number_format(memory_get_usage()) . Bytes used after query\n; while($rows[] = mysql_fetch_assoc($result)) { } echo number_format(memory_get_usage()) . Bytes used after array creation\n; mysql_free_result($result); echo number_format(memory_get_usage()) . Bytes used after mysql_free_result\n; ? 65,588 Bytes used before query 6940 rows returned 67,264 Bytes used after query 6,376,612 Bytes used after array creation 6,376,756 Bytes used after mysql_free_result -- Thanks! -Shawn http://www.spidean.com -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] Close MySQL Result
Shawn McKenzie wrote: Daevid Vincent wrote: -Original Message- From: Nathan Rixham [mailto:nrix...@gmail.com] you'll also find a performance upgrade if you load all sql results in to an array and close up the query / free the results before working on them. query for() { $results[] = $row; } close stuff work on results Do you have any proof of this? What would be the logic here? Got some example benchmarks? Got a URL of a whitepaper or something that discusses this? I would think the only things that the mysql calls are doing is holding pointers to the next record and DB handle. I can't imagine they are using that much resources, nor would they be just spinning and waiting tying up CPU cycles either. I've never heard this to be the case. I have proof to the contrary :-) ?php echo number_format(memory_get_usage()) . Bytes used before query\n; $conn = mysql_connect('localhost', 'x', 'x'); $result = mysql_query(SELECT * FROM table_name); $count = mysql_num_rows($result); echo $count . rows returned\n; echo number_format(memory_get_usage()) . Bytes used after query\n; while($rows[] = mysql_fetch_assoc($result)) { } echo number_format(memory_get_usage()) . Bytes used after array creation\n; mysql_free_result($result); echo number_format(memory_get_usage()) . Bytes used after mysql_free_result\n; ? 65,588 Bytes used before query 6940 rows returned 67,264 Bytes used after query 6,376,612 Bytes used after array creation 6,376,756 Bytes used after mysql_free_result yup appears i was talking bollocks :D lolol - confusion came on my part from optimisation of a high traffic site over the past few years! correction: on simple scripts it is slower, marginally, (due to two for loops and more data in memory) however - in real world applications where such nasty practises as escaping in and out of html to render results and secondary per row queries or api calls are taken in to account this method of getting everything out of the db in a single swift action gives the performance boost - and more over on high traffic sites freeing up the connection / query resources as quickly as possible makes a rather noticeable impact, too many open connections and queries can be very nasty when your getting a few hundred / thousand requests per second. sorry 'bout that! -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
RE: [PHP] Close MySQL Result
http://www.php.net/manual/en/function.mysql-free-result.php mysql_free_result($myresult); NOTE: mysql_free_result() only needs to be called if you are concerned about how much memory is being used for queries that return large result sets. All associated result memory is automatically freed at the end of the script's execution. http://us2.php.net/manual/en/function.unset.php unset($Row); -Original Message- From: Slack-Moehrle [mailto:mailingli...@mailnewsrss.com] Sent: Wednesday, January 20, 2010 1:21 PM To: php-general@lists.php.net Subject: [PHP] Close MySQL Result I think I am a dork. How do I close a MySQL result set to free memory? Given something like this: $gsql = Select * from resources where queryName = 'Production';; $myresult = mysql_query($gsql) or die('Cannot execute Query: ' . mysql_error()); $Row = mysql_fetch_assoc($myresult); if ($Row == true) { $_SESSION['PRODUCTION'] = $Row['queryValue']; } else { $_SESSION['PRODUCTION'] = TRUE; } How do I free up $myresult and $Row? -ML -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
Re: [PHP] Close MySQL Result
Daevid, Thanks for the links so I can read up! -ML - Original Message - From: Daevid Vincent dae...@daevid.com To: php-general@lists.php.net Cc: Slack-Moehrle mailingli...@mailnewsrss.com Sent: Wednesday, January 20, 2010 1:24:16 PM Subject: RE: [PHP] Close MySQL Result http://www.php.net/manual/en/function.mysql-free-result.php mysql_free_result($myresult); NOTE: mysql_free_result() only needs to be called if you are concerned about how much memory is being used for queries that return large result sets. All associated result memory is automatically freed at the end of the script's execution. http://us2.php.net/manual/en/function.unset.php unset($Row); -Original Message- From: Slack-Moehrle [mailto:mailingli...@mailnewsrss.com] Sent: Wednesday, January 20, 2010 1:21 PM To: php-general@lists.php.net Subject: [PHP] Close MySQL Result I think I am a dork. How do I close a MySQL result set to free memory? Given something like this: $gsql = Select * from resources where queryName = 'Production';; $myresult = mysql_query($gsql) or die('Cannot execute Query: ' . mysql_error()); $Row = mysql_fetch_assoc($myresult); if ($Row == true) { $_SESSION['PRODUCTION'] = $Row['queryValue']; } else { $_SESSION['PRODUCTION'] = TRUE; } How do I free up $myresult and $Row? -ML -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
RE: [PHP] Close MySQL Result
On Wed, 2010-01-20 at 13:24 -0800, Daevid Vincent wrote: http://www.php.net/manual/en/function.mysql-free-result.php mysql_free_result($myresult); NOTE: mysql_free_result() only needs to be called if you are concerned about how much memory is being used for queries that return large result sets. All associated result memory is automatically freed at the end of the script's execution. http://us2.php.net/manual/en/function.unset.php unset($Row); -Original Message- From: Slack-Moehrle [mailto:mailingli...@mailnewsrss.com] Sent: Wednesday, January 20, 2010 1:21 PM To: php-general@lists.php.net Subject: [PHP] Close MySQL Result I think I am a dork. How do I close a MySQL result set to free memory? Given something like this: $gsql = Select * from resources where queryName = 'Production';; $myresult = mysql_query($gsql) or die('Cannot execute Query: ' . mysql_error()); $Row = mysql_fetch_assoc($myresult); if ($Row == true) { $_SESSION['PRODUCTION'] = $Row['queryValue']; } else { $_SESSION['PRODUCTION'] = TRUE; } How do I free up $myresult and $Row? -ML -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php And you can unset() $row if you want to free memory used by that variable, although it should be noted that once unset, it's up to PHP's garbage collection to free the memory, but using unset() on the variable tells PHP that it can free it if necessary. If you're that worried about memory as well, try to optimise your queries a little bit. For example, instead of retrieving all the results in a table and using PHP to output only what you need, use the WHERE and LIMIT clauses in MySQL to narrow down the results to only those that you actually need. Thanks, Ash http://www.ashleysheridan.co.uk