Re: [sqlite] Upgrade from 3.5.8 -> 3.7.5 - increase memory usage
I am looking at the private byes counter from Windows (MSDN Description below) for my process. Is there another counter or stat I should be looking at? (from MSDN - Private Bytes: Displays the current number of bytes this process has allocated that cannot be shared with other processes.) I receive similar behavior (although it does not climb as fast-because it doesn't run as fast) with Journal_mode=delete. When using WAL; I set the wal_autocheckpoint to 250 and called WAL_CHECKPOINT without any measurable result to see if I see any difference. I have left the application running and the private bytes continues to increase; I am 150MB and counting My code has to be leaking; but why not with the older version? Thanks for all the help Todd -Original Message--- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Roger Binns Sent: Sunday, February 20, 2011 7:48 PM To: sqlite-users@sqlite.org Subject: Re: [sqlite] Upgrade from 3.5.8 -> 3.7.5 - increase memory usage -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 02/20/2011 02:48 PM, Todd Shutts wrote: > However; memory usage is growing like crazy. It is a very frequent occurrence that what people think is being measured is not what is actually being measured. Make sure you understand exactly what the tool showing you memory consumption is measuring and especially understand if it includes memory shared with other processes or memory mapped files. Additionally you need to understand the difference between memory as the kernel sees and reports it versus memory within particular APIs such as C's malloc. > The application > never used more than 10MB and it is currently using 57+MB and continues > to climb. The single most likely explanation is this is WAL in action, the memory is from a memory mapped file and a WAL checkpoint will release it. http://www.sqlite.org/wal.html Roger -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk1hxDYACgkQmOOfHg372QRikgCdHrEuzE5p71LTaiF+WRHfG6j2 9S0An100kCApkwZI74XGYR6zxczr2m7u =d0xw -END PGP SIGNATURE- ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
[sqlite] Upgrade from 3.5.8 -> 3.7.5 - increase memory usage
I inherited an application which used SQLite 3.5.8 running on Windows 2000. I upgrade to version 3.7.5 of the dll and added pragma statement to use WAL. There was an immediate and significant performance increase. However; memory usage is growing like crazy. The application never used more than 10MB and it is currently using 57+MB and continues to climb. I have searched the archives; I don't see anything that applies to upgrading.I can switch back to the previous version and memory usage drops and does not grow. I understand there have been substantial changes; but I have been unable to find the max usage. Cache_size is 2000. Is there any way to limit/control memory or has something changed related to memory management where my code needs to change? Any assistance is appreciated. Thanks. -- * This e-mail may contain confidential or legally privileged information that is intended for the individual or entity named as the recipient. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution or reliance upon the contents of this e-mail is strictly prohibited. If you have received this e-mail in error, please destroy the message immediately and contact the sender at Balance Innovations, LLC. Thank you! * ___ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users