Re: [sqlite] Upgrade from 3.5.8 -> 3.7.5 - increase memory usage

2011-02-21 Thread Todd Shutts
I am looking at the private byes counter from Windows (MSDN Description
below) for my process.  Is there another counter or stat I should be
looking at?  

(from MSDN - Private Bytes: 
Displays the current number of bytes this process has allocated that
cannot be shared with other processes.)

I receive similar behavior (although it does not climb as fast-because
it doesn't run as fast) with Journal_mode=delete.  When using WAL; I set
the wal_autocheckpoint to 250 and called WAL_CHECKPOINT without any
measurable result to see if I see any difference.

I have left the application running and the private bytes continues to
increase; I am 150MB and counting  My code has to be leaking; but why
not with the older version?

Thanks for all the help

Todd


-Original Message---
From: sqlite-users-boun...@sqlite.org
[mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Roger Binns
Sent: Sunday, February 20, 2011 7:48 PM
To: sqlite-users@sqlite.org
Subject: Re: [sqlite] Upgrade from 3.5.8 -> 3.7.5 - increase memory
usage

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 02/20/2011 02:48 PM, Todd Shutts wrote:
> However; memory usage is growing like crazy. 

It is a very frequent occurrence that what people think is being
measured is
not what is actually being measured.  Make sure you understand exactly
what
the tool showing you memory consumption is measuring and especially
understand if it includes memory shared with other processes or memory
mapped files.  Additionally you need to understand the difference
between
memory as the kernel sees and reports it versus memory within particular
APIs such as C's malloc.

> The application
> never used more than 10MB and it is currently using 57+MB and
continues
> to climb.  

The single most likely explanation is this is WAL in action, the memory
is
from a memory mapped file and a WAL checkpoint will release it.

  http://www.sqlite.org/wal.html

Roger
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk1hxDYACgkQmOOfHg372QRikgCdHrEuzE5p71LTaiF+WRHfG6j2
9S0An100kCApkwZI74XGYR6zxczr2m7u
=d0xw
-END PGP SIGNATURE-
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users


[sqlite] Upgrade from 3.5.8 -> 3.7.5 - increase memory usage

2011-02-20 Thread Todd Shutts
I inherited an application which used SQLite 3.5.8 running on Windows
2000.  I upgrade to version 3.7.5 of the  dll and added pragma statement
to use WAL.  There was an immediate and significant performance
increase.  However; memory usage is growing like crazy.  The application
never used more than 10MB and it is currently using 57+MB and continues
to climb.  

 

I have searched the archives; I don't see anything that applies to
upgrading.I can switch back to the previous version and memory usage
drops and does not grow.  I understand there have been substantial
changes; but I have been unable to find the max usage.  Cache_size is
2000.  Is there any way to limit/control memory or has something changed
related to memory  management where my code needs to change?

Any assistance is appreciated.

 

Thanks.

 


-- 
*
This e-mail may contain confidential or legally privileged information that is 
intended for the individual or entity named as the recipient. 
If you are not the intended recipient, you are hereby notified that any 
disclosure, copying, distribution or reliance upon the contents of this e-mail 
is strictly prohibited. 
If you have received this e-mail in error, please destroy the message 
immediately and contact the sender at Balance Innovations, LLC. Thank you!
*
___
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users