[sqlite] Handle leak using IIS on windows 7?

Hi there, I've searched around and found a few threads like this: http://sqlite.phxsoftware.com/forums/t/2480.aspx Basically, I have the same issue. When access the sqlite database via a website (MVC3 running on IIS) the first time, sqlite works fine. I properly call connections.Close() when

Re: [sqlite] Handle leak using IIS on windows 7?

If you showed a small sample code that caused your problem it would sure help a lot. I peeked at the library code. That message is generated when _cnn is null (the DB connection). private void InitializeForReader() { if (_activeReader != null && _activeReader.IsAlive)

Re: [sqlite] Performance Improvement

On Mon, Jul 18, 2011 at 4:58 PM, abhisek...@gmail.com wrote: > These are addresses accessed by a program. There will be 100 billion > entries > You won't be able to fit that many in your database - sqlite3 cannot scale to the file size you will need for that. Assuming

[sqlite] Performance Improvement

Hi, I am a new user of SQLite and I have a series of steps to do on a single table, and it takes way too long. I will outline the steps below and please let me know if I can do anything different to speed things up a bit. So I am coding up a cache simulator. The input basically consists of a

Re: [sqlite] Performance Improvement

Sorry the mail was sent prematurely. Continuing ... 2. In a loop, read each address, for that address find the next time this address was used ( to implement the replacement policy) To do this: 1. I am creating a table: CREATE TABLE AddressSet (SeqNo UNSIGNED BIG INT PRIMARY

Re: [sqlite] Performance Improvement

Thanks a lot Stephen. I guess I have to do this on parts of the input file at a time then, which I will try, though it will be an approximation of the file I am trying to implement, but that is fine. What would be the limit of the file size that sqlite can create, assuming disc space is not an

Re: [sqlite] Performance Improvement

On Mon, Jul 18, 2011 at 05:01:55PM +0200, Stephan Beal scratched on the wall: > On Mon, Jul 18, 2011 at 4:58 PM, abhisek...@gmail.com > wrote: > > > These are addresses accessed by a program. There will be 100 billion > > entries > > > > You won't be able to fit that many

Re: [sqlite] Performance Improvement

On Mon, Jul 18, 2011 at 5:14 PM, abhisek...@gmail.com wrote: > file I am trying to implement, but that is fine. What would be the limit of > the file size that sqlite can create, assuming disc space is not > an issue. > http://www.sqlite.org/limits.html Apparently i was

Re: [sqlite] Performance Improvement

Thanks Jay. I guess you are right. I have very little experience in dealing with such huge data-sets. So what I meant was, initially I was doing this with c++ data structures like vectors and maps, and I could not even store all the entries. The program would crash out with bad_alloc exception.

Re: [sqlite] Performance Improvement

Unless your caching at byte-level you don't need all the addresses. For 4K page size mask off the lower 11 bits. You should actually be able to reduce your memory usage by a LOT if you track by pages and not bytes. That will also speed you up along with it. Michael D. Black Senior

Re: [sqlite] Performance Improvement

On 7/18/2011 11:10 AM, abhisek...@gmail.com wrote: > Sorry the mail was sent prematurely. Continuing ... > 2. In a loop, read each address, > for that address find the next time this address was used > ( to implement the replacement policy) Sort the list by address then

Re: [sqlite] Performance Improvement

-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 07/18/2011 07:58 AM, abhisek...@gmail.com wrote: > So I am coding up a cache simulator. I suggest having a look at cachegrind which does something similar. You should be able to learn from their data structures. It is also open source so maybe

Re: [sqlite] Script-friendly execution of sqlite3.exe for initializing a DB

On Thu, Jul 14, 2011 at 16:20:56 -0500, Marvin Bellamy wrote: > I want to run sqlite3 from a script (actually from a ToolTask in the MSBuild > environment) and get it to create a database without dropping into > interactive mode. It looks like ToolTasks don't like the redirection > operator

Re: [sqlite] Performance Improvement

On Mon, Jul 18, 2011 at 9:30 AM, Igor Tandetnik wrote: > On 7/18/2011 11:10 AM, > abhisek...@gmail.com wrote: >> Sorry the mail was sent prematurely. Continuing ... >> 2. In a loop, read each address, >>                     for that address find the next time this address was

Re: [sqlite] Handle leak using IIS on windows 7?

Hm... I'm not doing anything fancy. I've attached the tiny sqlite logging class below. It's called in an MVC app simply by invoking: @Html.Raw(Doug.Utils.Web.DbLogger.Dump()) Yes, it uses transactions; is that a bad thing? I'm pretty sure the issue is something to do with file handles. For the

Re: [sqlite] Handle leak using IIS on windows 7?

On 19 Jul 2011, at 4:07am, Doug wrote: > I'm pretty sure the issue is something to do with file handles. For the same > reason after loading the page (from an IIS server) and then closing the > page, waiting 1 minute or two and then attempting to remove the db.sqlite > file, I get an "error,

Re: [sqlite] Handle leak using IIS on windows 7?

After reading the code, I noticed the following: 1. From the static Dump method, an instance of the DbLogger class is created via the static Get method and stored in the _instance static variable. 2. The connection itself is opened in the constructor for the DbLogger class via the InitDb

[sqlite] Loading a database from memory

Hi. I've been trying to find out the best way of loading an sqlite database from memory. Basically I'd like to be able to save a small sqlite database as meta data to an audio file, i.e. an mpeg4 container. I'd then be able read, modify then write it back to the file. I'm starting to get the

Re: [sqlite] Loading a database from memory

On 19 Jul 2011, at 5:17am, Glenn McCord wrote: > Hi. I've been trying to find out the best way of loading an sqlite > database from memory. Basically I'd like to be able to save a small > sqlite database as meta data to an audio file, i.e. an mpeg4 > container. I'd then be able read, modify then

Re: [sqlite] Loading a database from memory

On Tue, Jul 19, 2011 at 4:31 PM, Simon Slavin wrote: > > On 19 Jul 2011, at 5:17am, Glenn McCord wrote: > >> Hi. I've been trying to find out the best way of loading an sqlite >> database from memory. Basically I'd like to be able to save a small >> sqlite database as meta

Re: [sqlite] Loading a database from memory

On Tue, Jul 19, 2011 at 4:39 PM, Glenn McCord wrote: > On Tue, Jul 19, 2011 at 4:31 PM, Simon Slavin wrote: >> >> On 19 Jul 2011, at 5:17am, Glenn McCord wrote: >> >>> Hi. I've been trying to find out the best way of loading an sqlite >>> database