Joe Wilson <[EMAIL PROTECTED]> wrote:
> --- Tom Briggs <[EMAIL PROTECTED]> wrote:
> >    For clarity, my definition of small is about 200GB, so I'm not
> > selling SQLite short here... 
> Are you able to get decent performance out of sqlite3 for a 200GB database?
> How much RAM do you have on such a machine?

Whenever you start a new transaction, SQLite has to
allocate and clear a bitmap used to record which
pages have changes in the database file.  The size
of this bitmap is proportional to the size of the
database file.  The size of the bitmap is 256 bytes
per megabyte of database file assuming a 1KiB page
size.  That translates into about 52MB for a 200GiB
database.  This is doable, but probably not optimal.

Methods for reducing the memory requirements of this
bitmap (so that it is proportional to the size of the
change rather than the size of the database) have been
proposed, but we have not taken any steps toward
implementing them since the current approach works
well enough.  But as people start to push SQLite 
into the 100GiB size and beyond, we will likely revisit
that decision.

D. Richard Hipp <[EMAIL PROTECTED]>

To unsubscribe, send email to [EMAIL PROTECTED]

Reply via email to