> An SQLite user has brought to our attention a performance issue in SQLite > that seems to be associated with malloc(). If you have insights or > corroborating experience with this issue please let me know.
We recently had a malloc/free slowdown issue after changing to VS2008 in combination with XP. Not sure if it applies in your case but for us this helps: -- if( _get_sbh_threshold() < 512 ) { _set_sbh_threshold(512); } --- I'm unable to run your sqlite3.exe: MSVCR100.dll no found. Anyway, maybe the above helps. KInd regards Marcus > > SQLite supports a "zero-malloc option" (see > http://www.sqlite.org/malloc.html#memsys5 for details) which uses its own > internal memory allocator rather than system malloc(). Earlier today, we > patched the command-line shell to allow the zero-malloc option to be > turned > on. If you do: > > sqlite3 DATABASE > > then the regular system memory allocator is used, but if you say: > > sqlite3 -heap 100M DATABASE > > then the MEMSYS5 memory allocator will be used with a pool of 100MB of > memory to work with. (You can adjust the size of your memory pool for > whatever you need.) > > There are win32 and win64 builds of this updated command-line shell > compiled > using vs2010 here: > > http://www.sqlite.org/draft/download.html > > For certain full-text search queries against a large database, we are > seeing > speeds which are 3x faster when using "-heap 300M" (the memsys5 memory > allocator) versus omitting the -heap option and thus using system > malloc(). > This is on windows7. Similar results are seen with both gcc and vs2010 > builds. > > If you have any large queries that you can run on windows using the > command-line shell, I would appreciate you timing those queries using the > new shells from the download page, both with "-heap 300M" and without it, > and letting me know about any performance differences you see. > > I also observe that compiling for 64-bit using vs2010 (not an option with > my > ancient version 2.95.3 gcc cross-compiler) that the queries are an > additional 2x faster. I was surprised at the dramatic performance > increase > in going from 32-bit to 64-bit. Is such a speed-up typical? > > The use of "-heap 300M" seems to not make any performance difference on > Linux. > > Any insights into why this is, what we are doing wrong, or what we can do > to > improve the performance of malloc() on windows will be appreciated. > > -- > D. Richard Hipp > d...@sqlite.org > _______________________________________________ > sqlite-users mailing list > sqlite-users@sqlite.org > http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users > _______________________________________________ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users