Le jeu. 16 mai 2019 à 13:47, Amirouche Boubekki <amirouche.boube...@gmail.com> a écrit : > > Hello, > > > I am considering using lsm extension for a project. I a did a few benchmark > with the following configuration: > > LSM_CONFIG_AUTOFLUSH 1048576 > LSM_CONFIG_BLOCK_SIZE 65536 > LSM_CONFIG_AUTOWORK 1 > LSM_CONFIG_MMAP 0 > LSM_CONFIG_MULTIPLE_PROCESS 0 > > I am trying to load 4.5GB of data. The database errors with BUSY error at > some point. > > Also, the memory consumption grows unbound even if I diseabled MMAP. > > Here is some stats: > > $ ls -larh wt/foob.ar.lsm.sqlite* > > -rw-r--r-- 1 amirouche amirouche 618M May 16 13:39 wt/foob.ar.lsm.sqlite-log > -rw-r--r-- 1 amirouche amirouche 468M May 16 13:39 wt/foob.ar.lsm.sqlite > > And I attached a memory plot. > > opening and closing the database at each transaction help, but still the > memory grows. > > What I am doing wrong?
It is probably because I was inserting bytes taken from /dev/urandom. The code is at https://git.sr.ht/~amz3/chez-sqlite-lsm/tree/master/bench.scm -- Amirouche ~ amz3 ~ https://hyper.dev _______________________________________________ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users