Hi,

I have a similar problem; I need to reach writing 100000 records/s and parallel reading without blocking the writer. While previously it was not possible (I was considering HDF5 for this), now I decided to go back to sqlite.

Using WAL mode and lots of optimizations I am able to write >150000 records/s (one table with ~20 fields) and at the same time reading(processing) >300000 records/s.

There are lots of tricks/variables (number of fields, page size, cache size, wal checkpoint size...) to achieve this.

Regards,
Gabriel
_______________________________________________
sqlite-users mailing list
sqlite-users@sqlite.org
http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users

Reply via email to