Re: [h2] Manage MVStore file growth: Drop old versions? Best parameters? Entry order?

2014-04-10 Thread Markus Kropf
Thank you very much, Thomas, your hint on LSM-trees opened my eyes! (a little smalltalk: sometimes I tend to forget that there are laws of nature in computer science too... naive thought: That doesn't fit into memory, so lets store it in a database, DBs are so smart these days, they will give

[h2] Manage MVStore file growth: Drop old versions? Best parameters? Entry order?

2014-04-09 Thread Markus Kropf
Hi, I'm trying MVStore to implement a change tracking feature in a large graph structure, using several MVMaps with custom data types. In a recent test, I had a load like this: Opened new store, added ~1M entries, with roughly 10Byte serialized data each, closed. MVStore file size was ~1.6 GB