Hello, I was wondering if it is possible for Pharo to load lots of data and query them without using external DB, just using object memory. Well, someting like GemStone/S, but not so sophisticated.
I did some research so here is details what I found. I would appreciate if someone can tell me if any points of this agenda can be allready done or need to be programmed, or if this whole idea is waste of time and it is better to use external DB. 1) Object memory limit: Current object memory of Pharo is limited to 4GB. Free version of GemStone/S is also limited to 4GB, so I would rather stick with Pharo until I reach this level. And in the future this limit grow due to 64bit version of VM. 2) Saving to disk: Is it possible to save object or group of objects to disk and ensure consistency? With some transaction mechanism and transaction log? 3) RAM limit: Is it possible to delete objects from memory, move them to the disk and not break its connections to other objects? For example by redirecting object internal ID to some kind of hollow object, that will renew receiver of message from disk if necessary... This approach can also possibly split object memory into more "remote" sources. 4) Indexing: What optimalization for searching current collections in Pharo do? For example: how to store instances of City if I would like to search through it by name and also by its postal code? Is there some library for creating fulltext search (maybe Spotter uses that - I did not study it yet). Have a nice day, and thanks for any answer. Adam
