Hi everyone. We have a cache that stores records with timestamp and regularly we run a scan query like "timestamp <= now" and process returned records. As an optimization we implemented such a logic that if timestamp of a record greater than a threshold we don't put it to the cache but store directly to the database. If it is within the threshold we put it to cache and with a store adapter implementation we also put record to database. Because we don't want to lose record through restarts.
In our current state, the store adapter is the bottleneck under load, because of inserts and deletes. We insert new records and delete processed ones. So we thought persisting the data on file instead of database would perform better. But at the same time we don't want to lose the threshold optimization. So is it possible to implement such a logic with file persistence that we only keep certain record on memory? Do you have any suggestions that perform better in our use case? Thanks a lot. Best regards. -- Alper Tekinalp Software Development Team Lead Evam Streaming Analytics www.evam.com <http://www.evam.com.tr> <http://www.evam.com>
