Hello,
redis maybe?
smolix wrote:
* Thanks for the info about discard. Turning off LRU should help (this
is a not very much documented feature).
* The data we are computing is semi-persistent. That is, we need it
for the 1-2 days of computation we do (and yes, we do
checkpointing ;-). After that it can be discarded.
* Do you know of a better alternative (we need very high IOPS)?
TokyoCabinet solves a different problem. SSDs are not available in the
context. HD is too slow.
Take care,
Alex
On Aug 11, 11:13 am, Josef Finsel <[email protected]> wrote:
Yes, you can turn off the discard but it is not nor should it ever be used
as a persistent data store.
There are other options that might work for this, but using memcached would
be putting a 1" square peg into a 1/4" round hole.
On Tue, Aug 11, 2009 at 1:59 PM, smolix <[email protected]> wrote:
Hi,
Is there a way to use memcached as a _guaranteed_ distributed
(key,value) storage? That is, I want to have a distributed storage of
(key, value) pairs which can be accessed from many clients
efficiently. The RAM is sufficient that all should easily fit into
memory but I probably can't have an overhead of more than 2x the
amount of data it takes to store the pairs. Is there a way to turn off
the discard option in memcached? I can tune the keys such that they
are sequential or do similar preprocessing if needed.
This is about 100-500GB of data that I need to store with values less
than 4k per item (in some cases much smaller).
Any help and suggestions would be greatly appreciated.
Thanks,
Alex
--
"If you see a whole thing - it seems that it's always beautiful. Planets,
lives... But up close a world's all dirt and rocks. And day to day, life's a
hard job, you get tired, you lose the pattern."
Ursula K. Le Guin
What's different about data in the cloud?http://www.azuredba.com
http://www.finsel.com/words,-words,-words.aspx(My blog)
-http://www.finsel.com/photo-gallery.aspx(My Photogallery)
-http://www.reluctantdba.com/dbas-and-programmers/blog.aspx(My Professional
Blog)
I enjoy the massacre of ads. This sentence will slaughter ads without a
messy bloodbath.
