* Thanks for the info about discard. Turning off LRU should help (this is a not very much documented feature). * The data we are computing is semi-persistent. That is, we need it for the 1-2 days of computation we do (and yes, we do checkpointing ;-). After that it can be discarded. * Do you know of a better alternative (we need very high IOPS)? TokyoCabinet solves a different problem. SSDs are not available in the context. HD is too slow.
Take care, Alex On Aug 11, 11:13 am, Josef Finsel <[email protected]> wrote: > Yes, you can turn off the discard but it is not nor should it ever be used > as a persistent data store. > There are other options that might work for this, but using memcached would > be putting a 1" square peg into a 1/4" round hole. > > > > On Tue, Aug 11, 2009 at 1:59 PM, smolix <[email protected]> wrote: > > > Hi, > > > Is there a way to use memcached as a _guaranteed_ distributed > > (key,value) storage? That is, I want to have a distributed storage of > > (key, value) pairs which can be accessed from many clients > > efficiently. The RAM is sufficient that all should easily fit into > > memory but I probably can't have an overhead of more than 2x the > > amount of data it takes to store the pairs. Is there a way to turn off > > the discard option in memcached? I can tune the keys such that they > > are sequential or do similar preprocessing if needed. > > > This is about 100-500GB of data that I need to store with values less > > than 4k per item (in some cases much smaller). > > > Any help and suggestions would be greatly appreciated. > > > Thanks, > > > Alex > > -- > "If you see a whole thing - it seems that it's always beautiful. Planets, > lives... But up close a world's all dirt and rocks. And day to day, life's a > hard job, you get tired, you lose the pattern." > Ursula K. Le Guin > > What's different about data in the cloud?http://www.azuredba.com > > http://www.finsel.com/words,-words,-words.aspx(My blog) > -http://www.finsel.com/photo-gallery.aspx(My Photogallery) > -http://www.reluctantdba.com/dbas-and-programmers/blog.aspx(My Professional > Blog) > > I enjoy the massacre of ads. This sentence will slaughter ads without a > messy bloodbath.
