Rishi, Not sure this will help, but take a look at something interesting for your work to analyze memcache traffic: http://www.mspnews.com/news/2011/06/14/5572416.htm Darpan
On Tue, Jul 12, 2011 at 4:36 PM, rishi kapoor <[email protected]>wrote: > Hi Darpan, > > Exactly, I am looking for trace which has similar format > *<timestamp> <server id> GET|PUT|operations..., key, other parameters* > * > * > My intention is to replay these traces to generate workload to the cache > and see the performance. I am trying to characterize memcached specific > real world workloads. Following are the specific questions that I want to > answer in broad category: > > a) spikes in load: peak load vs normal load? > b) Key hot spots (i.e if there is a particular set of keys which is really > popular)? > c) What is the time order of change of these hotspots (do different keys > get popular at different time)? > > > I understand answers to these questions are heavily dependent on > application and traffic to the particular site. But a real implementation > trace is far better than simulated lab settings. > > > Rishi > > > On Tue, Jul 12, 2011 at 3:55 PM, Darpan Dinker <[email protected]>wrote: > >> Hi Rishi, >> >> (1) Are you looking for a trace such as follows: >> *<timestamp> GET|PUT|operations..., key, other parameters* >> >> Defining the trace may make it simpler for other members on this mailing >> list to respond with a "yes, I have it". >> >> (2) Regarding load spikes: are you simulating a cache or characterizing >> the workload using a real implementation? >> >> Darpan >> >> -- >> Darpan Dinker, VP Engineering >> Schooner Information Technology, Inc. http://www.schoonerinfotech.com/ >> MySQL and NoSQL for Mission-Critical Applications >> >> >> >> On Tue, Jul 12, 2011 at 9:12 AM, Roberto Spadim <[email protected]>wrote: >> >>> hum... maybe you should search "benchmark memcache" at google >>> >>> at dev.mysql have some informations about nosql and mysql: >>> >>> http://dev.mysql.com/tech-resources/articles/nosql-to-mysql-with-memcached.html >>> >>> since you are a Phd student... i think it's better test yourself what >>> is each software do >>> memcache protocol can be used for many data storages >>> memcached software is designed with cache in mind, check the first >>> memcached page, it's a cache system (i don't know but i think that all >>> key-value ram 'databases' are cache systems) >>> >>> some tests/benchmarks? google it... you will find many benchmarks >>> about php+mysql+memcached as a cache+database solution and only >>> php+mysql+(mysql query cache) as other solution, i didn't found many >>> benchmarks about what's key-value database is better, at what >>> overload, but since they don't do locks (they only get/set/delete) i >>> think you will not find a big difference between one and other >>> implementation (must check) >>> you will find more benchmarks about web scenario because many web app >>> use mysql as database and after 'memcache boom' many clients start >>> using it as a cache system, before memcached some app used apc (php >>> extension) and others cache systems (pear cache), but they aren't for >>> network, some used filesystems too (samba network filesystem, nfs and >>> others), but there's a bigger overhead using a network filesystem than >>> a memcached cache system >>> >>> maybe there's others protocols/nosql databases that you could study >>> too check this at wikipedia: >>> http://en.wikipedia.org/wiki/NoSQL >>> >>> check that they are cache solutions, not database solutions... read this: >>> Key-value >>>>>cache<<<<< in RAM >>> Citrusleaf database >>> memcached >>> Oracle Coherence >>> Redis >>> Tuple space >>> Velocity >>> >>> >>> 2011/7/12 Rishi <[email protected]>: >>> > Let me rephrase my statement >>> > " research on "in memory" key-value stores particularly memcached, >>> > with key focus on characterizing performance >>> > in case of load spikes. For data analysis, I am looking for realistic >>> > traces of memcached operations." >>> > >>> > It would be really great if some of the memcached users in industrial >>> > setting can share their traces. >>> > >>> > >>> > On Jul 11, 7:25 pm, Roberto Spadim <[email protected]> wrote: >>> >> you forgot the first paragraph >>> >> >>> >> What is Memcached? >>> >> >>> >> Free & open source, high-performance, distributed memory >>> object>>caching system<<, generic in nature, but intended for use in >>> >> >>> >> speeding up dynamic web applications by alleviating database load. >>> >> >>> >> for database (nosql) you should use this:http://memcachedb.org/ >>> >> or thishttp://www.couchbase.org/membase >>> >> >>> >> some ports/patchs allow others sql databases to use nosql memcache >>> >> protocol to get information about database check innodb-memcache and >>> >> nbd-memcache from mysql database >>> >> >>> >> 2011/7/11 Gabriel Sosa <[email protected]> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> >>> >> > wait wait wait... >>> >> >>> >> > from memcached.org >>> >> >>> >> > "Memcached is an in-memory key-value store for small chunks of >>> >> > arbitrary data (strings, objects) from results of database calls, >>> API >>> >> > calls, or page rendering." >>> >> >>> >> > I think caching is a particular use of memcache. In my case I >>> usually >>> >> > use it as a set of counters where you can do atomic operations. >>> >> >>> >> > saludos. >>> >> >>> >> > On Mon, Jul 11, 2011 at 8:43 PM, Roberto Spadim < >>> [email protected]> wrote: >>> >> > > hum... it´s no a key-value store >>> >> > > it´s a cache >>> >> > > if you want a nonsql database, check membase, or memcachedb >>> >> >>> >> > > 2011/7/11 Rishi <[email protected]> >>> >> >>> >> > >> Hi, >>> >> >>> >> > >> I am a PhD student and currently doing research on key-value >>> stores >>> >> > >> particularly memcached, with key focus on characterizing >>> performance >>> >> > >> in case of load spikes. For data analysis, I am looking for >>> realistic >>> >> > >> traces of memcached operations. >>> >> >>> >> > >> I was wondering if anyone is aware of any repository of such >>> publicly >>> >> > >> available traces? >>> >> >>> >> > >> - >>> >> > >> Rishi >>> >> >>> >> > > -- >>> >> > > Roberto Spadim >>> >> > > Spadim Technology / SPAEmpresarial >>> >> >>> >> > -- >>> >> > Gabriel Sosa >>> >> > Si buscas resultados distintos, no hagas siempre lo mismo. - >>> Einstein >>> >> >>> >> -- >>> >> Roberto Spadim >>> >> Spadim Technology / SPAEmpresarial >>> >>> >>> >>> -- >>> Roberto Spadim >>> Spadim Technology / SPAEmpresarial >>> >> >> >
