Re: Suggestions for deferring DB write using memcached

2010-06-05 Thread Brian Moon
- I'd like to keep our system as simple as possible and avoid additional components if possible. Has anyone had success using memcache itself for implementing work queues (a la memcachequeue)? See my slide from my recent memcached talk about queues. http://screencast.com/t/MGE5NWU1Y Brian.

Re: Suggestions for deferring DB write using memcached

2010-06-04 Thread Jay Paroline
One more shop here that uses gearmand for this!

Re: Suggestions for deferring DB write using memcached

2010-06-04 Thread ehalpern
Thanks for the quick responses. Has anyone had experience using gearman from java using gearman-java or some other bindings? On Jun 3, 12:13 pm, dormando dorma...@rydia.net wrote: We're building a system with heavy real-time write volume and looking for a way to decouple db writes from the

Suggestions for deferring DB write using memcached

2010-06-03 Thread ehalpern
We're building a system with heavy real-time write volume and looking for a way to decouple db writes from the user request path. We're exploring the approach of buffering updated entities in memcached and writing them back to the database asynchronously. The primary problem that we're concerned

Re: Suggestions for deferring DB write using memcached

2010-06-03 Thread dormando
We're building a system with heavy real-time write volume and looking for a way to decouple db writes from the user request path. We're exploring the approach of buffering updated entities in memcached and writing them back to the database asynchronously. The primary problem that we're

Re: Suggestions for deferring DB write using memcached

2010-06-03 Thread Adam Lee
On Thu, Jun 3, 2010 at 3:06 PM, ehalpern eric.halp...@gmail.com wrote: We're building a system with heavy real-time write volume and looking for a way to decouple db writes from the user request path. We're exploring the approach of buffering updated entities in memcached and writing them

Re: Suggestions for deferring DB write using memcached

2010-06-03 Thread Brian Moon
+1 We use gearman for this. Brian. http://brian.moonspot.net/ On 6/3/10 3:13 PM, dormando wrote: We're building a system with heavy real-time write volume and looking for a way to decouple db writes from the user request path. We're exploring the approach of buffering updated

Re: Suggestions for deferring DB write using memcached

2010-06-03 Thread Brian Moon
Oh, and I wrote about one application that does this. http://brian.moonspot.net/logging-with-mysql Brian. http://brian.moonspot.net/ On 6/3/10 3:13 PM, dormando wrote: We're building a system with heavy real-time write volume and looking for a way to decouple db writes from the user

Re: Suggestions for deferring DB write using memcached

2010-06-03 Thread Vladimir Vuksan
Others have suggested their favored tools. I would add beanstalkd to the list http://kr.github.com/beanstalkd/ I like it since it comes with simple (memcached inspired) protocol and can persist jobs. Vladimir On Thu, 3 Jun 2010, ehalpern wrote: We're building a system with heavy