On Oct 11, 12:06 pm, Ron Mayer <[email protected]> wrote:
> I'm using beanstalkd to queue up jobs to re-index documents whenever they
> get updated; so my jobs in this case are all simple paths/urls to documents.
>
> For some documents that change faster than the queue is drained, I end up
> getting the same job in the queue dozens of times; and then doing extra work
> re-processing them unnecessarily.
>
> Is there a good way to say "put this in the queue if it's not already in
> there"?
>
> If not, does anyone have a good way of handling this outside of beanstalkd?
Last time I had this problem, I did this:
http://www.rockstarprogrammer.org/post/2008/dec/06/simple-named-job-deduplication/
--
You received this message because you are subscribed to the Google Groups
"beanstalk-talk" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/beanstalk-talk?hl=en.