I believe more current versions of beanstalk will help with this issue. The issue is that beanstalk keeps binlogs all the way back to the oldest job still in a queue even though many more jobs have been deleted since then. It's a relatively new fix and may only be in git (not sure - I'm still running the older code). Also note the binlogs from your current version are incompatible with the new code in git.
The way to clear YOUR binlogs is to clean up your tubes. It's probably those delayed jobs. Something is happening in your consumer that is preventing them from being deleted. For me often I do lots of work in a try/catch and release the job in the catch rather than deleting it. I've since changed this so it first checks the job-stats to see how many times its been attempted and if it's over some threshold I either bury it or delete it. This way you can monitor buried jobs (something you should do anyway if you use bury) and keep your tubes clean :) --chad On Aug 30, 2011, at 3:06 AM, Victor <[email protected]> wrote: > Hi, > > I have a little problem, my binlog dir is currently 46gb and I can't > find a way to empty it, well, I could always just remove all the > binlogs, but I doubt that it's the right way to do this. > > I used a tool[1] to check if I had any posts laying around in any of > my tubes and found that most of them is actually empty. The problem is > though that I have one that looks like this: > > some_tube: > - cmd-pause-tube = 0 (0) > - current-jobs-buried = 0 (0) > - current-jobs-delayed = 192 (+192) > - current-jobs-ready = 0 (0) > - current-jobs-reserved = 8 (+8) > - current-jobs-urgent = 0 (0) > - current-using = 2 (+2) > - current-waiting = 0 (0) > - current-watching = 2 (+2) > - pause = 0 (0) > - pause-time-left = 0 (0) > - total-jobs = 501193520 (+501193520) > > Which leads me to believe that this is my main problem. I think that I > might have failed to delete the posts properly which makes them just > being there stateless. Is there a way to get rid of them as there's > quite a lot of data on disc that i don't really want to keep. > > //Victor > > [1] > https://github.com/dustin/beanstalk-tools/blob/master/bin/beanstalk-queue-stats.rb > > -- > You received this message because you are subscribed to the Google Groups > "beanstalk-talk" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/beanstalk-talk?hl=en. > -- You received this message because you are subscribed to the Google Groups "beanstalk-talk" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/beanstalk-talk?hl=en.
