Hi Keith,
I may be running into this issue as well. On a particular node (1 of 6),
I'm seeing the binlog directory has grown to 27GB and around 2500 files.
The other 5 nodes have more reasonable binlog sizes (~5GB, 500 or so
files).
- Beanstalk 1.9 on Debian Linux
- The host in question has binlog-records-migrated value of 0
- Our jobs are around 250-400 bytes each
- These nodes handle ~200 jobs per second each
I'm investigating high CPU utilization & disk I/O spikes in beanstalkd on
production so I'm happy to help track this down in any way I can.
Here is memory usage:
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
4691 root 20 0 6149m 6.0g 660 S 5 25.3 77:36.33 beanstalkd
Here is disk usage:
$ du -hs /var/lib/beanstalkd/
27G /var/lib/beanstalkd/
Here is file count:
$ ls -al /var/lib/beanstalkd/ | grep binlog | wc -l
2692
Here is the output of stats-tube:
--------------------------------------------------------
OK 1013
---
current-jobs-urgent: 0
current-jobs-ready: 10364940
current-jobs-reserved: 95
current-jobs-delayed: 0
current-jobs-buried: 3490
cmd-put: 8247649
cmd-peek: 0
cmd-peek-ready: 1799
cmd-peek-delayed: 26
cmd-peek-buried: 26
cmd-reserve: 4213336
cmd-reserve-with-timeout: 10993828
cmd-delete: 8785013
cmd-release: 0
cmd-use: 8251143
cmd-watch: 1655
cmd-ignore: 1655
cmd-bury: 58066
cmd-kick: 59
cmd-touch: 0
cmd-stats: 12867
cmd-stats-job: 944
cmd-stats-tube: 1101846
cmd-list-tubes: 157294
cmd-list-tube-used: 0
cmd-list-tubes-watched: 4
cmd-pause-tube: 0
job-timeouts: 1482
total-jobs: 8247649
max-job-size: 65535
current-tubes: 7
current-connections: 153
current-producers: 0
current-workers: 152
current-waiting: 37
total-connections: 8343737
pid: 4691
version: 1.9
rusage-utime: 1352.356517
rusage-stime: 3288.077492
uptime: 173047
binlog-oldest-index: 31746
binlog-current-index: 34353
binlog-records-migrated: 0
binlog-records-written: 17146841
binlog-max-size: 10485760
id: f5912079375bea2d
--------------------------------------------------------
What other information would be useful to provide?
Thanks for your time.
Kian
--
You received this message because you are subscribed to the Google Groups
"beanstalk-talk" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/beanstalk-talk.
For more options, visit https://groups.google.com/d/optout.
