I don't have strong evidence that this is a bug yet. let me write some test program and see if I can confirm/reproduce the issue.
On Mon, Feb 9, 2015 at 7:59 PM, Jay Kreps <jay.kr...@gmail.com> wrote: > Hmm, that does sound like a bug, we haven't seen that. How easy is it to > reproduce this? > > -Jay > > On Mon, Feb 9, 2015 at 5:19 PM, Steven Wu <stevenz...@gmail.com> wrote: > > > We observed some small discrepancy in messages sent per second reported > at > > different points. 1) and 4) matches very close. 2) and 3) matches very > > close but are about *5-6% lower* compared to 1) and 4). > > 1) send attempt from producer > > 2) send success from producer > > 3) record-send-rate reported by kafka producer > > 4) MessagesInPerSecond reported by kafka broker > > > > note that send success for 2) is incremented when onCompletion is called > > without error/exception). there is also a send error count when > > onCompletion is called with error. it is always zero. > > > > that's why I am wondering whether there are some callback misses? > > > > some info about the setup > > * producer: 0.8.2-beta > > * broker: 0.8.1.1 > > * acks=1 > > > > Thanks, > > Steven > > >