[ https://issues.apache.org/jira/browse/KAFKA-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15650180#comment-15650180 ]
Pratik kumar edited comment on KAFKA-4386 at 11/9/16 9:20 AM: -------------------------------------------------------------- Just for clarification: Async producers use sync producers internally to send batched messages(TopicPartition X ByteBufferMessageSet). So each invocation of send in sync producer should contain a collection of messages for a particular broker rather than single messages. These metrics are released for each call to this method , which encapsulates the above functionality . So shouldn't these metrics be tracked for each batch(for each broker) rather than request level? was (Author: pratik.kumar): Just for clarification: Async producers use sync producers internally to send batched messages(TopicPartition X ByteBufferMessageSet). So each invocation of send in sync producer should contain the a collection of messages rather than a single message. These metrics are released for each call to this method , which encapsulates the above functionality . So shouldn't these metrics be tracked for each batch rather than request level? > Producer Metrics Explanation > ---------------------------- > > Key: KAFKA-4386 > URL: https://issues.apache.org/jira/browse/KAFKA-4386 > Project: Kafka > Issue Type: Bug > Components: producer > Reporter: Pratik kumar > Labels: producer > > Context : > Kafka Producer 0.8.x > Problem: > Kafka Producer emits metrics regarding request size stats, request latency > and request rate stats. > But the inherent meaning of the these metrics are not clear. What does this > measure? > Is for each producer send request(which contains batches of messages per > broker)? OR Is it for a batch of messages defined according to user batching > policy? What happens when some application code has multiple async producers > to increase performance (how are rate and percentiles measured?)? -- This message was sent by Atlassian JIRA (v6.3.4#6332)