[ 
https://issues.apache.org/jira/browse/FLUME-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14221243#comment-14221243
 ] 

Gwen Shapira commented on FLUME-2562:
-------------------------------------

Looks like I got the wrong counters here :)

I used CounterGroup where I probably should have used SourceCounter, 
SinkCounter and ChannelCounter which are exposed via http. 

I assume that extending those classes to add some Kafka-specific metrics is 
acceptable? 
I'm asking because it looks like no one extended them before...



> Metrics for Flafka components
> -----------------------------
>
>                 Key: FLUME-2562
>                 URL: https://issues.apache.org/jira/browse/FLUME-2562
>             Project: Flume
>          Issue Type: Improvement
>            Reporter: Gwen Shapira
>            Assignee: Gwen Shapira
>         Attachments: FLUME-2562.0.patch
>
>
> Kafka source, sink and channel should have metrics. This will help us track 
> down possible issues or performance problems.
> Here are the metrics I came up with:
> kafka.next.time - Time spent waiting for events from Kafka (source and 
> channel)
> kafka.send.time - Time spent sending events (channel and sink) 
> kafka.commit.time - Time spent committing (source and channel)
> events.sent - Number of events sent to Kafka (sink and channel)
> events.read - Number of events read from Kafka (channel and source)
> events.rollback - Number of event rolled back (channel) or number of rollback 
> calls (sink)
> kafka.empty - Number of times backing off due to empty kafka topic (source)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to