[ 
https://issues.apache.org/jira/browse/FLUME-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225457#comment-14225457
 ] 

Gwen Shapira commented on FLUME-2562:
-------------------------------------

Example of new metrics:

"CHANNEL.channel1":{"EventPutSuccessCount":"98","ChannelFillPercentage":"1.7976931348623157E308","*KafkaEventGetTimer*":"2","Type":"CHANNEL","*KafkaEventSendTimer*":"565","*KafkaCommitTimer*":"1142","EventTakeSuccessCount":"95","StopTime":"0","ChannelSize":"0","EventPutAttemptCount":"0","StartTime":"1416893965625","*RollbackCount*":"0","ChannelCapacity":"0","EventTakeAttemptCount":"0”}}

"SOURCE.source1":{"*KafkaEventGetTimer*":"7377","OpenConnectionCount":"0","Type":"SOURCE","AppendBatchAcceptedCount":"0","AppendBatchReceivedCount":"0","EventAcceptedCount":"30","AppendReceivedCount":"0","StopTime":"0","StartTime":"1416953795734","EventReceivedCount":"30","*KafkaCommitTimer*":"1129","AppendAcceptedCount":"0”},

{"SINK.sink1":{"Type":"SINK","ConnectionClosedCount":"0","EventDrainSuccessCount":"437","*KafkaEventSendTimer*":"2144","ConnectionFailedCount":"0","BatchCompleteCount":"0","EventDrainAttemptCount":"0","ConnectionCreatedCount":"0","BatchEmptyCount":"0","StopTime":"0","*RollbackCount*":"0","StartTime":"1416960016259","BatchUnderflowCount":"0”},


> Metrics for Flafka components
> -----------------------------
>
>                 Key: FLUME-2562
>                 URL: https://issues.apache.org/jira/browse/FLUME-2562
>             Project: Flume
>          Issue Type: Improvement
>            Reporter: Gwen Shapira
>            Assignee: Gwen Shapira
>         Attachments: FLUME-2562.1.patch
>
>
> Kafka source, sink and channel should have metrics. This will help us track 
> down possible issues or performance problems.
> Here are the metrics I came up with:
> kafka.next.time - Time spent waiting for events from Kafka (source and 
> channel)
> kafka.send.time - Time spent sending events (channel and sink) 
> kafka.commit.time - Time spent committing (source and channel)
> events.sent - Number of events sent to Kafka (sink and channel)
> events.read - Number of events read from Kafka (channel and source)
> events.rollback - Number of event rolled back (channel) or number of rollback 
> calls (sink)
> kafka.empty - Number of times backing off due to empty kafka topic (source)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to