[
https://issues.apache.org/jira/browse/FLUME-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13634797#comment-13634797
]
Venkatesh Sivasubramanian commented on FLUME-2004:
--------------------------------------------------
Hi [~mpercy],
Thanks for reviewing!!
1. The line 298 gets invoked only when the buffer size (batchsize) is reached
and in that case, it calls the processEventBatch() and clears the events list.
And the line 304 is for all spillovers when the stream has stopped without
reaching the batch size. That is the reason, I have added in both the places.
Pls. feel free to let me know if my understanding is incorrect.
2. On the testing front, I did local testing by adding an interceptor that
selectively returned null based on some pattern in the message/event. Sure, let
me try to add a unit test and submit the patch to review board.
Best regards,
Venkatesh
> Need to capture metrics on the Flume exec source such as events received,
> rejected, etc.
> ----------------------------------------------------------------------------------------
>
> Key: FLUME-2004
> URL: https://issues.apache.org/jira/browse/FLUME-2004
> Project: Flume
> Issue Type: New Feature
> Components: Channel, Sinks+Sources
> Affects Versions: v1.3.0
> Reporter: Robert Justice
> Priority: Minor
> Attachments: FLUME-2004.patch
>
>
> To give you a background, we have configured our flume agents with "exec"
> source to tail some logs and stream it to a set of collectors. We have
> monitoring setup that polls "/metrics" on these agents and verifies a few
> metrics like channel size, event put count etc. The "/metrics" response
> returns data about the 'channel' and 'sink' (we have an avro sink)
> components, however there is no data returned about the "source" (exec)
> component. We are interested in monitoring the number of events received,
> rejected, etc.
> I couldn't find any documentation around this; I checked the flume source and
> saw the metrics are not getting captured in the code as well for 'exec'
> source.
> Please improve the metrics captured for the 'exec' source for flume.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
