[
https://issues.apache.org/jira/browse/FLINK-14531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16960856#comment-16960856
]
Gyula Fora commented on FLINK-14531:
------------------------------------
Hi!
Thanks for starting the discussion, we have built a Kafka Metrics reporter at
Cloudera that we would be happy to contribute back.
There are a few caveats, such as the kafka version, output format etc we have
to discuss though.
We took a fairly simplistic approach now that we use the latest 2.+ kafka
client and use JSON as the output format
> Add Kafka Metrics Reporter
> ----------------------------
>
> Key: FLINK-14531
> URL: https://issues.apache.org/jira/browse/FLINK-14531
> Project: Flink
> Issue Type: New Feature
> Components: Runtime / Metrics
> Environment: jdk1.8 + IDEA
> Reporter: chen yong
> Priority: Minor
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> When we developed monitoring indicators and reported them, we found that
> there was no report suitable for us, because our company had its own
> monitoring system, so we customized kafkareporter, and then the monitoring
> system would read the information and analyze it itself.Maybe other companies
> have similar situations.Although there is JMX, kafka is more
> versatile.Meanwhile, reporting monitoring indicators to kafka has no impact
> on the performance of flink program compared with other reports sent to the
> database.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)