Re: Kafka Monitoring

Thank you Apostolis Glenis. On Thu, Dec 14, 2017 at 7:30 PM, Apostolis Glenis wrote: > I have also created a monitoring application for Kafka that uses > prometheus. > You can look at the source code here: > > https://github.com/aglenis/kafka_monitoring_pandas > >

Re: Kafka Monitoring

I have also created a monitoring application for Kafka that uses prometheus. You can look at the source code here: https://github.com/aglenis/kafka_monitoring_pandas 2017-12-13 9:53 GMT+02:00 Irtiza Ali : > Ok thank you Michal > > On Tue, Dec 12, 2017 at 9:30 PM, Michal Michalski

Re: Kafka Monitoring

Ok thank you Michal On Tue, Dec 12, 2017 at 9:30 PM, Michal Michalski < michal.michal...@zalando.ie> wrote: > Hi Irtiza, > > Unfortunately I don't know what could be the issue in your case - in my > case all these metrics simply appear under appropriate keys > (e.g. "kafka.controller") in the

Re: Kafka Monitoring

Hi Irtiza, Unfortunately I don't know what could be the issue in your case - in my case all these metrics simply appear under appropriate keys (e.g. "kafka.controller") in the JSON response of the /list request - the same as the one you're making (I checked it right now to be sure). I also

Re: Kafka Monitoring

Hi Michal, I have followed the steps below for the configuring Jolokia with kafka - Install the jolokia JVM-Agent jar from their site. - Copy the jolokia jar file in the /opt/jolokia-agent/, create jolokia-agent directory as it doesn’t exist already. - Move to the

Re: Kafka Monitoring

Hi, We have no modifications in that file - what we do is having a "wrapper" that's just a Docker "entrypoint" (just a bash script) which contents is: export KAFKA_OPTS="$KAFKA_OPTS -javaagent:/jolokia-jvm-agent.jar=port=8074,host=0.0.0.0" exec ${KAFKA_DIR}/bin/kafka-server-start.sh

Re: Kafka Monitoring

Thanks Michal, can you kindly send me you kafka-run-class.sh and kafka-server-start.sh file, I have look what have you done. Because I have done same thing that you explained above but when i do this < http://localhost:/jolokia/list> i get only metrics for the zookeeper but not the above

Re: Kafka Monitoring

Hi Irtiza, I don't have any tutorial, but I can tell you what we do :-) First of all we have Jolokia agent jar included in our Kafka Docker image. Then we append this to KAFKA_OPTS -javaagent:/jolokia-jvm-agent.jar=port=8074,host=0.0.0.0 Relevant port is then "exposed" in Docker image and

Re: Kafka Monitoring

Hello Michal, Can you send me link to tutorial or provide some resources for the Jolokia configuration with kafka> Thank you Irtiza On Wed, Dec 6, 2017 at 8:00 PM, Michal Michalski < michal.michal...@zalando.ie> wrote: > Hi Irtiza, > > We're using Jolokia and we had no problems with it. > It

Re: Kafka Monitoring

thank you subhash. I will check it out On Wed, Dec 6, 2017 at 5:43 PM, Subhash Sriram wrote: > Hi Irtiza, > > Have you looked at jmxtrans? It has multiple output writers for the > metrics and one of them is the KeyOutWriter which just writes to disk. > >

Re: Kafka Monitoring

And Lenses - https://www.landoop.com/kafka-lenses/ On 06/12/2017, 11:21, "Abhimanyu Nagrath" wrote: There are a couple of tools for this. 1. Linkedin Burrow - https://github.com/linkedin/Burrow 2. Yahoo Kafka Monitoring Tool -

Re: Kafka Monitoring

Hi Irtiza, We're using Jolokia and we had no problems with it. It would be useful to know what exactly you did (how you "plugged in" Jolokia, how you configured it, what endpoint are you querying etc.) to help you. On 6 December 2017 at 10:36, Irtiza Ali wrote: > Hello everyone,

Re: Kafka Monitoring

I’ll give a +1 for jmxtrans here. We use it with great success paired with Graphite and Grafana for monitoring. On December 6, 2017 at 7:43:31 AM, Subhash Sriram (subhash.sri...@gmail.com) wrote: Hi Irtiza, Have you looked at jmxtrans? It has multiple output writers for the metrics and one of

Re: Kafka Monitoring

Hi Irtiza, Have you looked at jmxtrans? It has multiple output writers for the metrics and one of them is the KeyOutWriter which just writes to disk. https://github.com/jmxtrans/jmxtrans/wiki Hope that helps! Thanks, Subhash Sent from my iPhone > On Dec 6, 2017, at 5:36 AM, Irtiza Ali

Re: Kafka Monitoring

There are a couple of tools for this. 1. Linkedin Burrow - https://github.com/linkedin/Burrow 2. Yahoo Kafka Monitoring Tool - https://github.com/yahoo/kafka-manager 3. Uber Kafka Monitoring Tool - https://github.com/uber/chaperone Regards, Abhimanyu On Wed, Dec 6, 2017 at 3:14 PM,

Re: Kafka Monitoring..

Yeah…jmx is really the cheap/easy way to monitor kafka. You should also monitor OS metrics like pageScanD and pageScanK. Those were very helpful for us. -David On 11/9/17, 11:40 AM, "Andrew Otto" wrote: We’ve recently started using Prometheus, and use Prometheus JMX

Re: Kafka Monitoring..

We’ve recently started using Prometheus, and use Prometheus JMX Exporter to get Kafka metrics into prometheus. Here’s our JMX Exporter config:

Re: Kafka Monitoring..

JMX was pretty easy to setup for us. Look up the various jmx beans locally for your particular version of kafka (i.e. with jconsole..etc) https://github.com/jmxtrans/jmxtrans On 11/8/17, 7:10 PM, "chidigam ." wrote: Hi All, What is the simplest way of

Re: Kafka Monitoring..

Have you seen this thread ? http://search-hadoop.com/m/Kafka/uyzND1Q6wyNBj42g?subj=Kafka+Monitoring On Wed, Nov 8, 2017 at 5:10 PM, chidigam . wrote: > Hi All, > What is the simplest way of monitoring the metrics in kaka brokers? > Is there any opensource available? >

Re: Kafka Monitoring

Similar to other approaches, our service uses JMX via Jolokia and then we save the time-series data in Redis. Then we expose this in a number of ways including our dashboard, etc. We have found Redis to be quite good for a time-series backend for this purpose. This all gets setup automatically

Re: Kafka Monitoring

Not for monitoring Kafka. We pull the JMX metrics two ways - one is a container that wraps around the Kafka application and annotates the beans to be emitted to Kafka as metrics, which gets pulled into our autometrics/InGraphs system for graphing. But for alerting, we use an agent that polls the

Re: Kafka Monitoring

Using Elasticsearch, Logstash, and Kibana is a pretty popular pattern at LinkedIn. Also giving honorable mentions to Kafka Monitor and Kafka Manager since they hadn't been mentioned yet https://github.com/yahoo/kafka-manager https://github.com/linkedin/kafka-monitor Thanks, Andrew Hoblitzell

Re: Kafka Monitoring

You can look at enabling JMX on kafka ( https://stackoverflow.com/questions/36708384/enable-jmx-on-kafka-brokers) using JMXTrans (https://github.com/jmxtrans/jmxtrans) and a config ( https://github.com/wikimedia/puppet-kafka/blob/master/kafka-jmxtrans.json.md) to gather stats, and insert them into

Re: Kafka Monitoring

If you’re using confluent, you can use the control center. It’s not free however. From: Muhammad Arshad Reply-To: "users@kafka.apache.org" Date: Monday, June 19, 2017 at 5:52 PM To: "users@kafka.apache.org"

Re: Kafka monitoring

Hi, Maybe you are looking for something like https://github.com/uber/chaperone ? See also: * https://issues.apache.org/jira/browse/KAFKA-260 * https://sematext.com/blog/2016/06/07/kafka-consumer-lag-offsets-monitoring/ Otis -- Monitoring - Log Management - Alerting - Anomaly Detection Solr &

Re: Kafka monitoring

All consumers will "eventually" get the messages. What is it that you want to achieve by monitoring that? For the brokers you can monitor lag, for the producers you can have a counter that tracks messages sent and for consumers have one that tracks messages consumed. Although, just tracking lag

Re: Kafka Monitoring using JMX Mbeans

And if you're looking for some background on the various kafka metrics, we put a guide together: https://www.datadoghq.com/blog/monitoring-kafka-performance-metrics/ On Wed, May 4, 2016 at 3:37 AM, 马哲超 wrote: > We use jmxcmd as the command line tool. > > 2016-05-04

Re: Kafka Monitoring using JMX Mbeans

We use jmxcmd as the command line tool. 2016-05-04 10:47 GMT+08:00 Otis Gospodnetić : > Hi, > > On Mon, Apr 25, 2016 at 4:14 AM, Mudit Kumar wrote: > > > Hi, > > > > Have anyone setup any monitoring using Mbeans ?What kind of command line > >

Re: Kafka Monitoring using JMX Mbeans

Hi, On Mon, Apr 25, 2016 at 4:14 AM, Mudit Kumar wrote: > Hi, > > Have anyone setup any monitoring using Mbeans ?What kind of command line > tools been used? > See https://sematext.com/spm/integrations/kafka-monitoring/ We use it for monitoring Kafka, ZooKeeper,

RE: Kafka Monitoring using JMX Mbeans

: Re: Kafka Monitoring using JMX Mbeans We used a dockerized zabbix, one of the advantages of zabbix is that it has, jmx readout, creation of items, graphs, alerts in one product. Also how long to keep the history can be set for each item. The interface is not very intuitive though. On Mon, Apr

Re: Kafka Monitoring using JMX Mbeans

We used a dockerized zabbix, one of the advantages of zabbix is that it has, jmx readout, creation of items, graphs, alerts in one product. Also how long to keep the history can be set for each item. The interface is not very intuitive though. On Mon, Apr 25, 2016 at 10:14 AM Mudit Kumar

Re: Kafka Monitoring using JMX

Hi, Not sure what you are using to get the data out, but if you use SPM http://sematext.com/spm/integrations/kafka-monitoring.html you don't have to worry about any of that... assuming you use either 0.7.x or 0.8.2.x. Kafka metrics have changed drastically in the past and it looks like more

Re: Kafka Monitoring using JMX

Hi Naidu You'll need to escape the with a \ in the Mbean names. I've run across this too and it was al pain. It can get a bit tricky if you're doing it in code because you need to account for double escapes and so forth. This is a bug in the version of Metrics that Kafka is using. There is a

Re: Kafka Monitoring using JMX

You can use this https://github.com/Stackdriver/jmxtrans-config-stackdriver/blob/master/jmxtrans/stackdriver/json-specify-instance/kafka.json as an example of how Mbean are named and how is being escaped with \, and just use different output writer for any thing prior to 0.8.2.1 version. After

Re: kafka monitoring

Hi Sa Li, For the monitoring piece there is SPM - see *http://blog.sematext.com/2015/02/10/kafka-0-8-2-monitoring/ http://blog.sematext.com/2015/02/10/kafka-0-8-2-monitoring/*. Demo https://apps.sematext.com/demo (just select 'SPM.Prod.Kafka' system after you login as DEMO user) It will monitor

Re: kafka monitoring

Thank you very much for all the reply, I am able to connect jconsole now, by set env JMX_PORT= start server. However, when I connect it I found there is a port conflict with the kafka-run-class.sh, Error: Exception thrown by the agent : java.rmi.server.ExportException: Port already in use:

Re: kafka monitoring

In addition, I found all the attributes in jconsole MBeans are cool, but not being graphed, so again, if I want to view the real-time graphing, jmxtrans + graphite is the solution? thanks AL On Thu, Jan 8, 2015 at 1:35 PM, Sa Li sal...@gmail.com wrote: Thank you very much for all the reply, I

Re: kafka monitoring

Hi, you need to set jmx remote port. you can set this by executing below line in terminal and start server. (or) add below line to kafka-run-class.sh and start server. export JMX_PORT= (jmx remote port) and connect jconsole by giving brokerip: On Fri, Jan 9, 2015 at 12:38 AM,

RE: kafka monitoring

Is there a firewall between your DEV and PROD environments? If so you will need to open access on all ports, not just JMX port. It gets complicated with JMX. Gene Robichaux Manager, Database Operations Match.com 8300 Douglas Avenue I Suite 800 I Dallas, TX  75225 -Original Message-

Re: kafka monitoring

You need to export the JMX_PORT for kafka to use on startup before starting up /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop http://www.twitter.com/allthingshadoop

Re: kafka monitoring

Hi Sa Li, You need to set environment variable $JMX_PORT to enable jmx while starting kafka. See to kafka-run-class.sh on how it is used. Then you can connect to hostname:jmxport using Jconsole. Thanks, Raja. On Thu, Jan 8, 2015 at 2:08 PM, Sa Li sal...@gmail.com wrote: Hello, All I

Re: kafka monitoring system

Hi Sa Li, Have a look at SPM for monitoring Kafka: http://sematext.com/spm http://blog.sematext.com/2013/10/16/announcement-spm-performance-monitoring-for-kafka/ https://sematext.atlassian.net/wiki/display/PUBSPM/SPM+FAQ#SPMFAQ-KafkaMonitoring Otis -- Monitoring * Alerting * Anomaly Detection *

Re: kafka monitoring system

Hi Sa Li, You can try to use jmxtrans+opentsdb to monitor kafka. Jmxtrans is collecting data with JMX and sending to opentsdb. Opentsdb is graphing and alerting. YuanJia Li From: Sa Li Date: 2014-12-23 08:41 To: users Subject: kafka monitoring system Hi, all I am thinking to make a

Re: kafka monitoring system

Hi Sa Li, You can also try jmxtrans + graphite (for charting). jmxtrans has graphite output adapter out of the box. Regards, Raja. On Mon, Dec 22, 2014 at 10:39 PM, YuanJia Li yuanjia8...@163.com wrote: Hi Sa Li, You can try to use jmxtrans+opentsdb to monitor kafka. Jmxtrans is collecting

Re: kafka monitoring system

Try SemaText : a fully managed monitoring SaaS : http://sematext.com/ ... On Mon, Dec 22, 2014 at 7:46 PM, Rajasekar Elango rela...@salesforce.com wrote: Hi Sa Li, You can also try jmxtrans + graphite (for charting). jmxtrans has graphite output adapter out of the box. Regards, Raja. On

Re: kafka monitoring

This is per broker. What we do is use JMXtrans (https://github.com/jmxtrans/jmxtrans) to pull this data into statsd. To get all messages into the cluster at once, we sum over all the brokers in Graphite. On Thu, Oct 24, 2013 at 4:49 AM, Kane Kane kane.ist...@gmail.com wrote: I see this MBean:

Re: kafka monitoring

It is perBroker. It gives the count of messages that a broker has. As per my understanding to get it at cluster level,the messages count at each broker needs to be summed up. On Thu, Oct 24, 2013 at 2:19 PM, Kane Kane kane.ist...@gmail.com wrote: I see this MBean:

Re: Kafka Monitoring

Thanks a lot Jun. This is very helpful. Thanks, Raja. On Thu, Sep 5, 2013 at 1:12 AM, Jun Rao jun...@gmail.com wrote: Updated the doc at http://kafka.apache.org/documentation.html#monitoring Hopefully that answers your questions. Thanks, Jun On Tue, Sep 3, 2013 at 11:16 PM, Vadim

Re: Kafka Monitoring, 0.7 vs. 0.8 JMX

0.8 JMX is different from 0.7. In 0.8, all jmx beans are exposed through metrics. One can attach a metric reporter for monitoring. Thanks, Jun On Tue, May 7, 2013 at 1:45 PM, Otis Gospodnetic otis.gospodne...@gmail.com wrote: Hi, We're considering adding Kafka monitoring to SPM (see

Re: Kafka Monitoring, 0.7 vs. 0.8 JMX

See http://metrics.codahale.com/getting-started/#reporting-via-http Thanks, Jun On Wed, May 8, 2013 at 9:03 AM, Dennis Haller dhal...@talenttech.comwrote: What exactly is a metric reporter - something in log4j? Thanks Dennis On Wed, May 8, 2013 at 8:20 AM, Jun Rao jun...@gmail.com

Re: Kafka Monitoring, 0.7 vs. 0.8 JMX

  From: Jun Rao jun...@gmail.com To: users@kafka.apache.org users@kafka.apache.org Sent: Wednesday, May 8, 2013 11:20 AM Subject: Re: Kafka Monitoring, 0.7 vs. 0.8 JMX 0.8 JMX is different from 0.7. In 0.8, all jmx beans are exposed through metrics. One can attach

Re: Kafka Monitoring, 0.7 vs. 0.8 JMX

From the JmxReporter section of the metrics manual: Warning We don¹t recommend that you try to gather metrics from your production environment. JMX¹s RPC API is fragile and bonkers. For development purposes and browsing, though, it can be very useful. -Dragos On 5/8/13 2:10 PM, Otis

Re: Kafka Monitoring, 0.7 vs. 0.8 JMX

11:20 AM Subject: Re: Kafka Monitoring, 0.7 vs. 0.8 JMX 0.8 JMX is different from 0.7. In 0.8, all jmx beans are exposed through metrics. One can attach a metric reporter for monitoring. Thanks, Jun On Tue, May 7, 2013 at 1:45 PM, Otis Gospodnetic otis.gospodne...@gmail.com