Re: kafka per topic metrics

2020-07-16 Thread Pushkar Deole
messages consumed from a certain topic. I am > > > mainly > > > >> interested in these metrics. > > > >> > > > >> I read in kafka docs that they are present at producer/consumer, > > > however I > > > >> am not sure how to fetc

Re: kafka per topic metrics

2020-07-15 Thread Liam Clarke-Hutchinson
; however I > > >> am not sure how to fetch them from consumer/producer. > > >> > > >> On Wed, Jul 15, 2020 at 8:32 PM Claudia Kesslau > > >> wrote: > > >> > > >> > Hi, > > >> > > > >>

Re: kafka per topic metrics

2020-07-15 Thread Pushkar Deole
au > >> wrote: > >> > >> > Hi, > >> > > >> > I use https://github.com/prometheus/jmx_exporter for collecting > broker > >> > metrics and integrating them into prometheus. > >> > > >> > Hope this helps. >

Re: kafka per topic metrics

2020-07-15 Thread Liam Clarke-Hutchinson
laudia Kesslau >> wrote: >> >> > Hi, >> > >> > I use https://github.com/prometheus/jmx_exporter for collecting broker >> > metrics and integrating them into prometheus. >> > >> > Hope this helps. >> > Greetings, >> >

Re: kafka per topic metrics

2020-07-15 Thread Liam Clarke-Hutchinson
om/prometheus/jmx_exporter for collecting broker > > metrics and integrating them into prometheus. > > > > Hope this helps. > > Greetings, > > Claudia > > > > -Ursprüngliche Nachricht- > > Von: Pushkar Deole > > Gesendet: Mittwoch, 15. Juli

Re: kafka per topic metrics

2020-07-15 Thread Pushkar Deole
grating them into prometheus. > > Hope this helps. > Greetings, > Claudia > > -Ursprüngliche Nachricht- > Von: Pushkar Deole > Gesendet: Mittwoch, 15. Juli 2020 09:07 > An: users@kafka.apache.org > Betreff: Re: kafka per topic metrics > > We are using pro

AW: kafka per topic metrics

2020-07-15 Thread Claudia Kesslau
: kafka per topic metrics We are using prometheus as metrics collection and storage system and Grafana for displaying those metrics, so integration with them is required On Wed, Jul 15, 2020 at 11:11 AM rohit garg wrote: > You can try using kafka manager and check it will fullfill m

Re: kafka per topic metrics

2020-07-15 Thread Pushkar Deole
We are using prometheus as metrics collection and storage system and Grafana for displaying those metrics, so integration with them is required On Wed, Jul 15, 2020 at 11:11 AM rohit garg wrote: > You can try using kafka manager and check it will fullfill most of > requirement of yours. > >

Re: kafka per topic metrics

2020-07-14 Thread rohit garg
You can try using kafka manager and check it will fullfill most of requirement of yours. Thanks and Regards, Rohit On Wed, Jul 15, 2020, 10:33 Pushkar Deole wrote: > Hi All, > > Any inputs as to how the kafka consumer and producer metrics can be hooked > up to a monitoring system such as

Re: kafka per topic metrics

2020-07-14 Thread Pushkar Deole
Hi All, Any inputs as to how the kafka consumer and producer metrics can be hooked up to a monitoring system such as prometheus ? On Tue, Jul 14, 2020 at 4:22 PM Pushkar Deole wrote: > i did find these metrics from confluent docs: however how can i get this > metric ? is it available at kafka

Re: kafka per topic metrics

2020-07-14 Thread Pushkar Deole
i did find these metrics from confluent docs: however how can i get this metric ? is it available at kafka broker? Per-Topic Metrics MBean: kafka.producer:type=producer-topic-metrics,client-id=([-.w]+),topic=([-.w]+) record-send-rateThe average number of records sent per second for a topic. On

kafka per topic metrics

2020-07-14 Thread Pushkar Deole
Hi All, Need some help on kafka metrics, i am interested in certain metrics e.g. i need to know the number of records published on a particular topic and number of records consumed from that topic by a specific consumer group, i would need a total of these 2 and also average per second for them.