Re: Querying consumer groups programmatically (from Golang)

We are also collecting consumer group metrics from Kafka - we didn't want to add extra unnecessary dependencies (such as burrow, which is also overkill for what we need), so we just run a script every minute on the brokers that parses the output of kafka-consumer-groups.sh and uploads it to an

Re: Querying consumer groups programmatically (from Golang)

Hello, Could you tell me if burrow or remora is compatible with ssl kafka clusters ? Gabriel. 2017-08-16 15:39 GMT+02:00 Gabriel Machado : > Hi Jens and Ian, > > Very usefuls projects :). > What's the difference between the 2 softwares ? > Do they support kafka ssl

Re: Querying consumer groups programmatically (from Golang)

Hi Jens and Ian, Very usefuls projects :). What's the difference between the 2 softwares ? Do they support kafka ssl clusters ? Thanks, Gabriel. 2017-08-13 3:29 GMT+02:00 Ian Duffy : > Hi Jens, > > We did something similar to this at Zalando. > >

Re: Querying consumer groups programmatically (from Golang)

Hi Jens, We did something similar to this at Zalando. https://github.com/zalando-incubator/remora It effectively supplies the kafka consumer group supply command as a http endpoint. On 12 August 2017 at 16:42, Subhash Sriram wrote: > Hi Jens, > > Have you looked at

Re: Querying consumer groups programmatically (from Golang)

Hi Jens, Have you looked at Burrow? https://github.com/linkedin/Burrow/blob/master/README.md Thanks, Subhash Sent from my iPhone > On Aug 12, 2017, at 8:55 AM, Jens Rantil wrote: > > Hi, > > I am one of the maintainers of prometheus-kafka-consumer-group-exporter[1],

Querying consumer groups programmatically (from Golang)

Hi, I am one of the maintainers of prometheus-kafka-consumer-group-exporter[1], which exports consumer group offsets and lag to Prometheus. The way we currently scrape this information is by periodically executing `kafka-consumer-groups.sh --describe` for each group and parse the output.