Re: Java API to read metrics via JMX

2018-08-08 Thread Raghav
Thanks Boris. Is there a sample implementation in Java ? thanks. R On Wed, Aug 8, 2018 at 7:10 PM, Boris Lublinsky < boris.lublin...@lightbend.com> wrote: > Its actually quite simple, unfortunately you have to read, and then write > to TSDB. > Enclosed is an example doing this and dumping to

Re: Java API to read metrics via JMX

2018-08-08 Thread Boris Lublinsky
Yea, this is just a simple snippet of how to do this.Boker with JMX is how to get broker from zk BrokerWithJMX.scala Description: Binary data Boris LublinskyFDP Architectboris.lublin...@lightbend.comhttps://www.lightbend.com/ On Aug 8, 2018, at 9:18 PM, Ted Yu

Re: Java API to read metrics via JMX

2018-08-08 Thread Ted Yu
Boris: BrokerWithJMX is referenced but I didn't find the class source after a brief search. FYI On Wed, Aug 8, 2018 at 7:10 PM Boris Lublinsky < boris.lublin...@lightbend.com> wrote: > Its actually quite simple, unfortunately you have to read, and then write > to TSDB. > Enclosed is an example

Re: Java API to read metrics via JMX

2018-08-08 Thread Boris Lublinsky
Its actually quite simple, unfortunately you have to read, and then write to TSDB.Enclosed is an example doing this and dumping to InfluxDB JMXCollector.scala Description: Binary data Boris LublinskyFDP Architectboris.lublin...@lightbend.comhttps://www.lightbend.com/ On Aug 8, 2018, at 8:46

Java API to read metrics via JMX

2018-08-08 Thread Raghav
Hi Is there any Java API available so that I can enable our Kafka cluster's JMX port, and consume metrics via JMX api, and dump to a time series database. I checked out jmxtrans, but currently it does not dump to TSDB (time series database). Thanks. R

Looking for help with a question on the consumer API

2018-08-08 Thread Moiz Raja (moraja)
Hi All, I have an issue with the consumer getting kicked out of the group possibly due to other issues going on in the system. The issue is detailed here https://stackoverflow.com/questions/51754794/how-to-reinstate-a-kafka-consumer-which-has-been-kicked-out-of-the-group Any help with this

Re: python-kafka does not work

2018-08-08 Thread Oras Al-Kubaisi
Do you use auto commit or you commit messages directly? Do you have another node in the same consumer group? On Wed, 8 Aug 2018 at 16:18, 随风 <401580...@qq.com> wrote: > hi,i use python-kafka to consumer message,but a few days later,it is does > not work ,it can not to poll message.i can not deal

Re: Error reading field 'version' when execute kafka-consumer-groups.sh

2018-08-08 Thread Ted Yu
For the last error, please see KAFKA-6868 On Wed, Aug 8, 2018 at 8:18 AM 刘鹏 wrote: > hi, > I get an error when I run kafka-consumer-groups.sh. > > > firstly,I run: > ./kafka-consumer-groups.sh --command-config consumer.properties > --bootstrap-server ip:port --list > > the

python-kafka does not work

2018-08-08 Thread ????
hi??i use python-kafka to consumer message??but a few days later??it is does not work ??it can not to poll message.i can not deal with it util restart client can you tell me this reason and method iPhone

Error reading field 'version' when execute kafka-consumer-groups.sh

2018-08-08 Thread 刘鹏
hi, I get an error when I run kafka-consumer-groups.sh. firstly,I run: ./kafka-consumer-groups.sh --command-config consumer.properties --bootstrap-server ip:port --list the result is: Note: This will not show information about old Zookeeper-based consumers. mygroup

Re: Kafka flow

2018-08-08 Thread Ted Yu
Have you looked at http://kafka.apache.org/documentation/ ? Chapters 4 and 5. FYI On Wed, Aug 8, 2018 at 1:46 AM darekAsz wrote: > Hi, > I need informations about workflow in kafka, I want to know what is going > on when producer send message, as much details as possible about >

Include Keys in FileStreamSink connector

2018-08-08 Thread David Espinosa
Hi all, I'm trying to backup the whole content of an avro topic into a file, and later restoring the Kafka topic from the file using Kafka Connect. I'm using avroconverters from both key and value, but key is not included in the dump file. Somebody knows how to include keys using Kafka Connect?

Re: Kafka on Windows

2018-08-08 Thread M. Manna
Using docker is probably the best option. The one thing I cannot confirm (and I haven't tried yet) is how the volumes will behave when you are transferring the topic log offsets to your windows drive. Hopefully, this will be fine but do let us know if someone has tried. Thanks, On 7 August

Kafka flow

2018-08-08 Thread darekAsz
Hi, I need informations about workflow in kafka, I want to know what is going on when producer send message, as much details as possible about requests-responses. Can anyone tell me when I can find this? Best regards