Re: Kafka Monitoring

2016-11-08 Thread vinay patil
gt;> I am monitoring Kafka using KafkaManager for checking offset lag and >>>>>>> other Kafka metrics, however I am not able to see the consumers when I >>>>>>> use >>>>>>> FlinkKafkaConsumer , for console-consumer it shows them i

Re: Kafka Monitoring

2016-11-08 Thread Daniel Santos
NAML <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeName

Re: Kafka Monitoring

2016-11-08 Thread vinay patil
d >>>>> by Flink on KafkaManger, one has to set it up with zookeeper. On 0.9 it >>>>> will only serve as a view of progress. >>>>> >>>>> Basically what's mandatory on 0.8 is optional on 0.9, and for viewing >>>>> purposes o

Re: Kafka Monitoring

2016-11-08 Thread Daniel Santos
bble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> --

Re: Kafka Monitoring

2016-11-08 Thread vinay patil
>> I am monitoring Kafka using KafkaManager for checking offset lag and >>>>> other Kafka metrics, however I am not able to see the consumers when I >>>>> use >>>>> FlinkKafkaConsumer , for console-consumer it shows them in the Consumers >>>>&

Re: Kafka Monitoring

2016-11-08 Thread Daniel Santos
ailing List archive., click here. NAML <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespa

Re: Kafka Monitoring

2016-11-08 Thread vinay patil
ers for the kafka consumer while running >>>> the application. >>>> >>>> Has anyone faced this issue ? >>>> I am using Kafka 0.9.0.1 >>>> >>>> Regards, >>>> Vinay Patil >>>> >>> >>>

Re: Kafka Monitoring

2016-11-08 Thread Daniel Santos
cNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> View this message in context: Re: Kafka Monitoring

Re: Kafka Monitoring

2016-11-08 Thread vinay patil
archive., email >> > target="_top" rel="nofollow" link="external" class="">[hidden email] >> To unsubscribe from Apache Flink User Mailing List archive., click here. >> NAML >> <http://apache-flink-user-mailing-list-archive.23

Re: Kafka Monitoring

2016-11-07 Thread vinay patil
Hi Limbo, I can see the lag by using that URL, but the Lag there is not showing updated results, it does not change, also if you try to to change the consumer group value it will still show you the same value instead of saying consumer group does not exist or similar kind of error :) According to

Re: Kafka Monitoring

2016-11-07 Thread vinay patil
Hi Daniel, My Zookeeper instances are running and I have provided the hosts in Kafka manager config files. Can you please elaborate how do I set it up with Zookeeper ? I have also tried setting offset.storage as Zookeeper , still I don't see the consumer getting listed in KafkaManager, also the k

Re: Kafka Monitoring

2016-11-07 Thread limbo
Hi, I have the same problem, I think the reason is that the consumer of flink use the low level API, and when I type the group name in manager url I can get the lag of the flink consumer, like this: http://your_manager_url/clusters//consumers//topic//type/ZK

Re: Kafka Monitoring

2016-11-07 Thread Daniel Santos
Hello, I have been using that setup. >From my understanding, if one desires to see the offset being consumed by >Flink on KafkaManger, one has to set it up with zookeeper. On 0.9 it will only >serve as a view of progress. Basically what's mandatory on 0.8 is optional on 0.9, and for viewing