Re: flink kafka consumer lag

2017-07-09 Thread Kien Truong
Hi, You should setup a metric reporter to collect Flink's metrics. https://ci.apache.org/projects/flink/flink-docs-release-1.2/monitoring/metrics.html There's a lot of useful information in the metrics, including the consumer lags. I'm using the Graphite reporter with InfluxDB for storage +

flink kafka consumer lag

2017-07-08 Thread Karthik Deivasigamani
Hi, I'm using Flink 1.2.1 and FlinkKafkaConsumer09 to read data from Kafka Server (0.10.1.0). My consumer is able to read and everything works fine. But when I use the kafka_consumer_groups.sh command to find the lag metrics it does not return the lag. Upon reading online I found that Flink Kafk