Hi, I'm trying to access Kafka consumer metrics for a Spark streaming job and all I'm getting in JConsole is metrics for FetchRequestAndResponseMetrics. There's no other metrics (specially ConsumerLag MaxLag). Any thoughts?
Environment: - Kafka 0.10.0.2.5 - Spark 2.0.x.2.5 - Spark / kafka integration: Direct DStream using spark-streaming-kafka-0-8_2.11 - Hortonworks Data Platform 2.5 Thanks,