Hi, Try to increase scrape_timeout in your prometheus.yml file.
*Julian Ade Putra* *(Mobile)* : +62*81932700018* *Aim for the stars, if you fail, at least you'll get the moon* On Thu, Jun 4, 2020 at 11:48 AM Azher Khan <[email protected]> wrote: > Hi There, > > I have configured JMX Exporter to scrape the kafka metrics as a java agent. > > I am able to see JMX Exporter fetch all the Kafka metrics only for a few > hours after which prometheus is unable to scrape the metrics and we get the > below message > > context deadline exceeded > > > Also when we run a curl for the from the Kafka Instance it takes forever > to pull the Kafka metrics. > > [user@kafkaX ~]$ curl http://XX.XX.XX.YYY:7070/metrics > % Total % Received % Xferd Average Speed Time Time Time > Current > Dload Upload Total Spent Left > Speed > 0 0 0 0 0 0 0 0 --:--:-- 0:40:01 --:--:-- > 0 > > > If i do a restart of the Kakfa service, I can see the metrics being able > to be pulled up again only for few hours and then we are back to the above > issue. > > > I have setup JMX exporter as a java agent, which is run along with Kafka > service > > cat /etc/systemd/system/kafka.service > > [Service] > Environment="KAFKA_OPTS=-Djava.security.auth.login.config=/opt/kafka/config/kafka_server_jaas.conf > -javaagent:/opt/jmx-exporter/jmx_prometheus_javaagent-0.12.0.jar=7070:/opt/jmx-exporter/kafka-2_0_0.yml" > > -- > You received this message because you are subscribed to the Google Groups > "Prometheus Users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/prometheus-users/f0d944dd-ff8d-4ec4-aff3-a16491e62a6b%40googlegroups.com > <https://groups.google.com/d/msgid/prometheus-users/f0d944dd-ff8d-4ec4-aff3-a16491e62a6b%40googlegroups.com?utm_medium=email&utm_source=footer> > . > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/CA%2BKLfv_0Nd08MPJooXzs1Mv3rrUxZaG0u_iQE6Q%2B29esAKLmmQ%40mail.gmail.com.
