Yes, both the Prometheus instances are talking to the same BBE indeed. Infact both have the exact same configuration file and are scraping the exact same targets.
Here is the graph for the modified query. Fails visible for 2.20.1 but none for 2.12.0. 2.12.0 [image: image.png] 2.20.1 [image: image.png] Why is there a difference in the instances when they are talking to the same BBE. Also, what do you think about the evaluation_time and scrape_interval combination? Should I change something to solve this? On Saturday, November 7, 2020 at 3:31:53 PM UTC+5:30 [email protected] wrote: > You won't necessarily see all the failures on that graph. With a 5-second > scrape interval, a 6 hour window contains 4,320 scrapes - more than the > number of points fetched. Many of the points will be skipped over. > > I suggest you graph this instead: > > min_over_time(probe_success[5m]) > > (Otherwise, you'd need to zoom in much closer and then scroll left and > right) > > Once you've sorted that, it becomes easier to compare the two prometheus > servers. > > Note: are these two servers talking to the *same* blackbox exporter - i.e. > making remote connections over the network? Or does each prometheus server > have its own blackbox exporter? If they are separate blackbox exporter > instances then there's likely some difference between the two, or the > environment in which they are running. > On Sat, Nov 7, 2020 at 3:32 PM Brian Candler <[email protected]> wrote: > You won't necessarily see all the failures on that graph. With a 5-second > scrape interval, a 6 hour window contains 4,320 scrapes - more than the > number of points fetched. Many of the points will be skipped over. > > I suggest you graph this instead: > > min_over_time(probe_success[5m]) > > (Otherwise, you'd need to zoom in much closer and then scroll left and > right) > > Once you've sorted that, it becomes easier to compare the two prometheus > servers. > > Note: are these two servers talking to the *same* blackbox exporter - i.e. > making remote connections over the network? Or does each prometheus server > have its own blackbox exporter? If they are separate blackbox exporter > instances then there's likely some difference between the two, or the > environment in which they are running. > > -- > You received this message because you are subscribed to a topic in the > Google Groups "Prometheus Users" group. > To unsubscribe from this topic, visit > https://groups.google.com/d/topic/prometheus-users/oKAPrUljkU0/unsubscribe > . > To unsubscribe from this group and all its topics, send an email to > [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/prometheus-users/32600890-13b1-45f5-a8cf-d3ef931065c0o%40googlegroups.com > <https://groups.google.com/d/msgid/prometheus-users/32600890-13b1-45f5-a8cf-d3ef931065c0o%40googlegroups.com?utm_medium=email&utm_source=footer> > . > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/CAFGi5vApZnQ4a5eCmJm5WT8%3DRXSwf_POvTzOXmFfUuMHYgJUAA%40mail.gmail.com.
