On Tuesday, 1 September 2020 16:37:49 UTC+1, Peter S wrote: > > TSDB is fine. Sorry I wasn't being clear. Network traffic has become the > bottleneck. Even though the exporter and prometheus are collocated on the > same machine, scrapes have begun timing out more and more often. Next we > think we're increasing scraping interval (15s) to buy us some time. > > prometheus can run multiple scrapes in parallel - so the solution may be as simple as breaking the data into (say) 16 chunks, and having a job which scrapes 16 endpoints. There is usually some natural way in which the data breaks down into smaller groups which logically belong together.
Failing that, you could look at a "push" based approach rather than "pull" based, for example VictoriaMetrics supports this. -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/5a742780-296e-4f8f-927f-fee9973c3bffo%40googlegroups.com.
