Hi all!
I use Prometheus to scrape the machine. There are about 500 service
machines, and each machine generates about 3500 sample data. When I use the
federate interface, I find Prometheus adds instance and job labels to data
from different machines. So there are 500 * 3500 = 1750000 sample data.
This results in very large memory for queries and writes. I don't care
about the data on the single machine dimension. Is there any way to remove
the instance label and aggregate data before data writing?
for example:
http_requests_total{methed="GET", code="200", instance="ip1:port", job=
"job1"} 100
http_requests_total{methed="GET", code="200", instance="ip2:port", job=
"job1"} 50
merge to:
http_requests_total{methed="GET", code="200", instance="", job="job1"} 150
Has anyone ever encountered the same problem, how did you solve it or any
other solution?
Thx!
--
You received this message because you are subscribed to the Google Groups
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/prometheus-users/9429e324-548b-40af-96c1-9a45d571e3b5%40googlegroups.com.