Good to know, I was actually thinking about doing something like sharding by namespace. Do you know any kind of doc or guide on how do I do that? I'm running Prometheus Operator by the way and they're still implementing a sharding mechanism (https://github.com/coreos/prometheus-operator/pull/3241).
Em quarta-feira, 15 de julho de 2020 17:48:35 UTC-3, Stuart Clark escreveu: > > On 15/07/2020 21:40, Adso Castro wrote: > > Seconded. Clark's right. My current scenario is kinda the same (pod > > memory keep floating between 12~16GB) and I'm currently working on > > identifying why do I have so much targets (17k at the moment) and > > doing all the records I can to relieve stress from dashboards and rules. > > > 17k targets sounds a lot for a single Prometheus server. It is worth > looking at sharding into multiple Prometheus instances, by namespace or > function. > > > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/ded77cd9-ea06-4e5f-aa08-e39ad26a0099o%40googlegroups.com.
