Here is a link to the "snapshot" of the dashboard. https://snapshot.raintank.io/dashboard/snapshot/crxdjU7fhzAhl0x0KWiH1ZHGZXKyhqmF On Friday, December 18, 2020 at 6:09:13 PM UTC-6 Julien Pivotto wrote:
> On 18 Dec 16:03, Brett Larson wrote: > > Hello, > > I am using a Prometheus 2.21 server and I am seeing that the memory is > > growing at an untenable rate. I will start the pod at 4GB and eventually > it > > will move to 10GB after a few days and go into a crashloop back off > state. > > > > The pod is configured to only keep around 8 hours of data, and this data > is > > stored to empyDir, not a persistent file system. We are doing remote > write > > to postgres for only about 4 metrics. > > > > We do have some no-nos (high cardinality labels & pod names) but > > unfortunately these are needed. > > > > I don't understand why after a retention of 8 hours we would still cause > > memory like this to grow and i'm looking for some guidance on how I can > > troubleshoot this. > > > > Please let me know, > > Thank you! > > Can you share screenshots of the > https://grafana.com/grafana/dashboards/12054 dashboard ? > > -- > Julien Pivotto > @roidelapluie > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/98ef5eea-5552-42c8-9798-8c005cd01eaen%40googlegroups.com.

