Mark On Tuesday, August 4, 2020 at 6:24:38 PM UTC+8, Vinod M V wrote: > > Hi All , > > I am facing Memory usage with Prometheus service and Maintaining > 30 days of data from Node exporter, Process exporter and JMX exporter for > 95 servers in Prometheus Database. > > Grafana and Prometheus are running on the same node. When loading > node_exporter or JVM Grafana dashboards, memory usage will shoot up to more > than 10 GB and sometime usage will hit max and Prometheus will be > restarted. Moreover memory usage will not reduce even after closing > JVM/Node exporter Grafana Dashboards. > > Always need to restart Prometheus to release the memory. I am > expecting 300 more servers to this configuration in future. > > Can someone please suggest a solution for this memory issue ( or > suggest a best database for save the metrics) and suggest a open source > solution for High availability > > Monitoring Server config: ( VM server): > Server Arch: x86_64 > CPU core count: 4 > Memory: 16 GB > Prometheus Version: 2.20.0 > Prom Config Flags: --log.level=error --query.max-concurrency=10 > --query.max-samples=10000000 --storage.tsdb.retention > 30d --web.route-prefix=/ > > Node_exporter Version on node: 0.16.0 > Process_exporter Version on node: 0.5.0 > Grafana Version: 6.4.4 > > *Thanks and Regards,* > *Vinod M V* >
-- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/b956c05b-9d1c-491d-a33b-805643af9644o%40googlegroups.com.

