Hi All ,
I am facing Memory usage with Prometheus service and Maintaining
30 days of data from Node exporter, Process exporter and JMX exporter for
95 servers in Prometheus Database.
Grafana and Prometheus are running on the same node. When loading
node_exporter or JVM Grafana dashboards, memory usage will shoot up to more
than 10 GB and sometime usage will hit max and Prometheus will be
restarted. Moreover memory usage will not reduce even after closing
JVM/Node exporter Grafana Dashboards.
Always need to restart Prometheus to release the memory. I am
expecting 300 more servers to this configuration in future.
Can someone please suggest a solution for this memory issue ( or
suggest a best database for save the metrics) and suggest a open source
solution for High availability
Monitoring Server config: ( VM server):
Server Arch: x86_64
CPU core count: 4
Memory: 16 GB
Prometheus Version: 2.20.0
Prom Config Flags: --log.level=error --query.max-concurrency=10
--query.max-samples=10000000 --storage.tsdb.retention
30d --web.route-prefix=/
Node_exporter Version on node: 0.16.0
Process_exporter Version on node: 0.5.0
Grafana Version: 6.4.4
*Thanks and Regards,*
*Vinod M V*
--
You received this message because you are subscribed to the Google Groups
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/prometheus-users/4aea5f48-60d8-4b5d-bee7-899e3544ed9bo%40googlegroups.com.
