This sounds like an issue with cAdvisor, I recommend opening an issue there.
On Thu, May 28, 2020 at 7:38 AM Isabel Noronha <[email protected]> wrote: > The infra is going to be with 20 servers with each server running >2K > containers > So I see CPU surge in case od cAdvisor when it exposes metrics in > Prometheus format and compresses it. > I cannot afford to crash my infra nor lose scraped metrics. > > On Wednesday, May 27, 2020 at 5:43:05 PM UTC+5:30, Isabel Noronha wrote: >> >> Hello, >> >> I see very high CPU consumption (beyond 700%) by cAdvisor. >> Attached is a png file that clearly shows that it's a *problem with >> compressing and exposing metrics in Prometheus format.* >> >> Prometheus v2.18 >> cAdvisor v0.35 >> No.of containers 2K. >> >> Can I store scraped metrics in an external DB like VictoriaMetrics and >> query using promql and grafana to view dashboards? >> >> Scenario: >> target1,target 2 >> Both targets have cAdvisor running. >> I want to scrape all the cAdvisor metrics and send them to TSDB (say >> Victoriametrics). >> Then use this DB to run promql queries from http://localhost:9090 >> >> Is this possible? >> >> Thanks, >> Regards, >> Isabel >> >> >> >> >> >> -- > You received this message because you are subscribed to the Google Groups > "Prometheus Users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/prometheus-users/a8bdf34a-cd0c-449b-8207-8063d1b72a80%40googlegroups.com > <https://groups.google.com/d/msgid/prometheus-users/a8bdf34a-cd0c-449b-8207-8063d1b72a80%40googlegroups.com?utm_medium=email&utm_source=footer> > . > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/CABbyFmpVygc-k1NG_fRFybEqgnM8Z4-xAdtd7ETtbbJxz985fg%40mail.gmail.com.
