Please advise what all i can do to prevent/investigate remote writes from getting stopped.
On Fri, 21 Jan 2022 at 22:59, Ramachandra Bhaskar Ayalavarapu < [email protected]> wrote: > we are not using as agent > > On Fri, 21 Jan 2022 at 17:49, Julien Pivotto <[email protected]> > wrote: > >> Hello, >> >> Are you using the "Prometheus agent" feature? What are the command line >> flags for Prometheus? >> >> Regards, >> >> On 21 Jan 17:44, Ramachandra Bhaskar Ayalavarapu wrote: >> > Hello >> > >> > Some of our prometheus instances running inside kubernetes are >> frequently >> > not sending metrics to the remote_write destination. the remote_write >> > destination is healthy and doesn't have problems from other clusters. >> The >> > container is stable and not crashing and neither we are seeing any >> errors. >> > please advise. >> > >> > prometheus version: v2.32.0 >> > >> > RAM given to container: 12-48gb cpu: 2-12 cores. Kubernetes has close to >> > 130+ nodes >> > >> > remoteWrite: >> > - url: "https://<redacted>/api/v1/write" >> > queueConfig: >> > capacity: 10000 >> > batchSendDeadline: 5s >> > minShards: 1 >> > maxSamplesPerSend: 1000 >> > maxShards: 10 >> > basicAuth: >> > username: >> > name: kuberemotewrite >> > key: username >> > password: >> > name: kuberemotewrite >> > key: password >> > >> > Please advise on how to debug further. >> > >> > -- >> > You received this message because you are subscribed to the Google >> Groups "Prometheus Users" group. >> > To unsubscribe from this group and stop receiving emails from it, send >> an email to [email protected]. >> > To view this discussion on the web visit >> https://groups.google.com/d/msgid/prometheus-users/CAHcJzTnQj9UvrG9JTEQJVpDsNRBYiiRtqn5etUdA7DOrE18uvA%40mail.gmail.com >> . >> >> -- >> Julien Pivotto >> @roidelapluie >> > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/CAHcJzTnaUUgr7g9zZU%3DXSxOD592W-3r5yLf_nLVuNoeJPUesRw%40mail.gmail.com.
