Hello
Some of our prometheus instances running inside kubernetes are frequently
not sending metrics to the remote_write destination. the remote_write
destination is healthy and doesn't have problems from other clusters. The
container is stable and not crashing and neither we are seeing any errors.
please advise.
prometheus version: v2.32.0
RAM given to container: 12-48gb cpu: 2-12 cores. Kubernetes has close to
130+ nodes
remoteWrite:
- url: "https://<redacted>/api/v1/write"
queueConfig:
capacity: 10000
batchSendDeadline: 5s
minShards: 1
maxSamplesPerSend: 1000
maxShards: 10
basicAuth:
username:
name: kuberemotewrite
key: username
password:
name: kuberemotewrite
key: password
Please advise on how to debug further.
--
You received this message because you are subscribed to the Google Groups
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/prometheus-users/CAHcJzTnQj9UvrG9JTEQJVpDsNRBYiiRtqn5etUdA7DOrE18uvA%40mail.gmail.com.
