That's great, I didn't realize you could use remote write while still writing metrics locally. On another note, what kind of performance impact does the remote-write feature have when enabled? Is it something considerable or is it relatively minor, even with large instances scraping from many endpoints?
On Tuesday, October 20, 2020 at 10:38:39 AM UTC-4 [email protected] wrote: > Remote Write does this. The data from the WAL is directly streamed to the > remote endpoint in addition to writing to the local TSDB. > > > https://prometheus.io/docs/prometheus/latest/configuration/configuration/#remote_write > > On Tue, Oct 20, 2020 at 4:35 PM Al <[email protected]> wrote: > >> I have a use-case where I would like to have the ability for a Prometheus >> write metrics locally while being able to also stream the same metrics to >> another type of external database. The goal is to ship these metrics as >> they're scraped so queries on the remote database can be executed with the >> most up to date data as something like receiving a compacted/completed 2h >> block wouldn't be sufficient for our needs. It would be great if we could >> use both local storage and remote write a the same time although from what >> I can see that's not possible. I'm sure there's a good reason for this >> although it would be great if someone could share some lower level >> knowledge as to why this isn't possible? >> >> So far I can't seem to find anything out-of-the-box to allow us to ship >> incoming metrics remotely as they come in but I suspect we could likely >> accomplish this by reading the WAL with the wal package? I'm not >> completely familiar with all the internals of the WAL and the Prometheus >> storage so I'm trying to figure how I could accomplish this efficiently in >> a reasonable amount of time. >> >> I appreciate any help. >> >> >> Thanks >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Prometheus Users" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/prometheus-users/95ab00ca-cee9-43f8-9a44-265dc4704586n%40googlegroups.com >> >> <https://groups.google.com/d/msgid/prometheus-users/95ab00ca-cee9-43f8-9a44-265dc4704586n%40googlegroups.com?utm_medium=email&utm_source=footer> >> . >> > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/6b2759bf-3b35-4fde-9c8e-72d0bf78dd43n%40googlegroups.com.
