Thanks for the reply, Brian. I don't mind writing recording rules. My only worry is will I be able to use Grafana dashboards without any issues (especially when we access data over years) as InfluxDB stores it internally in a different format.
Our's is a small organization with a small network ( a few thousand devices to monitor) and a small team ( I am the only one working on this). Keeping disk space usage (relatively) small and fixed even after storing data for years is Thanos has a lot of overheads, it supports only object/cloud storage. I don't think it supports custom resolutions/retentions. The most important point is it's downsampling is intended for query performance optimization instead of reducing storage footprint. In fact, it increases it by 3 times. VictoriaMetrics can't be considered for production systems (yet) as it is basically a one-man show. Also similar to other tools like Thanos, cortex, m3, etc, it has installation and maintenance overheads. Are you suggesting that a sophisticated long term solution setup is better than using an external DB with remote read/write? On Thursday, May 7, 2020 at 8:20:58 PM UTC+5:30, Brian Candler wrote: > > If you are using prometheus' remote_write feature to write to influxdb, > then I would have thought you would be able to query it via prometheus' > remote_read via the same PromQL interface - that is, you should not have to > write influxQLqueries (I'm not sure why you've found this). But you may > end up having to write recording rules to do downsampling. > > I'd suggest you consider using something else for long term storage which > supports the same PromQL language natively, so your dashboards don't have > to change. Popular options include VictoriaMetrics (very easy to set up) > and Thanos (a bit more work). > > Thanos includes down-sampling as a built-in feature. With VictoriaMetrics > you can scrape the /federate endpoint as described here > <https://github.com/VictoriaMetrics/VictoriaMetrics/issues/36>. So > either way, you don't have to write recording rules. > > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/9fb7ba93-1bd4-4414-9b0f-62856efb0114%40googlegroups.com.
