Hi, We have running prometheus instances in staging and production which have retention policy set to 100GB. we realised that it is more than the Disk(PVC) allocated for it.
How to delete data which is older than X days using command line or API since when we changed the retention period or size which is not deleting older chunks. Could you suggest a way to change the retention policy during runtime and make sure it enforces that rule for older data as well. Manual deletion of chunks is leading to WAL replay issues since they have those references. Any suggestions would really help Thanks, Rajesh -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/CAEyhnp%2BbSYd0Ny1aTQeUa_wEBv%3DsJJ-FkZZJsHpigaj%2BqVT%2BEw%40mail.gmail.com.
