Hi All, We are running 2 prometheus server for HA. In both the servers prometheus suddenly started to consume a lot of disk space. (~ 5 GB per minute). And stops when disks is full because of no space. We have 15d retention. In one server I have deleted the whole data under /var/lib/promtheus/data and restarted the prometheus. Then the disk consumption became normal. but in the other server the case is same. Please help in understanding this.
Regards, Saivignesh -- IMPORTANT NOTICE: This e-mail, including any attachments, may contain confidential information and is intended only for the addressee(s) named above. If you are not the intended recipient(s), you should not disseminate, distribute, or copy this e-mail. Please notify the sender by reply e-mail immediately if you have received this e-mail in error and permanently delete all copies of the original message from your system. E-mail transmission cannot be guaranteed to be secure as it could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. Company accepts no liability for any damage or loss of confidential information caused by this email or due to any virus transmitted by this email or otherwise. -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/5a66226a-0938-40a5-9bc7-22b32373c151n%40googlegroups.com.

