Prometheus 2.15 is rather old, have you considered upgrading to the latest version? There have been many fixes around the WAL and crash handling since then.
/MR On Thu, Nov 26, 2020 at 2:23 AM [email protected] <[email protected]> wrote: > Prometheus version: v2.15.2 > Problem：the size of prometheus's wal is 42G,which will lead to OOM,and > the prometheus can't restart,unless to remove the wal manually. > > [image: 1.jpg] > My question is: > > 1、Whether the "Unknown series references" error is the reason of causing > the wal too big? > 1、Under what circumstances will "Unknown series references" happen? > 2、What is the reason that lead to "Unknown series references" ? and > how can I avoid it? > > Many thanks! > > -- > You received this message because you are subscribed to the Google Groups > "Prometheus Users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/prometheus-users/32fdd8b0-9bef-4899-abc3-d8c0006ef1fen%40googlegroups.com > <https://groups.google.com/d/msgid/prometheus-users/32fdd8b0-9bef-4899-abc3-d8c0006ef1fen%40googlegroups.com?utm_medium=email&utm_source=footer> > . > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/CAMV%3D_gY72%3D5CD%3DFcgNdt46-dCRDqA0VN2NDH75qvMiDY0XGKDA%40mail.gmail.com.
