Can you graph these two metrics, over the time range you are talking about?
prometheus_tsdb_head_series rate(prometheus_tsdb_head_samples_appended_total[1h]) On Thu, Jan 18, 2024 at 10:55 AM akbill <alan.k...@gmail.com> wrote: > Hi all, > > Our customer has been using the Prometheus for years. The configurations > have not been changed since day 1 and recently the file system disk usage > is over 90% and keeps increasing(not always right away but gradually). Is > there a reason why new chunk size increases over time? > > Although we have many application Metrics used to monitor our network > elements and performances, they are never changed or added. We are just > getting the same data KPIs over time. > > Files in July (Month; Day; Time; DirectoryName; Size in MB) > [image: image] > <https://private-user-images.githubusercontent.com/157004483/297689569-953a158d-6680-4dc2-b112-2c614ec0d565.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDU1NzE4ODUsIm5iZiI6MTcwNTU3MTU4NSwicGF0aCI6Ii8xNTcwMDQ0ODMvMjk3Njg5NTY5LTk1M2ExNThkLTY2ODAtNGRjMi1iMTEyLTJjNjE0ZWMwZDU2NS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwMTE4JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDExOFQwOTUzMDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT00OTgwMWU0YTNlYmIzYmVkOTFlMGFmZjA2ZjBhZjlmZDUxOGFjMjEyODAwZDEyOGEyMDk1MGE1ZTU3MzJmZThjJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.afV_zaB3pIRC0478LqFBsui3Dqj4x0uKtCHOg90NEeY> > > [image: image] > <https://private-user-images.githubusercontent.com/157004483/297690280-87766e1d-82a1-4cc5-a4dd-6471a0623832.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDU1NzE4ODUsIm5iZiI6MTcwNTU3MTU4NSwicGF0aCI6Ii8xNTcwMDQ0ODMvMjk3NjkwMjgwLTg3NzY2ZTFkLTgyYTEtNGNjNS1hNGRkLTY0NzFhMDYyMzgzMi5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwMTE4JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDExOFQwOTUzMDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT02NmMxNzg5NjBkMDMyYTg3ZDQ4ZTVhM2Q3YWQ2NzMzYzgxMDkyMWFhMTEwYmEwNDA2MzExNDk5YWExNDRiNGYyJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.9Mpv2oWqBVaaHSmGjD1YWBcKPpLzow1QHVmmpfWMTZk> > > Files in Dec. (Month; Day; Time; DirectoryName; Size in MB) > [image: image] > <https://private-user-images.githubusercontent.com/157004483/297684089-18fc0aa1-6b04-41c5-b745-0726e0cbc47d.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDU1NzE4ODUsIm5iZiI6MTcwNTU3MTU4NSwicGF0aCI6Ii8xNTcwMDQ0ODMvMjk3Njg0MDg5LTE4ZmMwYWExLTZiMDQtNDFjNS1iNzQ1LTA3MjZlMGNiYzQ3ZC5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwMTE4JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDExOFQwOTUzMDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT0xOGVlMTU5ODA1OWRjMGJmYjlmNzA2NTc5MDIyYmRjNGY4YTZiZDVkMmVjNzQ0MDM2MDNkOWRkNDc4MTk4MjdjJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.JNuPlHhzgjRSp5BcuGH3B1mnnddiCttVaWK9IDCv_4s> > > [image: image] > <https://private-user-images.githubusercontent.com/157004483/297689446-a592f2d4-bff1-442f-bfff-7f658a676f21.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDU1NzE4ODUsIm5iZiI6MTcwNTU3MTU4NSwicGF0aCI6Ii8xNTcwMDQ0ODMvMjk3Njg5NDQ2LWE1OTJmMmQ0LWJmZjEtNDQyZi1iZmZmLTdmNjU4YTY3NmYyMS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwMTE4JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDExOFQwOTUzMDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1hM2JhOWEzZWM5OGU0YzdjNDFmMGZlZTY5ZjE1Y2M5MzIzNWU3MGQ5MjlmMTExZjMzMDliYzlmZDQ3NzE1NWRhJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.DSCfPM5JFC91VDEihUlh4Fp65zKRWdyDgsJ54nv4stQ> > > [image: image] > <https://private-user-images.githubusercontent.com/157004483/297691964-17665c18-cdfc-4db2-af58-8f8bdb0efa64.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDU1NzE4ODUsIm5iZiI6MTcwNTU3MTU4NSwicGF0aCI6Ii8xNTcwMDQ0ODMvMjk3NjkxOTY0LTE3NjY1YzE4LWNkZmMtNGRiMi1hZjU4LThmOGJkYjBlZmE2NC5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwMTE4JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDExOFQwOTUzMDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT01YTlhZjk1NzYwY2ZkMTUyODA5M2M1NWI3M2RmYjYzNjZmOTUxYmJlZjIzYjkwNzY3MDEwOWNmNjE0ZTE4OGVhJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.NKwAQXMHIeRyAaAQMi1-QzGsYVsZwpkgnkZU-4ii0HQ> > > So, is there a reason why chunk size increases over time? Any way we can > sustain the file size w/o changing the retention time? > > -- > You received this message because you are subscribed to the Google Groups > "Prometheus Users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to prometheus-users+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/prometheus-users/feb914d1-fbd4-43c9-b062-d094d3278de8n%40googlegroups.com > <https://groups.google.com/d/msgid/prometheus-users/feb914d1-fbd4-43c9-b062-d094d3278de8n%40googlegroups.com?utm_medium=email&utm_source=footer> > . > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to prometheus-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/CABbyFmqvCqY8yW7uGr9_KjMpE9-osDvksDhA_fYDP7EzKH6JzQ%40mail.gmail.com.
