On Thu, 2021-08-19 at 11:37 +0200, Mattia Rizzolo wrote: > On Sat, Aug 14, 2021 at 11:20:47AM +0100, Adam D. Barratt wrote: > > ullmann.debian.org, the host for udd.d.o, filled its PostgreSQL > > partition overnight. DSA added another 5GB of space, but within a > > few hours around 3GB of that had already been used. > > Uh.
That's similar to the reaction I had. :-) > > Looking at the PostgreSQL logs, it appears that auto-cleanup of > > deleted > > records in some of the tables hasn't been working correctly for a > > while, which may be adding to the space usage. > > I see (also through the #debian-admin logs) that the space got under > control after a few runs of the autovacuum. It's certainly better, but still a fair way above where things were a week ago. Judging from https://munin.debian.org/debian.org/ullmann.debian.org/df.html , the partition was around 50% used for the past month or so (~25-30GB). Starting on Thursday night, there was a gradual but sustained increase in usage until it filled in the early hours of Saturday morning and the additional 5GB was added. We're now at ~65%, _after_ the rounds of cleanup (both manual and automatic). > > For the moment, I've disabled all of the "udd" user's crontab, to > > try > > and stop the rate of disk increase, and allow the auto-cleanup a > > chance > > to run and hopefully free some more space. > > I hadn't had a chance to investiage anything, so I'm not re-enabling > rudd. > But I've re-cronned some bits that I'm positive should not cause any > trouble. Thanks for the update. Regards, Adam