[Bug 1895943] Re: zsys automatic snapshots just eat up all drive space and never get cleaned up
I can report the same just after a few month of working with ZFS. I now get this error message I try to do an apt upgrade: ERROR couldn't save system state: Minimum free space to take a snapshot and preserve ZFS performance is 20%. I am using ZFS on Ubuntu 21.10 on a private notebook that I use _occasionally_ meaning maximum once per week without a lot of data intensive stuff going there. I agree with other comments that this ZFS default behaviour gives a bad impression on an otherwise great filesystem. The idea of snapshots is a good one but should have much saner defaults that also take into account on how much space they take. With that experience I would never enable ZFS with Ubuntu on a production relevant box. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1895943 Title: zsys automatic snapshots just eat up all drive space and never get cleaned up To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/zsys/+bug/1895943/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1895943] Re: zsys automatic snapshots just eat up all drive space and never get cleaned up
Hello, same situation for me... Up to the point I needed to boot in recovery mode to delete some states (it was so full I couldn't boot in normal mode). -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1895943 Title: zsys automatic snapshots just eat up all drive space and never get cleaned up To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/zsys/+bug/1895943/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1895943] Re: zsys automatic snapshots just eat up all drive space and never get cleaned up
Identical experience to Tessa. Normal desktop usage with regular updates, within exactly 5 months I exhausted the storage capacity of my 2 TB drive (!!). Something is wrong here, older snapshots must have a sane rotation default. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1895943 Title: zsys automatic snapshots just eat up all drive space and never get cleaned up To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/zsys/+bug/1895943/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1895943] Re: zsys automatic snapshots just eat up all drive space and never get cleaned up
Status changed to 'Confirmed' because the bug affects multiple users. ** Changed in: zsys (Ubuntu) Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1895943 Title: zsys automatic snapshots just eat up all drive space and never get cleaned up To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/zsys/+bug/1895943/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1895943] Re: zsys automatic snapshots just eat up all drive space and never get cleaned up
s/minutes/months/, typo (I apologize for the confusion!) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1895943 Title: zsys automatic snapshots just eat up all drive space and never get cleaned up To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/zsys/+bug/1895943/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1895943] Re: zsys automatic snapshots just eat up all drive space and never get cleaned up
Identical experience to Tessa. Normal desktop usage with regular updates, within exactly 5 minutes I exhausted the storage capacity of my 2 TB drive (!!). Something is wrong here, older snapshots must have a sane rotation default. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1895943 Title: zsys automatic snapshots just eat up all drive space and never get cleaned up To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/zsys/+bug/1895943/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1895943] Re: zsys automatic snapshots just eat up all drive space and never get cleaned up
as well, I'd highly recommend a command for zsysctl to purge up to X number of old states, so that an admin can manually get disk usage under control if necessary. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1895943 Title: zsys automatic snapshots just eat up all drive space and never get cleaned up To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/zsys/+bug/1895943/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1895943] Re: zsys automatic snapshots just eat up all drive space and never get cleaned up
Alright, I've read through some of these design docs. it's unfortunate they're buried in blog posts and not just laid out on an ubuntu site about zsys and zfs usage on Ubuntu, but at least now I know where they are. More to the point, all I've done is watch some movies and download some games on steam, and within a month my system had unusably low disk space. So I'd definitely dispute your claim that my use case is "extreme". my use case is standard desktop usage, and not accounting for very normal usage in your design before shipping it with the OS is honestly unbelievable. if I was running server workloads with highly changing datasets, this would be way worse. I typically see > 1TB / week of writes on low usage servers, let alone the sometimes multiple TBs/hour on high usage systems, so I honestly can't imagine who this system design is for. I'll try playing with a manually installed zsys.conf file and see if I can get this down to something usable. maybe if I just keep it to 2 old states instead of 20, that'd be more viable. I'd definitely recommend that the zsys.conf usage be documented in the package, either with a man page or a README under /usr/share/doc, since these implementation details seem pretty well hidden. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1895943 Title: zsys automatic snapshots just eat up all drive space and never get cleaned up To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/zsys/+bug/1895943/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1895943] Re: zsys automatic snapshots just eat up all drive space and never get cleaned up
Thanks for reporting this bug and help making ubuntu better. ZSys is supposed to take user snapshots at the same time than system snapshot. This is done on purpose, to ensure that a system revert will always revert you to a coherent state. You can have application data that changed format and upgraded your database. If we didn’t snapshot USERDATA, then, reverting the system will end up in, for instance, older thunderbird not being able to open the new database schema (it can’t know about it), and so, your system snapshot will be useless. There is no point in snapshotting only the system thus. I suggest that you read this blog post which details that a little bit more: https://didrocks.fr/2020/05/28/zfs-focus-on-ubuntu-20.04-lts-zsys- general-principle-on-state-management/. It seems though that you have a bunch of data generated/copied and then removed on your machine (0.5T?). The GC is by default kicking out everything that is more than one month old since 0.4.7, but if your threshold is higher I understand that cn be a bottleneck. The good news is that this is configurable and explained at https://didrocks.fr/2020/06/04/zfs-focus-on-ubuntu-20.04-lts-zsys-state-collection/. Note that the default policy changed as stated above so that until free-space GC pressure is impemented, we mitigate extreme use cases like yours. Another way is to consider using persistent datasets which will be excluded from snapshots as explained in https://didrocks.fr/2020/06/16/zfs-focus-on-ubuntu-20.04-lts-zsys-dataset-layout/ -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1895943 Title: zsys automatic snapshots just eat up all drive space and never get cleaned up To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/zsys/+bug/1895943/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
