[Bug 1970896] Re: uvt-simplestreams-libvirt in ubuntu_kvm_smoke_test will eat up all disk free space on Jammy AWS baremetal
OK! Thanks for the info, we will discuss how to deal with this first (maybe just bump the disk size) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1970896 Title: uvt-simplestreams-libvirt in ubuntu_kvm_smoke_test will eat up all disk free space on Jammy AWS baremetal To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/1970896/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1970896] Re: uvt-simplestreams-libvirt in ubuntu_kvm_smoke_test will eat up all disk free space on Jammy AWS baremetal
Hi Po-Hsu Lin, Sorry, there's also a decompression step. The relevant code is: https://git.launchpad.net/uvtool/tree/uvtool/libvirt/__init__.py#n45 It's possible this could be optimized if libvirt's API has had any enhancements since I wrote that code. It looks like I did it this way because I had to tell libvirt the uncompressed size before creating the image in libvirt, and decompressing into a temporary file was the easiest way of determining this. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1970896 Title: uvt-simplestreams-libvirt in ubuntu_kvm_smoke_test will eat up all disk free space on Jammy AWS baremetal To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/1970896/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1970896] Re: uvt-simplestreams-libvirt in ubuntu_kvm_smoke_test will eat up all disk free space on Jammy AWS baremetal
Hi Robie, thanks for the reply, It make sense to require twice of the image size as per the verification requirement, however it looks like in this case it's using more than two times of it. The image is just around 600M, so it should be just 600M in /tmp and 600M more in libvirt after it's been verified. 3.0G free space should be enough, but it's not. Maybe I am missing some pieces here? Thanks -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1970896 Title: uvt-simplestreams-libvirt in ubuntu_kvm_smoke_test will eat up all disk free space on Jammy AWS baremetal To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/1970896/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1970896] Re: uvt-simplestreams-libvirt in ubuntu_kvm_smoke_test will eat up all disk free space on Jammy AWS baremetal
Hi, In uvtool this is by design. It has to download the entire image before it can cryptographically verify it, and only then does it start injecting the image into libvirt. It does that using libvirt's socket API. Using that mechanism, I don't think it's possible to do a filesystem-level move to economize on disk usage. I suppose it might be possible to do one of a couple of things: 1) Have some kind of "--insecure" flag and code that opportunistically skips the /tmp step in this case, streaming the download directly into libvirt. However this is more code to maintain for a very special case, and the error path cleanup at the libvirt of a failed download would also have to be checked and handled as needed. 2) Arrange to do a filesystem-level move instead of using libvirt's API. However this would break users who have more complicated setups, so there'd again have to be more code to maintain to special case the default case. Since this behaviour is by design in uvtool, it isn't a bug per se, so I'll mark it accordingly. If you want to write and merge one of the above options, please could you explain why this is important for uvtool? Requiring twice the image size to be available in disk space seems reasonable to me. ** Changed in: uvtool (Ubuntu) Status: New => Incomplete ** Changed in: uvtool (Ubuntu) Importance: Undecided => Wishlist -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1970896 Title: uvt-simplestreams-libvirt in ubuntu_kvm_smoke_test will eat up all disk free space on Jammy AWS baremetal To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/1970896/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1970896] Re: uvt-simplestreams-libvirt in ubuntu_kvm_smoke_test will eat up all disk free space on Jammy AWS baremetal
When you run this `uvt-simplestreams-libvirt sync` command, I noticed there will be two files created in /tmp: -rw--- 1 root root 575M Apr 29 09:23 tmpf17tglw6 -rw--- 1 root root 1.4G Apr 29 09:23 tmpi4lq8p24 After that, it will start writing image file in /var/lib/uvtool/libvirt/images/, the file size reaches about 1.1G then disk space runs out root@a1.metal:/var/lib/uvtool/libvirt/images# ls -alh total 1.1G -rw--- 1 root root 1.1G Apr 29 09:14 'x-uvt-b64-Y29tLnVidW50dS5jbG91ZC5kYWlseTpzZXJ2ZXI6MjIuMDQ6YXJtNjQgMjAyMjA0MjM=' -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1970896 Title: uvt-simplestreams-libvirt in ubuntu_kvm_smoke_test will eat up all disk free space on Jammy AWS baremetal To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/1970896/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1970896] Re: uvt-simplestreams-libvirt in ubuntu_kvm_smoke_test will eat up all disk free space on Jammy AWS baremetal
** Also affects: uvtool (Ubuntu) Importance: Undecided Status: New ** Tags added: sru-20220418 ubuntu-kvm-smoke ** Tags removed: ubuntu-kvm-smoke ** Tags added: 5.15 aws jammy ubuntu-kvm-smoke-test -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1970896 Title: uvt-simplestreams-libvirt in ubuntu_kvm_smoke_test will eat up all disk free space on Jammy AWS baremetal To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-kernel-tests/+bug/1970896/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
