Re: Retention period for autopkgtest test logs

2023-09-26 Thread Steve Langasek
On Mon, Sep 25, 2023 at 03:22:59PM -0700, Bryce Harrington wrote:
> Moreover, there are other use cases beyond test failure fixing.
> Consider MREs and SRUs, where you prepare a package in a PPA, and run
> autopkgtest as part of the criteria for having the package be accepted.

For the record, I don't believe the SRU team has ever asked for pre-upload
autopkgtests as a condition of an MRE.

Given the frequency with which autopkgtest infrastructure gets overloaded, I
generally take the view that ppa autopkgtest runs should be kept to a
minimum because the results don't transfer to the main archive and all have
to be run again, and it's the second run that actually matters for
proposed-migration.

-- 
Steve Langasek   Give me a lever long enough and a Free OS
Debian Developer   to set it on, and I can move the world.
Ubuntu Developer   https://www.debian.org/
slanga...@ubuntu.com vor...@debian.org


signature.asc
Description: PGP signature
-- 
ubuntu-devel mailing list
ubuntu-devel@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel


Re: Retention period for autopkgtest test logs

2023-09-26 Thread Francis Ginther
On Mon, Sep 25, 2023 at 1:18 PM Bryce Harrington <
bryce.harring...@canonical.com> wrote:

> On Mon, Sep 25, 2023 at 10:23:36AM -0700, Brian Murray wrote:
> > Currently test results and log files for autopkgtest runs are kept until
> > the release for which the test was run reaches its End of Life. This is
> > also true for autopkgtest runs for packages in PPAs and the Ubuntu QA
> > team thinks we should not be keeping these for such a long period of
> > time.
> >
> > We plan to automatically remove test results for PPAs which ran more
> > than 8 weeks ago. Does 8 weeks seem like too short of a period to
> > anybody?
>
> It does feel a bit short; prior results can sometimes be interesting for
> comparison purposes, although even that value diminishes quickly over
> time.  Is there a strong reason to favor 8 weeks vs. say 26 weeks
> (i.e. our development cycle length)?
>
> Bryce
>

I would also recommend a longer period, at least 12 or 16 weeks. The
selfish reasoning is that this would give us at least 2 kernel SRU cycles
worth of (hopefully) passing logs to use when triaging a failure.

Francis
-- 
Francis Ginther
Canonical - Kernel
-- 
ubuntu-devel mailing list
ubuntu-devel@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel


Re: Retention period for autopkgtest test logs

2023-09-26 Thread John Chittum
Could we add "Keeping the last run"

That way you delete, but aren't just time constrained. Keeping the last
test run can be useful to do a comparison, if needed.

On Mon, Sep 25, 2023 at 12:24 PM Brian Murray  wrote:

> Currently test results and log files for autopkgtest runs are kept until
> the release for which the test was run reaches its End of Life. This is
> also true for autopkgtest runs for packages in PPAs and the Ubuntu QA
> team thinks we should not be keeping these for such a long period of
> time.
>
> We plan to automatically remove test results for PPAs which ran more
> than 8 weeks ago. Does 8 weeks seem like too short of a period to
> anybody?
>
> Thanks!
> --
> Brian Murray
>
> --
> ubuntu-devel mailing list
> ubuntu-devel@lists.ubuntu.com
> Modify settings or unsubscribe at:
> https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel
>


-- 
---
Dr. John Chittum
Engineering Manager, Canonical, CPC team
-- 
ubuntu-devel mailing list
ubuntu-devel@lists.ubuntu.com
Modify settings or unsubscribe at: 
https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel