On Fri, Sep 12, 2025 at 5:05 AM Karolina Surma <ksu...@redhat.com> wrote:
>
> >>> The plan, as of now, is:
> >>>
> >>>   1. Wait for Python 3.14.0rc3 release.
> >>>   2. Wait for the Fedora 43 Beta Freeze to finish.
> >>>   3. Bump and build all packages in rawhide (except kernel).
> >>>   4. FF-merge into f43 and build all packages that match the criteria:
> >>>      a) the rawhide and f43 branches were not different before 3.
> >>>      b) they have no update stuck in bodhi/gating.
> >>>      c) their latest commit hash has been successfully built and shipped 
> >>> for
> >>> Fedora 43.
> >>>   5. Open Bodhi updates for packages built for Fedora 43.
> >>
> >> How are you planning on doing the updates?
> >> In groups? one at a time? all at once?
> >>
> >> I don't think bodhi can handle ~3700 packages in one update. :(
> >>
> >
> > This is something we actually wanted to try for ELN. I feel like I
> > remember a conversation from the recent past where we figured out that
> > the major impediment to doing this had actually been fixed (it was
> > related to HTTP timeouts trying to add all of the packages, I think).
> > I'm pretty sure we'd been given the green light to try this for the
> > ~2500 packages in ELN. I'm CCing Yaakov Selkowitz and Adam Williamson
> > directly who could correct me if I'm misremembering.
> >
> > So maybe it's worth giving it a try? If it fails, we can always fall
> > back to the direct tagging option.
>
> I'd much prefer not to proceed in yet untested ways, there will be a lot
> to handle in a rather short timeframe.
> A single Bodhi update with all the builds would have more downsides to
> it: any failed gating would stop the whole update; any
> updated-in-the-meantime package would require us to bump the one in the
> side tag and reset the timer to push to stable.
>
> > Karolina: Either way, I think we need to do this in a side-tag, if
> > only to have an easy way to look up what potentially needs tagging.
> > Since we're past the Bodhi activation point, we can't rely on
> > automation to create all of the individual updates (short of
> > submitting them as a single update from a side-tag).
>
> Since all the builds will most probably be trigerred by me, a simple
> koji query filtering my builds after a given timestamp will be a good
> enough solution to make sure we caught them all.
>
> ---
>
> Kevin, to your original question: if we create individual updates for
> each package, what, except for my work behind the scenes (to determine
> built packages and trigger an update for them) can go wrong? Can Bodhi
> handle ~3700 individual updates appearing in the span of ~2 days? If so,
> we'd most likely go this route.
> What is the best way forward from your point of view?
>

~3700 individual updates hitting Bodhi over a short period is almost
certainly going to cause problems with the load, similar to trying to
manually create a single update with all the same packages.

To my mind, we have three realistic options here:

Option 1) You perform all of the builds, we identify them and tag them
manually into Fedora, bypassing Bodhi entirely.
Pros: Low resource usage, can be done with or without a side-tag as
preferred. (Though a side-tag means it's easier to keep track of which
packages were built specifically for this and it allows maintainers to
submit their own builds into the side-tag if needed, rather than
relying only on Karolina to build everything.)
Cons: It bypasses all testing, so we won't know until the next compose
attempt whether things still work.

Option 2) Build everything into a side-tag, we try submitting the side
tag as a Bodhi update
Pros: The set of changes gets tested (though it probably fails and
needs to waive at least a few cases). It exercises a path ELN wants to
take and it provides Fedora data on whether Bodhi can handle such a
large update set. Even if Bodhi fails, we still have the option to
just migrate everything from the side-tag directly into stable.
Cons: If the load generated is too high, we could cause a DoS on Bodhi.

Option 3) Don't do this mass-rebuild at all.
Pros: No resource usage, no risk to infrastructure.
Cons: Low initial end-user performance, as we'll ship Python packages
that need to byte-compile every module the first time they are used.


Does anyone see an Option 4 somewhere?

-- 
_______________________________________________
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue

Reply via email to