Re: Respinning rawhide images every filesystem update?

2020-08-08 Thread Kevin Fenzi
On Thu, Aug 06, 2020 at 12:02:09PM -0400, Alex Scheel wrote:
> - Original Message -
> > From: "Stephen John Smoogen" 
> > To: "Development discussions related to Fedora" 
> > 
> > Sent: Thursday, August 6, 2020 10:55:51 AM
> > Subject: Re: Respinning rawhide images every filesystem update?
> > 
> > On Thu, 6 Aug 2020 at 10:05, Alex Scheel  wrote:
> > >
> > > - Original Message -
> > > > From: "Stephen John Smoogen" 
> > > > To: "Development discussions related to Fedora"
> > > > , asch...@redhat.com
> > > > Sent: Thursday, August 6, 2020 9:55:17 AM
> > > > Subject: Re: Respinning rawhide images every filesystem update?
> > > >
> > > > On Thu, 6 Aug 2020 at 09:36, Alex Scheel  wrote:
> > > > >
> > > > > I'm bumping this thread. This is still broken.
> > > > >
> > > >
> > > > Please open a ticket at
> > > > https://pagure.io/fedora-infrastructure/new_issue and open new issue
> > > > with an explanation of what is broken and where you are pulling from.
> > > > If it is a fedora registry then infrastructure can work on a fix. If
> > > > it is from docker.io or quay or elsewhere we can try to find the
> > > > people who fix it and let them know.
> > >
> > > Opened:
> > >
> > > https://pagure.io/fedora-infrastructure/issue/9208
> > >
> > > This was also posted to devel to hopefully get the attention of the
> > > filesystem maintainer.
> > >
> > >
> > > They seem to have ignored 1548403 since 2018. :-)
> > >
> > >
> > 
> > OK so this ticket clarifies the problem because I thought this was a
> > problem with the filesystem in the container image with how it is spun
> > or delivered. It is instead with the package filesystem. Here is the
> > ticket contents (since most people don't follow links in emails).
> 
> There's three ways to solve this:
> 
>  1) Make the filesystem upgrade nicely in a container, or
>  2) Have the container runtime/user namespace system/... support the
> type of change that upgrading the filesystem package makes, or
>  3) Just respin the container image quickly whenever this happens; this
> hides the problem from users without solving the problem.
> 
> 1 isn't happening because the maintainer isn't involved.
> 2 isn't happening because the container runtime maintainers punted on it.
> 3 is the easiest left to accomplish.

But I am confused, because as far as I can tell this is already
happening. 


> If I had a choice, I'd be really happy with 3. I don't know what
> all is involved to respin container images with a new package. I'm 
> sure it takes time, but I'd imagine it'd be mostly automated. The
> problem gets fixed eventually anyways.

It is automated. 

It happens every compose of rawhide. 

I am not sure why you are not seeing the new images. 

Are you pulling from registry.fedoraproject.org?

kevin


signature.asc
Description: PGP signature
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: Respinning rawhide images every filesystem update?

2020-08-06 Thread Alex Scheel
- Original Message -
> From: "Stephen John Smoogen" 
> To: "Development discussions related to Fedora" 
> 
> Sent: Thursday, August 6, 2020 10:55:51 AM
> Subject: Re: Respinning rawhide images every filesystem update?
> 
> On Thu, 6 Aug 2020 at 10:05, Alex Scheel  wrote:
> >
> > - Original Message -
> > > From: "Stephen John Smoogen" 
> > > To: "Development discussions related to Fedora"
> > > , asch...@redhat.com
> > > Sent: Thursday, August 6, 2020 9:55:17 AM
> > > Subject: Re: Respinning rawhide images every filesystem update?
> > >
> > > On Thu, 6 Aug 2020 at 09:36, Alex Scheel  wrote:
> > > >
> > > > I'm bumping this thread. This is still broken.
> > > >
> > >
> > > Please open a ticket at
> > > https://pagure.io/fedora-infrastructure/new_issue and open new issue
> > > with an explanation of what is broken and where you are pulling from.
> > > If it is a fedora registry then infrastructure can work on a fix. If
> > > it is from docker.io or quay or elsewhere we can try to find the
> > > people who fix it and let them know.
> >
> > Opened:
> >
> > https://pagure.io/fedora-infrastructure/issue/9208
> >
> > This was also posted to devel to hopefully get the attention of the
> > filesystem maintainer.
> >
> >
> > They seem to have ignored 1548403 since 2018. :-)
> >
> >
> 
> OK so this ticket clarifies the problem because I thought this was a
> problem with the filesystem in the container image with how it is spun
> or delivered. It is instead with the package filesystem. Here is the
> ticket contents (since most people don't follow links in emails).

There's three ways to solve this:

 1) Make the filesystem upgrade nicely in a container, or
 2) Have the container runtime/user namespace system/... support the
type of change that upgrading the filesystem package makes, or
 3) Just respin the container image quickly whenever this happens; this
hides the problem from users without solving the problem.

1 isn't happening because the maintainer isn't involved.
2 isn't happening because the container runtime maintainers punted on it.
3 is the easiest left to accomplish.


If I had a choice, I'd be really happy with 3. I don't know what
all is involved to respin container images with a new package. I'm 
sure it takes time, but I'd imagine it'd be mostly automated. The
problem gets fixed eventually anyways.

- Alex

(Arguably there is 4, quit rebuilding the filesystem package needlessly,
 but we seem to like mass-rebuilds of all packages, and it might set a
 weird precedence if we special case things). 

> filesystem package breaks Fedora containers because dnf cannot
> successfully update the package. See:
> 
> https://bugzilla.redhat.com/show_bug.cgi?id=1548403
> https://bugzilla.redhat.com/show_bug.cgi?id=1708249
> 
> Every time filesystem updates, it causes this problem. The solution is
> to rebuild Fedora containers with the new filesystem package upgrade,
> so dnf upgrade will already have the updated filesystem package.
> 
> Alternatively, the filesystem maintainer could make their package
> container friendly.
> 
> This is from the main Fedora registry:
> 
> [ascheel@ascheel-p50 ~]$ podman run -ti
> registry.fedoraproject.org/fedora:rawhide /bin/bash
> [root@5808bc88f6ab /]# dnf update --refresh -y
> Fedora 33 openh264 (From Cisco) - x86_64  6.9 kB/s | 5.1 kB 00:00
> Fedora - Modular Rawhide - Developmental pack 2.6 MB/s | 3.1 MB 00:01
> Fedora - Rawhide - Developmental packages for  17 MB/s |  73 MB 00:04
> Dependencies resolved.
> ==
>  Package Arch   Version Repo Size
> ==
> Upgrading:
> 
> 
> 
>  filesystem  x86_64 3.14-3.fc33 rawhide 1.1 M
> 
> 
> 
>   Upgrading: filesystem-3.14-3.fc33.x86_64  3/341
> Error unpacking rpm package filesystem-3.14-3.fc33.x86_64
> 
> 
> 
> Failed:
>   filesystem-3.14-2.fc32.x86_64 filesystem-3.14-3.fc33.x86_64
> 
> Error: Transaction failed
> 
> 
> --
> Stephen J Smoogen.
> ___
> devel mailing list -- devel@lists.fedoraproject.org
> To unsubscribe send an email to devel-le...@lists.fedoraproject.org
> Fedora Code of Conduct:
> https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> List Guidel

Re: Respinning rawhide images every filesystem update?

2020-08-06 Thread Stephen John Smoogen
On Thu, 6 Aug 2020 at 10:05, Alex Scheel  wrote:
>
> - Original Message -
> > From: "Stephen John Smoogen" 
> > To: "Development discussions related to Fedora" 
> > , asch...@redhat.com
> > Sent: Thursday, August 6, 2020 9:55:17 AM
> > Subject: Re: Respinning rawhide images every filesystem update?
> >
> > On Thu, 6 Aug 2020 at 09:36, Alex Scheel  wrote:
> > >
> > > I'm bumping this thread. This is still broken.
> > >
> >
> > Please open a ticket at
> > https://pagure.io/fedora-infrastructure/new_issue and open new issue
> > with an explanation of what is broken and where you are pulling from.
> > If it is a fedora registry then infrastructure can work on a fix. If
> > it is from docker.io or quay or elsewhere we can try to find the
> > people who fix it and let them know.
>
> Opened:
>
> https://pagure.io/fedora-infrastructure/issue/9208
>
> This was also posted to devel to hopefully get the attention of the
> filesystem maintainer.
>
>
> They seem to have ignored 1548403 since 2018. :-)
>
>

OK so this ticket clarifies the problem because I thought this was a
problem with the filesystem in the container image with how it is spun
or delivered. It is instead with the package filesystem. Here is the
ticket contents (since most people don't follow links in emails).

filesystem package breaks Fedora containers because dnf cannot
successfully update the package. See:

https://bugzilla.redhat.com/show_bug.cgi?id=1548403
https://bugzilla.redhat.com/show_bug.cgi?id=1708249

Every time filesystem updates, it causes this problem. The solution is
to rebuild Fedora containers with the new filesystem package upgrade,
so dnf upgrade will already have the updated filesystem package.

Alternatively, the filesystem maintainer could make their package
container friendly.

This is from the main Fedora registry:

[ascheel@ascheel-p50 ~]$ podman run -ti
registry.fedoraproject.org/fedora:rawhide /bin/bash
[root@5808bc88f6ab /]# dnf update --refresh -y
Fedora 33 openh264 (From Cisco) - x86_64  6.9 kB/s | 5.1 kB 00:00
Fedora - Modular Rawhide - Developmental pack 2.6 MB/s | 3.1 MB 00:01
Fedora - Rawhide - Developmental packages for  17 MB/s |  73 MB 00:04
Dependencies resolved.
==
 Package Arch   Version Repo Size
==
Upgrading:



 filesystem  x86_64 3.14-3.fc33 rawhide 1.1 M



  Upgrading: filesystem-3.14-3.fc33.x86_64  3/341
Error unpacking rpm package filesystem-3.14-3.fc33.x86_64



Failed:
  filesystem-3.14-2.fc32.x86_64 filesystem-3.14-3.fc33.x86_64

Error: Transaction failed


-- 
Stephen J Smoogen.
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: Respinning rawhide images every filesystem update?

2020-08-06 Thread Alex Scheel
- Original Message -
> From: "Stephen John Smoogen" 
> To: "Development discussions related to Fedora" 
> , asch...@redhat.com
> Sent: Thursday, August 6, 2020 9:55:17 AM
> Subject: Re: Respinning rawhide images every filesystem update?
> 
> On Thu, 6 Aug 2020 at 09:36, Alex Scheel  wrote:
> >
> > I'm bumping this thread. This is still broken.
> >
> 
> Please open a ticket at
> https://pagure.io/fedora-infrastructure/new_issue and open new issue
> with an explanation of what is broken and where you are pulling from.
> If it is a fedora registry then infrastructure can work on a fix. If
> it is from docker.io or quay or elsewhere we can try to find the
> people who fix it and let them know.

Opened:

https://pagure.io/fedora-infrastructure/issue/9208

This was also posted to devel to hopefully get the attention of the
filesystem maintainer.


They seem to have ignored 1548403 since 2018. :-)


- Alex

> 
> Without that information, it is very likely it will stay broken unless
> fixed by accident because no one knows what is meant by 'still broken'
> 
> > - Original Message -
> > > From: "Alex Scheel" 
> > > To: "Development discussions related to Fedora"
> > > 
> > > Sent: Monday, August 3, 2020 2:36:40 PM
> > > Subject: Respinning rawhide images every filesystem update?
> > >
> > > Hey list,
> > >
> > >
> > > How do Fedora rawhide images get respun? Every time filesystem updates,
> > > it causes `dnf update` to fail in a podman container because filesystem
> > > can't be updated in a container. We either need to make sure filesystem
> > > updates  cause rawhide containers to be rebuilt, or figure out how to
> > > ship a container-friendly filesystem package.
> > >
> > >
> > > See:
> > >
> > > https://bugzilla.redhat.com/show_bug.cgi?id=1548403
> > > https://bugzilla.redhat.com/show_bug.cgi?id=1708249
> > >
> > >
> > > And I'm sure many other discussions.
> > >
> > > - Alex
> > ___
> > devel mailing list -- devel@lists.fedoraproject.org
> > To unsubscribe send an email to devel-le...@lists.fedoraproject.org
> > Fedora Code of Conduct:
> > https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives:
> > https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
> 
> 
> 
> --
> Stephen J Smoogen.
> ___
> devel mailing list -- devel@lists.fedoraproject.org
> To unsubscribe send an email to devel-le...@lists.fedoraproject.org
> Fedora Code of Conduct:
> https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives:
> https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
> 
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: Respinning rawhide images every filesystem update?

2020-08-06 Thread Stephen John Smoogen
On Thu, 6 Aug 2020 at 09:36, Alex Scheel  wrote:
>
> I'm bumping this thread. This is still broken.
>

Please open a ticket at
https://pagure.io/fedora-infrastructure/new_issue and open new issue
with an explanation of what is broken and where you are pulling from.
If it is a fedora registry then infrastructure can work on a fix. If
it is from docker.io or quay or elsewhere we can try to find the
people who fix it and let them know.

Without that information, it is very likely it will stay broken unless
fixed by accident because no one knows what is meant by 'still broken'

> - Original Message -
> > From: "Alex Scheel" 
> > To: "Development discussions related to Fedora" 
> > 
> > Sent: Monday, August 3, 2020 2:36:40 PM
> > Subject: Respinning rawhide images every filesystem update?
> >
> > Hey list,
> >
> >
> > How do Fedora rawhide images get respun? Every time filesystem updates,
> > it causes `dnf update` to fail in a podman container because filesystem
> > can't be updated in a container. We either need to make sure filesystem
> > updates  cause rawhide containers to be rebuilt, or figure out how to
> > ship a container-friendly filesystem package.
> >
> >
> > See:
> >
> > https://bugzilla.redhat.com/show_bug.cgi?id=1548403
> > https://bugzilla.redhat.com/show_bug.cgi?id=1708249
> >
> >
> > And I'm sure many other discussions.
> >
> > - Alex
> ___
> devel mailing list -- devel@lists.fedoraproject.org
> To unsubscribe send an email to devel-le...@lists.fedoraproject.org
> Fedora Code of Conduct: 
> https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: 
> https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org



-- 
Stephen J Smoogen.
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: Respinning rawhide images every filesystem update?

2020-08-06 Thread Alex Scheel
I'm bumping this thread. This is still broken.

- Original Message -
> From: "Alex Scheel" 
> To: "Development discussions related to Fedora" 
> 
> Sent: Monday, August 3, 2020 2:36:40 PM
> Subject: Respinning rawhide images every filesystem update?
> 
> Hey list,
> 
> 
> How do Fedora rawhide images get respun? Every time filesystem updates,
> it causes `dnf update` to fail in a podman container because filesystem
> can't be updated in a container. We either need to make sure filesystem
> updates  cause rawhide containers to be rebuilt, or figure out how to
> ship a container-friendly filesystem package.
> 
> 
> See:
> 
> https://bugzilla.redhat.com/show_bug.cgi?id=1548403
> https://bugzilla.redhat.com/show_bug.cgi?id=1708249
> 
> 
> And I'm sure many other discussions.
> 
> - Alex
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: Respinning rawhide images every filesystem update?

2020-08-05 Thread Kevin Fenzi
On Mon, Aug 03, 2020 at 02:36:40PM -0400, Alex Scheel wrote:
> Hey list,
> 
> 
> How do Fedora rawhide images get respun? Every time filesystem updates,

They are rebuild in every rawhide nightly compose. 
Here's the one from last night/this morning: 
https://koji.fedoraproject.org/koji/taskinfo?taskID=48713559

They are then pushed into our registry.

> it causes `dnf update` to fail in a podman container because filesystem
> can't be updated in a container. We either need to make sure filesystem
> updates  cause rawhide containers to be rebuilt, or figure out how to
> ship a container-friendly filesystem package.

Where are you pulling from? Our registry? docker.io? quay?

kevin


signature.asc
Description: PGP signature
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Respinning rawhide images every filesystem update?

2020-08-03 Thread Alex Scheel
Hey list,


How do Fedora rawhide images get respun? Every time filesystem updates,
it causes `dnf update` to fail in a podman container because filesystem
can't be updated in a container. We either need to make sure filesystem
updates  cause rawhide containers to be rebuilt, or figure out how to
ship a container-friendly filesystem package.


See:

https://bugzilla.redhat.com/show_bug.cgi?id=1548403
https://bugzilla.redhat.com/show_bug.cgi?id=1708249


And I'm sure many other discussions.

- Alex
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org