Re: RFC: Ubuntu Seeded Snaps
IMHO, Snap Store is more like an app store (like Google Play Store), than a regular package repository (archive.ubuntu.com, a PPA or a third party repository). I think some ground rules and some policies are necessary, but we must avoid burocracy and give freedom to developer, so he/she can create what he wants. So things like licensing should weaker enforced. The idea is: think as an app store, not a package repository. On Fri, Feb 9, 2018 at 2:32 PM, Ross Gammonwrote: > On 02/09/2018 12:18 PM, Colin Watson wrote: >> On Fri, Feb 09, 2018 at 11:20:53AM +0100, Oliver Grawert wrote: >>> Am Freitag, den 09.02.2018, 09:37 + schrieb Robie Basak: Should this be a side effect subject to change of store policy (which I think is outside the scope of the Ubuntu project?), or should we define "no devmode" as an Ubuntu policy now? >>> this is an already existing store policy ... if your snap was built >>> with "confinement: devmode" you can not release it to stable, the store >>> checks this and blocks. so the "only stable" policy on the ubuntu side >>> should be enough. >> Regardless of the question of governance of that policy, there's also >> the fact that the spec calls for following a per-series channel, for >> which I don't think a "no devmode" store policy is currently configured. >> > Maybe not related to the policy as such, but one thing I have always > wondered about, but not had the time to investigate (as I have only > installed one snap deliberately on my system), is the release upgrade path. > > When I installed my "one and only" snap, I had to manually remove the > old deb package manually. > > Will this be managed automagically if a flavour chooses a snap in their > seed rather than the old deb package? > > Cheers, > > Ross > > > > -- > ubuntu-devel mailing list > ubuntu-devel@lists.ubuntu.com > Modify settings or unsubscribe at: > https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel -- Marcos H. Alano Linux System Administrator marcoshal...@gmail.com -- ubuntu-devel mailing list ubuntu-devel@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel
Re: RFC: Ubuntu Seeded Snaps
On 02/09/2018 11:48 AM, Colin Watson wrote: > For better or worse, the snap store doesn't have teams. Should this be > rephrased in terms of collaboration or something? Well, I'd rather we set the expectation that the snap store learn to use LP teams. Mark -- ubuntu-devel mailing list ubuntu-devel@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel
Re: RFC: Ubuntu Seeded Snaps
Hi Colin, On Fri, Feb 09, 2018 at 10:00:28AM +, Colin Watson wrote: > On Fri, Feb 09, 2018 at 09:37:17AM +, Robie Basak wrote: > > On Thu, Feb 08, 2018 at 03:10:08PM -0800, Steve Langasek wrote: > > > Snaps included in images will be installed referencing a per-Ubuntu-series > > > branch. This ensures forwards-compatibility by allowing publishing to > > > this > > > branch if the mainline of a snap becomes incompatible with a given Ubuntu > > > release, without requiring up-front maintenance of multiple snap channels. > > I don't follow this. Are you suggesting that the seed list a snap > > version number? Or a specific code branch in Launchpad from which the > > snap ending up in the images will get built? If the former, wouldn't the > > install base become "stuck"? > Store channel names are formed as [track/]risk[/branch]; it's this kind > of branch that Steve is referring to. (The spec should probably just > say "channel", though.) > I'm not sure how this can avoid requiring up-front maintenance of > multiple snap channels. If the proposal is that we install snaps in a > way that will cause refreshes to pull from a pre-configured per-series > channel, then unless that channel actually exists then "snap refresh" is > surely going to be returning errors, which doesn't seem like a good > stock configuration. My understanding was that if the branch does not exist, pulling by that branch name would fall back to the stable channel. It seems that may not be the case: $ snap refresh canonical-livepatch --channel stable/foo error: snap "canonical-livepatch" not found (at least in channel "stable/foo") $ Would this need further development in either the snap client or the snap store in order to support such usage? The intended behavior is that the publisher does not have to maintain these channels when the content should be identical to the stable channel, but that if a snap revision *is* published to the Ubuntu-specifc channel at any point, all relevant Ubuntu clients will pick that version instead of stable. > This raises another point; when upgrading to versions beyond 18.04, > users' systems will need to be modified to follow the appropriate > per-series channel for each of these preinstalled snaps. Somebody will > need to teach the upgrader to do this, and it will also need to be > documented for people who don't use update-manager/do-release-upgrade. Yes; I've captured the software requirement here: https://bugs.launchpad.net/ubuntu/+source/ubuntu-release-upgrader/+bug/1748581 For documentation, do you have a sense of where that could be put that would be read by those who don't use ubuntu-release-upgrader? The release notes upgrade instructions already point to u-r-u. Thanks, -- Steve Langasek Give me a lever long enough and a Free OS Debian Developer to set it on, and I can move the world. Ubuntu Developerhttp://www.debian.org/ slanga...@ubuntu.com vor...@debian.org signature.asc Description: PGP signature -- ubuntu-devel mailing list ubuntu-devel@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel
Re: RFC: Ubuntu Seeded Snaps
With snaps we no longer get crash reporting to errors.ubuntu.com. We should add support for snap crash reporting to apport. This isn't all that useful without debug symbols, so we should investigate how we can make builds with debug symbols available as well. Just a couple things I think we need to tackle sooner rather than later. Cheers, Ken On Thu, Feb 8, 2018 at 6:10 PM, Steve Langasekwrote: > Dear developers, > > As I'm sure you know, Canonical has recently been putting a lot of work > into > the Snap Store[1], a repository for third-party packages that is the > successor > to the past extras.ubuntu.com[2] and click packages efforts. > > We are confident that snaps today represent a solid delivery vehicle for > third-party software on top of Ubuntu, and that snaps stand as a > first-class > alternative to deb packages for Ubuntu users where appropriate. > > Snaps are already presented alongside debs in the software catalog on the > Ubuntu Desktop, and with the 17.10 release, the Ubuntu MATE team took the > first foray into including snaps by default in an Ubuntu flavor image. Now > in Ubuntu 18.04 LTS, we are looking at broadening the inclusion of snaps in > Ubuntu images by default. This raises important questions about what the > policies should be for software installed by default as a snap, since the > review processes around the Ubuntu archive for universe and main don't > directly translate to the Snap Store. > > I have prepared a draft which lays out what I believe the requirements > should be around snaps which we ship preinstalled, and I would greatly > appreciate the feedback of the Ubuntu Developer community around this > proposed policy: > > https://wiki.ubuntu.com/UbuntuSeededSnaps > > > I have also included the text of this draft below for your convenience. > > > = Goal = > Snaps represent a new way of building packages with reduced barriers to > entry. By design, the snapcraft tooling imposes very little policy to > avoid > also introducing friction. As more software becomes available as snaps, we > want to take advantage of this body of packages as part of the default > Ubuntu experience, but maintaining the Ubuntu community’s commitments > around > this default experience means reintroducing policy on top of snaps. This > document is an attempt to translate existing policy for the Ubuntu archive > to the new world of the Canonical Snap Store. > > = Channel availability = > Including software in the default install of Ubuntu implies a certain > commitment to handle upgrades cleanly and to provide continuity of behavior > across updates within the stable release. The best way to ensure this > commitment holds true in the snap case is to only include snaps that come > from the stable channel. > > As a side effect, since devmode snaps may not be published to the stable > channel, only strict and classic confined snaps may be included. > > Snaps included in images will be installed referencing a per-Ubuntu-series > branch. This ensures forwards-compatibility by allowing publishing to this > branch if the mainline of a snap becomes incompatible with a given Ubuntu > release, without requiring up-front maintenance of multiple snap channels. > > = Maintainer = > Packages in the Ubuntu archive arrive there by one of two means: they are > synced from Debian as upstream, or they are uploaded by an Ubuntu > developer. > Similarly, to be included in an Ubuntu image, a snap should have as its > publisher either the upstream, or the Ubuntu developer community. For the > latter, a common team should initially be created in the Snap Store whose > membership is managed by the Developer Membership Board, and kept in sync > with the ubuntu-motu team in Launchpad, with the Ubuntu Security team > additionally included. > > = Source availability = > Unlike Launchpad, the Snap Store allows publishers to upload binary snaps > directly. While a valuable option in the general case, for snaps installed > by default we should ensure that they build from source in the common > Launchpad environment. This helps to avoid any increase to the build time > attack surface and provides a known good environment that can be similarly > duplicated if the snaps needs to be rebuilt in the future > > In addition, maintainability of the product demands that the package > remains > buildable if no changes have been made to the product’s source. For .deb > packages, we enforce this by only building against other packages in the > Ubuntu distribution. Launchpad allows snap builds to pull from third-party > repositories; this means that if those repositories change - or disappear - > the snap may no longer be functionally equivalent when rebuilt, or may not > build at all. To address this, official Ubuntu snaps should be built only > from source that is available in Launchpad. Snap recipe builds already > require a launchpad-hosted branch to host the snapcraft.yaml, so it is a >
Re: RFC: Ubuntu Seeded Snaps
On 02/09/2018 12:18 PM, Colin Watson wrote: > On Fri, Feb 09, 2018 at 11:20:53AM +0100, Oliver Grawert wrote: >> Am Freitag, den 09.02.2018, 09:37 + schrieb Robie Basak: >>> Should this be a side effect subject to change of store policy >>> (which I think is outside the scope of the Ubuntu project?), or >>> should we define "no devmode" as an Ubuntu policy now? >> this is an already existing store policy ... if your snap was built >> with "confinement: devmode" you can not release it to stable, the store >> checks this and blocks. so the "only stable" policy on the ubuntu side >> should be enough. > Regardless of the question of governance of that policy, there's also > the fact that the spec calls for following a per-series channel, for > which I don't think a "no devmode" store policy is currently configured. > Maybe not related to the policy as such, but one thing I have always wondered about, but not had the time to investigate (as I have only installed one snap deliberately on my system), is the release upgrade path. When I installed my "one and only" snap, I had to manually remove the old deb package manually. Will this be managed automagically if a flavour chooses a snap in their seed rather than the old deb package? Cheers, Ross -- ubuntu-devel mailing list ubuntu-devel@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel
Re: RFC: Ubuntu Seeded Snaps
On Fri, Feb 09, 2018 at 11:20:53AM +0100, Oliver Grawert wrote: > Am Freitag, den 09.02.2018, 09:37 + schrieb Robie Basak: > > Should this be a side effect subject to change of store policy > > (which I think is outside the scope of the Ubuntu project?), or > > should we define "no devmode" as an Ubuntu policy now? > > this is an already existing store policy ... if your snap was built > with "confinement: devmode" you can not release it to stable, the store > checks this and blocks. so the "only stable" policy on the ubuntu side > should be enough. Regardless of the question of governance of that policy, there's also the fact that the spec calls for following a per-series channel, for which I don't think a "no devmode" store policy is currently configured. -- Colin Watson [cjwat...@ubuntu.com] -- ubuntu-devel mailing list ubuntu-devel@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel
Re: RFC: Ubuntu Seeded Snaps
hi, Am Freitag, den 09.02.2018, 10:30 + schrieb Robie Basak: > > I think you missed my point. i definitely read it completely differently, yes, sorry for the noise :) ciao oli signature.asc Description: This is a digitally signed message part -- ubuntu-devel mailing list ubuntu-devel@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel
Re: RFC: Ubuntu Seeded Snaps
On Fri, Feb 09, 2018 at 11:20:53AM +0100, Oliver Grawert wrote: > > Should this be a side effect subject to change of store policy (which > > I > > think is outside the scope of the Ubuntu project?), or should we > > define > > "no devmode" as an Ubuntu policy now? > > this is an already existing store policy ... if your snap was built > with "confinement: devmode" you can not release it to stable, the store > checks this and blocks. so the "only stable" policy on the ubuntu side > should be enough. I think you missed my point. Who sets the store policy? What is the governance of the store policy? If it is Canonical, rather than Ubuntu, then Ubuntu may consider it appropriate to "lock" its seeding policy, rather than having a policy whose result varies according to external changes. signature.asc Description: PGP signature -- ubuntu-devel mailing list ubuntu-devel@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel
Re: RFC: Ubuntu Seeded Snaps
hi, Am Freitag, den 09.02.2018, 09:37 + schrieb Robie Basak: > > > > > As a side effect, since devmode snaps may not be published to the > > stable > > channel, only strict and classic confined snaps may be included. > Should this be a side effect subject to change of store policy (which > I > think is outside the scope of the Ubuntu project?), or should we > define > "no devmode" as an Ubuntu policy now? this is an already existing store policy ... if your snap was built with "confinement: devmode" you can not release it to stable, the store checks this and blocks. so the "only stable" policy on the ubuntu side should be enough. ciao oli signature.asc Description: This is a digitally signed message part -- ubuntu-devel mailing list ubuntu-devel@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel
Re: RFC: Ubuntu Seeded Snaps
On Fri, Feb 09, 2018 at 09:37:17AM +, Robie Basak wrote: > On Thu, Feb 08, 2018 at 03:10:08PM -0800, Steve Langasek wrote: > > Snaps included in images will be installed referencing a per-Ubuntu-series > > branch. This ensures forwards-compatibility by allowing publishing to this > > branch if the mainline of a snap becomes incompatible with a given Ubuntu > > release, without requiring up-front maintenance of multiple snap channels. > > I don't follow this. Are you suggesting that the seed list a snap > version number? Or a specific code branch in Launchpad from which the > snap ending up in the images will get built? If the former, wouldn't the > install base become "stuck"? Store channel names are formed as [track/]risk[/branch]; it's this kind of branch that Steve is referring to. (The spec should probably just say "channel", though.) I'm not sure how this can avoid requiring up-front maintenance of multiple snap channels. If the proposal is that we install snaps in a way that will cause refreshes to pull from a pre-configured per-series channel, then unless that channel actually exists then "snap refresh" is surely going to be returning errors, which doesn't seem like a good stock configuration. This raises another point; when upgrading to versions beyond 18.04, users' systems will need to be modified to follow the appropriate per-series channel for each of these preinstalled snaps. Somebody will need to teach the upgrader to do this, and it will also need to be documented for people who don't use update-manager/do-release-upgrade. > I'm very much in favour of the above two requirements, but there's also > a little more. With the current archive, these are some existing > properties that I think should be considered for inclusion in this > policy. > > * _Users_ (rather than just developers) can retrieve the full source >associated with a package from Launchpad with no other external >dependencies and rebuild it themselves, and tooling exists for this. > > * Users can find the build logs associated with every binary shipped >from the archive. > > * The above two statements are true both for packages that a user is >considering installing but has not yet installed, and for packages >that a user has installed locally. > > Does any of this exist with snaps today (that were built from source on > Launchpad)? I haven't been able to find any suitable connection to > identify the provenance of a snap in this way. If they were built on Launchpad with the proposed changes to disallow external network access, then all the necessary information exists, but there's currently no tooling to help users actually find it. -- Colin Watson [cjwat...@ubuntu.com] -- ubuntu-devel mailing list ubuntu-devel@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel
Re: RFC: Ubuntu Seeded Snaps
Hi Steve, Thank you for driving this. I'm looking forward to having leaf desktop packages available and upgradeable via snaps. On Thu, Feb 08, 2018 at 03:10:08PM -0800, Steve Langasek wrote: > = Channel availability = > Including software in the default install of Ubuntu implies a certain > commitment to handle upgrades cleanly and to provide continuity of behavior > across updates within the stable release. The best way to ensure this > commitment holds true in the snap case is to only include snaps that come > from the stable channel. Makes sense. Interestingly though, this isn't a property that exists for the (deb) archive at the moment. Ubuntu developers can sync from Debian experimental and we trust them to use their judgement. We also sometimes deliberately ship something pre-release because of release schedule alignment issues, with the expectation that an updates will be issued shortly after release. What would be the equivalent for snaps? Would a TB exception always be required, or should the policy allow the release team to grant exceptions? Should it be a policy matter at all: can Ubuntu developers be trusted to make the decision for themselves, consulting with Ubuntu developers and the release team as appropriate? > As a side effect, since devmode snaps may not be published to the stable > channel, only strict and classic confined snaps may be included. Should this be a side effect subject to change of store policy (which I think is outside the scope of the Ubuntu project?), or should we define "no devmode" as an Ubuntu policy now? > Snaps included in images will be installed referencing a per-Ubuntu-series > branch. This ensures forwards-compatibility by allowing publishing to this > branch if the mainline of a snap becomes incompatible with a given Ubuntu > release, without requiring up-front maintenance of multiple snap channels. I don't follow this. Are you suggesting that the seed list a snap version number? Or a specific code branch in Launchpad from which the snap ending up in the images will get built? If the former, wouldn't the install base become "stuck"? If the latter, how and when would that branch get updated, and how would that work if upstream are maintaining the snap? > = Maintainer = > Packages in the Ubuntu archive arrive there by one of two means: they are > synced from Debian as upstream, or they are uploaded by an Ubuntu developer. > Similarly, to be included in an Ubuntu image, a snap should have as its > publisher either the upstream, or the Ubuntu developer community. For the > latter, a common team should initially be created in the Snap Store whose > membership is managed by the Developer Membership Board, and kept in sync > with the ubuntu-motu team in Launchpad, with the Ubuntu Security team > additionally included. Sounds reasonable. > = Source availability = > Unlike Launchpad, the Snap Store allows publishers to upload binary snaps > directly. While a valuable option in the general case, for snaps installed > by default we should ensure that they build from source in the common > Launchpad environment. This helps to avoid any increase to the build time > attack surface and provides a known good environment that can be similarly > duplicated if the snaps needs to be rebuilt in the future > > In addition, maintainability of the product demands that the package remains > buildable if no changes have been made to the product’s source. For .deb > packages, we enforce this by only building against other packages in the > Ubuntu distribution. Launchpad allows snap builds to pull from third-party > repositories; this means that if those repositories change - or disappear - > the snap may no longer be functionally equivalent when rebuilt, or may not > build at all. To address this, official Ubuntu snaps should be built only > from source that is available in Launchpad. Snap recipe builds already > require a launchpad-hosted branch to host the snapcraft.yaml, so it is a > logical extension to require launchpad hosting for the parts also. I'm very much in favour of the above two requirements, but there's also a little more. With the current archive, these are some existing properties that I think should be considered for inclusion in this policy. * _Users_ (rather than just developers) can retrieve the full source associated with a package from Launchpad with no other external dependencies and rebuild it themselves, and tooling exists for this. * Users can find the build logs associated with every binary shipped from the archive. * The above two statements are true both for packages that a user is considering installing but has not yet installed, and for packages that a user has installed locally. Does any of this exist with snaps today (that were built from source on Launchpad)? I haven't been able to find any suitable connection to identify the provenance of a snap in this way. > = License = > The license policy covering
RFC: Ubuntu Seeded Snaps
Dear developers, As I'm sure you know, Canonical has recently been putting a lot of work into the Snap Store[1], a repository for third-party packages that is the successor to the past extras.ubuntu.com[2] and click packages efforts. We are confident that snaps today represent a solid delivery vehicle for third-party software on top of Ubuntu, and that snaps stand as a first-class alternative to deb packages for Ubuntu users where appropriate. Snaps are already presented alongside debs in the software catalog on the Ubuntu Desktop, and with the 17.10 release, the Ubuntu MATE team took the first foray into including snaps by default in an Ubuntu flavor image. Now in Ubuntu 18.04 LTS, we are looking at broadening the inclusion of snaps in Ubuntu images by default. This raises important questions about what the policies should be for software installed by default as a snap, since the review processes around the Ubuntu archive for universe and main don't directly translate to the Snap Store. I have prepared a draft which lays out what I believe the requirements should be around snaps which we ship preinstalled, and I would greatly appreciate the feedback of the Ubuntu Developer community around this proposed policy: https://wiki.ubuntu.com/UbuntuSeededSnaps I have also included the text of this draft below for your convenience. = Goal = Snaps represent a new way of building packages with reduced barriers to entry. By design, the snapcraft tooling imposes very little policy to avoid also introducing friction. As more software becomes available as snaps, we want to take advantage of this body of packages as part of the default Ubuntu experience, but maintaining the Ubuntu community’s commitments around this default experience means reintroducing policy on top of snaps. This document is an attempt to translate existing policy for the Ubuntu archive to the new world of the Canonical Snap Store. = Channel availability = Including software in the default install of Ubuntu implies a certain commitment to handle upgrades cleanly and to provide continuity of behavior across updates within the stable release. The best way to ensure this commitment holds true in the snap case is to only include snaps that come from the stable channel. As a side effect, since devmode snaps may not be published to the stable channel, only strict and classic confined snaps may be included. Snaps included in images will be installed referencing a per-Ubuntu-series branch. This ensures forwards-compatibility by allowing publishing to this branch if the mainline of a snap becomes incompatible with a given Ubuntu release, without requiring up-front maintenance of multiple snap channels. = Maintainer = Packages in the Ubuntu archive arrive there by one of two means: they are synced from Debian as upstream, or they are uploaded by an Ubuntu developer. Similarly, to be included in an Ubuntu image, a snap should have as its publisher either the upstream, or the Ubuntu developer community. For the latter, a common team should initially be created in the Snap Store whose membership is managed by the Developer Membership Board, and kept in sync with the ubuntu-motu team in Launchpad, with the Ubuntu Security team additionally included. = Source availability = Unlike Launchpad, the Snap Store allows publishers to upload binary snaps directly. While a valuable option in the general case, for snaps installed by default we should ensure that they build from source in the common Launchpad environment. This helps to avoid any increase to the build time attack surface and provides a known good environment that can be similarly duplicated if the snaps needs to be rebuilt in the future In addition, maintainability of the product demands that the package remains buildable if no changes have been made to the product’s source. For .deb packages, we enforce this by only building against other packages in the Ubuntu distribution. Launchpad allows snap builds to pull from third-party repositories; this means that if those repositories change - or disappear - the snap may no longer be functionally equivalent when rebuilt, or may not build at all. To address this, official Ubuntu snaps should be built only from source that is available in Launchpad. Snap recipe builds already require a launchpad-hosted branch to host the snapcraft.yaml, so it is a logical extension to require launchpad hosting for the parts also. Both of these requirements will likely depend on changes to Launchpad and possibly the Snap Store, to either support enforcing a different network policy at build time or to tag builds as compliant or not with this policy. = License = The license policy covering Ubuntu main and restricted is documented at https://www.ubuntu.com/about/about-ubuntu/licensing. Snaps included by default in Ubuntu installs should comply with this policy the same as .debs do. Partner-specific images and images for community flavors may include