Re: zstd compression for packages

On 21 March 2018 at 00:25, Steve Langasek wrote: > On Sat, Mar 17, 2018 at 03:09:55PM +, Dimitri John Ledkov wrote: >> On 16 March 2018 at 22:13, Steve Langasek wrote: >> > In other words: if we want to make this the default, we should

Re: zstd compression for packages

On Sat, Mar 17, 2018 at 03:09:55PM +, Dimitri John Ledkov wrote: > On 16 March 2018 at 22:13, Steve Langasek wrote: > > In other words: if we want to make this the default, we should quantify > > Daniel's remark that he would prefer a 6% faster download over a 10%

Re: zstd compression for packages

On Sat, Mar 17, 2018 at 03:09:55PM +, Dimitri John Ledkov wrote: > On 16 March 2018 at 22:13, Steve Langasek wrote: > > In other words: if we want to make this the default, we should quantify > > Daniel's remark that he would prefer a 6% faster download over a 10%

Re: zstd compression for packages

Hi All, On Sat, Mar 17, 2018 at 3:09 PM, Dimitri John Ledkov wrote: > On 16 March 2018 at 22:13, Steve Langasek wrote: >> In other words: if we want to make this the default, we should quantify >> Daniel's remark that he would prefer a 6%

Re: zstd compression for packages

On 16 March 2018 at 22:13, Steve Langasek wrote: > In other words: if we want to make this the default, we should quantify > Daniel's remark that he would prefer a 6% faster download over a 10% faster > unpack. > Well, I think it does not make sense to think about this

Re: zstd compression for packages

Hi Julian, Thanks for posting about this. I agree that if this is landing in dpkg+apt upstream, it's reasonable to try to get it into the 18.04 release so that it can be used in later releases without needing a dpkg versioned pre-depends. If we are to evaluate using zstd as the default

Re: zstd compression for packages

Am Dienstag, den 13.03.2018, 12:07 +1100 schrieb Daniel Axtens: > > > On Tue, Mar 13, 2018 at 1:43 AM, Balint Reczey al.com> wrote: > > Hi Daniel, > > > > On Mon, Mar 12, 2018 at 2:11 PM, Daniel Axtens > > wrote: > > > Hi, > > > > > > I

Re: zstd compression for packages

On Wed, Mar 14, 2018 at 02:40:01PM -0300, Marcos Alano wrote: > May be run some tests to find the sweet spot between size and speed? Well, that's what we did, and the sweet spot is -19, the maximum non-ultra level. -- debian developer - deb.li/jak | jak-linux.org - free software dev ubuntu core

Re: zstd compression for packages

On Wed, Mar 14, 2018 at 04:09:27PM +0100, Benjamin Tegge wrote: > I want to mention that you can enable ultra compression levels 20 to 22 > in zstd which usually achieve results comparable to the highest > compression levels of xz. There should be a level that matches the > results of xz -6 while

Re: zstd compression for packages

On Tue, Mar 13, 2018 at 1:43 AM, Balint Reczey wrote: > Hi Daniel, > > On Mon, Mar 12, 2018 at 2:11 PM, Daniel Axtens > wrote: > > Hi, > > > > I looked into compression algorithms a bit in a previous role, and to be > > honest I'm quite

Re: zstd compression for packages

On Mon, Mar 12, 2018 at 10:09 AM, Julian Andres Klode wrote: > On Mon, Mar 12, 2018 at 09:30:16AM -0400, Neal Gompa wrote: >> On Mon, Mar 12, 2018 at 9:11 AM, Daniel Axtens >> wrote: >> > Hi, >> > >> > I looked into compression algorithms

Re: zstd compression for packages

On Mon, Mar 12, 2018 at 9:11 AM, Daniel Axtens wrote: > Hi, > > I looked into compression algorithms a bit in a previous role, and to be > honest I'm quite surprised to see zstd proposed for package storage. zstd, > according to its own github repo, is "targeting

Re: zstd compression for packages

On Mon, Mar 12, 2018 at 03:36:11PM +0100, Julian Andres Klode wrote: > Acknowledged. I don't think we want to go ahead without dpkg upstream > blessing anyway. On the APT side, we don't maintain Ubuntu-only branches, > so if we get a go-ahead it would land in Debian immediately too. Good. > I

Re: zstd compression for packages

Hi Daniel, On Mon, Mar 12, 2018 at 2:11 PM, Daniel Axtens wrote: > Hi, > > I looked into compression algorithms a bit in a previous role, and to be > honest I'm quite surprised to see zstd proposed for package storage. zstd, > according to its own github repo, is

Re: zstd compression for packages

On Mon, Mar 12, 2018 at 02:19:18PM +, Colin Watson wrote: > On Mon, Mar 12, 2018 at 10:02:49AM -0400, Jeremy Bicha wrote: > > On Mon, Mar 12, 2018 at 6:06 AM, Julian Andres Klode > > wrote: > > > We are considering requesting a FFe for that - the features are not >

Re: zstd compression for packages

On Mon, Mar 12, 2018 at 10:02:49AM -0400, Jeremy Bicha wrote: > On Mon, Mar 12, 2018 at 6:06 AM, Julian Andres Klode > wrote: > > We are considering requesting a FFe for that - the features are not > > invasive, and it allows us to turn it on by default in 18.10. > >

Re: zstd compression for packages

On Mon, Mar 12, 2018 at 03:05:13PM +0100, Julian Andres Klode wrote: > On Mon, Mar 12, 2018 at 01:49:42PM +, Robie Basak wrote: > > On Mon, Mar 12, 2018 at 11:06:11AM +0100, Julian Andres Klode wrote: > > > We are considering requesting a FFe for that - the features are not > > > invasive,

Re: zstd compression for packages

On Mon, Mar 12, 2018 at 10:02:49AM -0400, Jeremy Bicha wrote: > On Mon, Mar 12, 2018 at 6:06 AM, Julian Andres Klode > wrote: > > We are considering requesting a FFe for that - the features are not > > invasive, and it allows us to turn it on by default in 18.10. > >

Re: zstd compression for packages

On Mon, Mar 12, 2018 at 09:30:16AM -0400, Neal Gompa wrote: > On Mon, Mar 12, 2018 at 9:11 AM, Daniel Axtens > wrote: > > Hi, > > > > I looked into compression algorithms a bit in a previous role, and to be > > honest I'm quite surprised to see zstd proposed for

Re: zstd compression for packages

On Mon, Mar 12, 2018 at 01:49:42PM +, Robie Basak wrote: > On Mon, Mar 12, 2018 at 11:06:11AM +0100, Julian Andres Klode wrote: > > We are considering requesting a FFe for that - the features are not > > invasive, and it allows us to turn it on by default in 18.10. > > libzstd has only been

Re: zstd compression for packages

On Mon, Mar 12, 2018 at 6:06 AM, Julian Andres Klode wrote: > We are considering requesting a FFe for that - the features are not > invasive, and it allows us to turn it on by default in 18.10. What does Debian's dpkg maintainer think? Thanks, Jeremy Bicha --

Re: zstd compression for packages

On Mon, Mar 12, 2018 at 11:06:11AM +0100, Julian Andres Klode wrote: > We are considering requesting a FFe for that - the features are not > invasive, and it allows us to turn it on by default in 18.10. libzstd has only been stable in the archive since Artful. We had to SRU fixes to Xenial

Re: zstd compression for packages

Hi, I looked into compression algorithms a bit in a previous role, and to be honest I'm quite surprised to see zstd proposed for package storage. zstd, according to its own github repo, is "targeting real-time compression scenarios". It's not really designed to be run at its maximum compression

Re: zstd compression for packages

On Mon, Mar 12, 2018 at 11:06:11AM +0100, Julian Andres Klode wrote: > Hey folks, > > We had a coding day in Foundations last week and Balint and Julian added > support for zstd compression to dpkg [1] and apt [2]. > > [1] https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=892664 > [2]