Re: zstd compression for packages

2018-03-28 Thread Dimitri John Ledkov
On 21 March 2018 at 00:25, Steve Langasek wrote: > On Sat, Mar 17, 2018 at 03:09:55PM +, Dimitri John Ledkov wrote: >> On 16 March 2018 at 22:13, Steve Langasek wrote: >> > In other words: if we want to make this the default, we should quantify >> > Daniel's remark that he would prefer a 6% f

Re: zstd compression for packages

2018-03-20 Thread Steve Langasek
On Sat, Mar 17, 2018 at 03:09:55PM +, Dimitri John Ledkov wrote: > On 16 March 2018 at 22:13, Steve Langasek wrote: > > In other words: if we want to make this the default, we should quantify > > Daniel's remark that he would prefer a 6% faster download over a 10% faster > > unpack. > Well, I

Re: zstd compression for packages

2018-03-19 Thread Julian Andres Klode
On Sat, Mar 17, 2018 at 03:09:55PM +, Dimitri John Ledkov wrote: > On 16 March 2018 at 22:13, Steve Langasek wrote: > > In other words: if we want to make this the default, we should quantify > > Daniel's remark that he would prefer a 6% faster download over a 10% faster > > unpack. > > > > W

Re: zstd compression for packages

2018-03-19 Thread Balint Reczey
Hi All, On Sat, Mar 17, 2018 at 3:09 PM, Dimitri John Ledkov wrote: > On 16 March 2018 at 22:13, Steve Langasek wrote: >> In other words: if we want to make this the default, we should quantify >> Daniel's remark that he would prefer a 6% faster download over a 10% faster >> unpack. >> > > Well,

Re: zstd compression for packages

2018-03-17 Thread Dimitri John Ledkov
On 16 March 2018 at 22:13, Steve Langasek wrote: > In other words: if we want to make this the default, we should quantify > Daniel's remark that he would prefer a 6% faster download over a 10% faster > unpack. > Well, I think it does not make sense to think about this in absolute terms. Thinking

Re: zstd compression for packages

2018-03-16 Thread Steve Langasek
Hi Julian, Thanks for posting about this. I agree that if this is landing in dpkg+apt upstream, it's reasonable to try to get it into the 18.04 release so that it can be used in later releases without needing a dpkg versioned pre-depends. If we are to evaluate using zstd as the default compressi

Re: zstd compression for packages

2018-03-15 Thread Benjamin Tegge
Am Dienstag, den 13.03.2018, 12:07 +1100 schrieb Daniel Axtens: > > > On Tue, Mar 13, 2018 at 1:43 AM, Balint Reczey al.com> wrote: > > Hi Daniel, > > > > On Mon, Mar 12, 2018 at 2:11 PM, Daniel Axtens > > wrote: > > > Hi, > > > > > > I looked into compression algorithms a bit in a previous ro

Re: zstd compression for packages

2018-03-15 Thread Julian Andres Klode
On Wed, Mar 14, 2018 at 02:40:01PM -0300, Marcos Alano wrote: > May be run some tests to find the sweet spot between size and speed? Well, that's what we did, and the sweet spot is -19, the maximum non-ultra level. -- debian developer - deb.li/jak | jak-linux.org - free software dev ubuntu core

Re: zstd compression for packages

2018-03-14 Thread Julian Andres Klode
On Wed, Mar 14, 2018 at 04:09:27PM +0100, Benjamin Tegge wrote: > I want to mention that you can enable ultra compression levels 20 to 22 > in zstd which usually achieve results comparable to the highest > compression levels of xz. There should be a level that matches the > results of xz -6 while s

Re: zstd compression for packages

2018-03-14 Thread Daniel Axtens
On Tue, Mar 13, 2018 at 1:43 AM, Balint Reczey wrote: > Hi Daniel, > > On Mon, Mar 12, 2018 at 2:11 PM, Daniel Axtens > wrote: > > Hi, > > > > I looked into compression algorithms a bit in a previous role, and to be > > honest I'm quite surprised to see zstd proposed for package storage. > zstd,

Re: zstd compression for packages

2018-03-14 Thread Neal Gompa
On Mon, Mar 12, 2018 at 10:09 AM, Julian Andres Klode wrote: > On Mon, Mar 12, 2018 at 09:30:16AM -0400, Neal Gompa wrote: >> On Mon, Mar 12, 2018 at 9:11 AM, Daniel Axtens >> wrote: >> > Hi, >> > >> > I looked into compression algorithms a bit in a previous role, and to be >> > honest I'm quite

Re: zstd compression for packages

2018-03-14 Thread Neal Gompa
On Mon, Mar 12, 2018 at 9:11 AM, Daniel Axtens wrote: > Hi, > > I looked into compression algorithms a bit in a previous role, and to be > honest I'm quite surprised to see zstd proposed for package storage. zstd, > according to its own github repo, is "targeting real-time compression > scenarios"

Re: zstd compression for packages

2018-03-12 Thread Colin Watson
On Mon, Mar 12, 2018 at 03:36:11PM +0100, Julian Andres Klode wrote: > Acknowledged. I don't think we want to go ahead without dpkg upstream > blessing anyway. On the APT side, we don't maintain Ubuntu-only branches, > so if we get a go-ahead it would land in Debian immediately too. Good. > I had

Re: zstd compression for packages

2018-03-12 Thread Balint Reczey
Hi Daniel, On Mon, Mar 12, 2018 at 2:11 PM, Daniel Axtens wrote: > Hi, > > I looked into compression algorithms a bit in a previous role, and to be > honest I'm quite surprised to see zstd proposed for package storage. zstd, > according to its own github repo, is "targeting real-time compression

Re: zstd compression for packages

2018-03-12 Thread Julian Andres Klode
On Mon, Mar 12, 2018 at 02:19:18PM +, Colin Watson wrote: > On Mon, Mar 12, 2018 at 10:02:49AM -0400, Jeremy Bicha wrote: > > On Mon, Mar 12, 2018 at 6:06 AM, Julian Andres Klode > > wrote: > > > We are considering requesting a FFe for that - the features are not > > > invasive, and it allows

Re: zstd compression for packages

2018-03-12 Thread Colin Watson
On Mon, Mar 12, 2018 at 10:02:49AM -0400, Jeremy Bicha wrote: > On Mon, Mar 12, 2018 at 6:06 AM, Julian Andres Klode > wrote: > > We are considering requesting a FFe for that - the features are not > > invasive, and it allows us to turn it on by default in 18.10. > > What does Debian's dpkg maint

Re: zstd compression for packages

2018-03-12 Thread Robie Basak
On Mon, Mar 12, 2018 at 03:05:13PM +0100, Julian Andres Klode wrote: > On Mon, Mar 12, 2018 at 01:49:42PM +, Robie Basak wrote: > > On Mon, Mar 12, 2018 at 11:06:11AM +0100, Julian Andres Klode wrote: > > > We are considering requesting a FFe for that - the features are not > > > invasive, and

Re: zstd compression for packages

2018-03-12 Thread Julian Andres Klode
On Mon, Mar 12, 2018 at 10:02:49AM -0400, Jeremy Bicha wrote: > On Mon, Mar 12, 2018 at 6:06 AM, Julian Andres Klode > wrote: > > We are considering requesting a FFe for that - the features are not > > invasive, and it allows us to turn it on by default in 18.10. > > What does Debian's dpkg maint

Re: zstd compression for packages

2018-03-12 Thread Julian Andres Klode
On Mon, Mar 12, 2018 at 09:30:16AM -0400, Neal Gompa wrote: > On Mon, Mar 12, 2018 at 9:11 AM, Daniel Axtens > wrote: > > Hi, > > > > I looked into compression algorithms a bit in a previous role, and to be > > honest I'm quite surprised to see zstd proposed for package storage. zstd, > > accordin

Re: zstd compression for packages

2018-03-12 Thread Julian Andres Klode
On Mon, Mar 12, 2018 at 01:49:42PM +, Robie Basak wrote: > On Mon, Mar 12, 2018 at 11:06:11AM +0100, Julian Andres Klode wrote: > > We are considering requesting a FFe for that - the features are not > > invasive, and it allows us to turn it on by default in 18.10. > > libzstd has only been s

Re: zstd compression for packages

2018-03-12 Thread Jeremy Bicha
On Mon, Mar 12, 2018 at 6:06 AM, Julian Andres Klode wrote: > We are considering requesting a FFe for that - the features are not > invasive, and it allows us to turn it on by default in 18.10. What does Debian's dpkg maintainer think? Thanks, Jeremy Bicha -- ubuntu-devel mailing list ubuntu-d

Re: zstd compression for packages

2018-03-12 Thread Robie Basak
On Mon, Mar 12, 2018 at 11:06:11AM +0100, Julian Andres Klode wrote: > We are considering requesting a FFe for that - the features are not > invasive, and it allows us to turn it on by default in 18.10. libzstd has only been stable in the archive since Artful. We had to SRU fixes to Xenial becaus

Re: zstd compression for packages

2018-03-12 Thread Daniel Axtens
Hi, I looked into compression algorithms a bit in a previous role, and to be honest I'm quite surprised to see zstd proposed for package storage. zstd, according to its own github repo, is "targeting real-time compression scenarios". It's not really designed to be run at its maximum compression le

Re: zstd compression for packages

2018-03-12 Thread Julian Andres Klode
On Mon, Mar 12, 2018 at 11:06:11AM +0100, Julian Andres Klode wrote: > Hey folks, > > We had a coding day in Foundations last week and Balint and Julian added > support for zstd compression to dpkg [1] and apt [2]. > > [1] https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=892664 > [2] https://sa