Re: [GRASS-dev] GRASS GIS raster files: LZW compression?

2017-12-05 Thread Luca Delucchi
On 5 December 2017 at 14:45, Markus Metz wrote: > > > ZSTD compression is a new feature and the changes are not trivial, > considering the changesets for r71889, r71890, r71891. There is a minimal > chance to get ZSTD compression in 7.4. GRASS 7.4.0 is not yet out,

Re: [GRASS-dev] GRASS GIS raster files: LZW compression?

2017-12-05 Thread Markus Metz
.08 > To: Markus Metz <markus.metz.gisw...@gmail.com> > Cc: GRASS developers list <grass-dev@lists.osgeo.org> > Subject: Re: [GRASS-dev] GRASS GIS raster files: LZW compression? > > On Mon, Dec 4, 2017 at 7:32 PM, Markus Metz <markus.metz.gisw...@gmail.com> wrote: > >

Re: [GRASS-dev] GRASS GIS raster files: LZW compression?

2017-12-05 Thread Nikos Alexandris
* Markus Neteler [2017-12-05 10:08:00 +0100]: On Mon, Dec 4, 2017 at 7:32 PM, Markus Metz wrote: ZSTD compression has been added to trunk with r71889-92. Great! ZSTD compression can be added with configure --with-zstd=yes or simpler

Re: [GRASS-dev] GRASS GIS raster files: LZW compression?

2017-12-05 Thread Stefan Blumentrath
<markus.metz.gisw...@gmail.com> Cc: GRASS developers list <grass-dev@lists.osgeo.org> Subject: Re: [GRASS-dev] GRASS GIS raster files: LZW compression? On Mon, Dec 4, 2017 at 7:32 PM, Markus Metz <markus.metz.gisw...@gmail.com> wrote: > ZSTD compression has been added to trunk w

Re: [GRASS-dev] GRASS GIS raster files: LZW compression?

2017-12-05 Thread Markus Neteler
On Mon, Dec 4, 2017 at 7:32 PM, Markus Metz wrote: > ZSTD compression has been added to trunk with r71889-92. Great! > ZSTD compression can be added with configure --with-zstd=yes or simpler > configure --with-zstd > > In order to get some wider testing, ZSTD is

Re: [GRASS-dev] GRASS GIS raster files: LZW compression?

2017-12-04 Thread Helmut Kudrnovsky
Markus Metz-3 wrote > ZSTD compression has been added to trunk with r71889-92. > > ZSTD compression can be added with configure --with-zstd=yes or simpler > configure --with-zstd > > In order to get some wider testing, ZSTD is now the default compression > method in trunk if ZSTD is available. >

Re: [GRASS-dev] GRASS GIS raster files: LZW compression?

2017-12-04 Thread Markus Metz
ZSTD compression has been added to trunk with r71889-92. ZSTD compression can be added with configure --with-zstd=yes or simpler configure --with-zstd In order to get some wider testing, ZSTD is now the default compression method in trunk if ZSTD is available. ZSTD is an improvement over ZLIB:

Re: [GRASS-dev] GRASS GIS raster files: LZW compression?

2017-12-02 Thread Markus Neteler
On Tue, Oct 31, 2017 at 8:35 PM, Markus Metz wrote: > On Tue, Oct 31, 2017 at 12:16 PM, Markus Neteler wrote: >> >> On Mon, Oct 30, 2017 at 9:58 AM, Markus Metz >> wrote: >> ... >> > Some more tests: >> > corine

Re: [GRASS-dev] GRASS GIS raster files: LZW compression?

2017-10-31 Thread Markus Metz
On Tue, Oct 31, 2017 at 12:16 PM, Markus Neteler wrote: > > On Mon, Oct 30, 2017 at 9:58 AM, Markus Metz > wrote: > ... > > Some more tests: > > corine land cover 250 meter, relatively small, easy to compress Byte type > > LZ4: 33 sec, 54 MB > >

Re: [GRASS-dev] GRASS GIS raster files: LZW compression?

2017-10-31 Thread Markus Neteler
On Mon, Oct 30, 2017 at 9:58 AM, Markus Metz wrote: ... > Some more tests: > corine land cover 250 meter, relatively small, easy to compress Byte type > LZ4: 33 sec, 54 MB > ZLIB level 1: 36 sec, 39 MB > ZSTD level 3: 34 sec, 29 MB > > GMTED2010 for the corine

Re: [GRASS-dev] GRASS GIS raster files: LZW compression?

2017-10-30 Thread Markus Metz
On Fri, Oct 27, 2017 at 10:44 PM, Markus Metz wrote: > > > > On Thu, Oct 26, 2017 at 7:23 PM, Even Rouault wrote: > > > > On jeudi 26 octobre 2017 18:57:10 CEST Markus Neteler wrote: > > > > > On Thu, Oct 26, 2017 at 9:25 AM, Markus Metz

Re: [GRASS-dev] GRASS GIS raster files: LZW compression?

2017-10-27 Thread Markus Metz
On Thu, Oct 26, 2017 at 7:23 PM, Even Rouault wrote: > > On jeudi 26 octobre 2017 18:57:10 CEST Markus Neteler wrote: > > > On Thu, Oct 26, 2017 at 9:25 AM, Markus Metz > > > > > > wrote: > > > > On Wed, Oct 25, 2017 at 10:40 PM, Markus

Re: [GRASS-dev] GRASS GIS raster files: LZW compression?

2017-10-27 Thread Markus Neteler
On Thu, Oct 26, 2017 at 8:01 PM, Seth Price wrote: > > Also, it's worth remembering that LZ4 is not intended for file size. It's > there because it > decompresses at least an order of magnitude faster than LZW. Yes, I am using LZ4 as the default for our data in order to gain

Re: [GRASS-dev] GRASS GIS raster files: LZW compression?

2017-10-26 Thread Seth Price
Also, it's worth remembering that LZ4 is not intended for file size. It's there because it decompresses at least an order of magnitude faster than LZW. On Thu, Oct 26, 2017 at 10:23 AM, Even Rouault wrote: > On jeudi 26 octobre 2017 18:57:10 CEST Markus Neteler

Re: [GRASS-dev] GRASS GIS raster files: LZW compression?

2017-10-26 Thread Even Rouault
On jeudi 26 octobre 2017 18:57:10 CEST Markus Neteler wrote: > On Thu, Oct 26, 2017 at 9:25 AM, Markus Metz > > wrote: > > On Wed, Oct 25, 2017 at 10:40 PM, Markus Neteler wrote: > >> Hi devs, > >> > >> while playing with the SRTM 30m world I

Re: [GRASS-dev] GRASS GIS raster files: LZW compression?

2017-10-26 Thread Markus Neteler
On Thu, Oct 26, 2017 at 9:25 AM, Markus Metz wrote: > On Wed, Oct 25, 2017 at 10:40 PM, Markus Neteler wrote: >> >> Hi devs, >> >> while playing with the SRTM 30m world I see that there is a difference >> of 66GB in size between LZ4 (larger) and

Re: [GRASS-dev] GRASS GIS raster files: LZW compression?

2017-10-26 Thread Markus Metz
On Wed, Oct 25, 2017 at 10:40 PM, Markus Neteler wrote: > > Hi devs, > > while playing with the SRTM 30m world I see that there is a difference > of 66GB in size between LZ4 (larger) and DEFLATE (smaller). While this > is not a surprise I was wondering if LZW compression could

[GRASS-dev] GRASS GIS raster files: LZW compression?

2017-10-25 Thread Markus Neteler
Hi devs, while playing with the SRTM 30m world I see that there is a difference of 66GB in size between LZ4 (larger) and DEFLATE (smaller). While this is not a surprise I was wondering if LZW compression could be brought back. AFAIK the license issue is gone for a while and indeed GRASS got a