Re: [GRASS-dev] GRASS_COMPRESSOR=BZIP2 in winGRASS
>> r.in.gdal and GRASS_COMPRESSOR=BZIP2 and GRASS_INT_ZLIB=9 > >Note that GRASS_INT_ZLIB affects only ZLIB compression. copy/paste error; should be added to the sentence before: GRASS_COMPRESSOR=ZLIB and GRASS_INT_ZLIB=9 >If you want to save a lot of disk space, you can convert FCELL maps to >CELL maps, e.g. for temperature values rounding to Celsius * 10, then >check again which compressor best fits your needs. In previous tests I >found that BZIP2 only gives me a disk space advantage for large maps >with >1 columns. Also, it seems that BZIP2 might compress integer >maps better than fp maps. will try to convert and test size. thanks. - best regards Helmut -- View this message in context: http://osgeo-org.1560.x6.nabble.com/GRASS-COMPRESSOR-BZIP2-in-winGRASS-tp5286534p5286838.html Sent from the Grass - Dev mailing list archive at Nabble.com. ___ grass-dev mailing list grass-dev@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/grass-dev
Re: [GRASS-dev] GRASS_COMPRESSOR=BZIP2 in winGRASS
On Mon, Sep 19, 2016 at 9:49 PM, Helmut Kudrnovsky wrote: [...] > > - > original geotif with gdal_translate -co COMPRESS=LZW -co PREDICTOR=2 > > ls -l > total 279600 > -rw-r--r-- 1 88170601 Sep 19 19:07 CHELSA_bio01_1979-2013_V1_1_eur.tif > -rw-r--r-- 1 56511749 Sep 19 19:13 CHELSA_bio02_1979-2013_V1_1_eur.tif > -rw-r--r-- 1 69376203 Sep 19 19:16 CHELSA_bio03_1979-2013_V1_1_eur.tif > -rw-r--r-- 1 72247104 Sep 19 19:19 CHELSA_bio04_1979-2013_V1_1_eur.tif > > - > r.in.gdal and GRASS_COMPRESSOR=ZLIB > > ls -l > total 305909 > -rw-r--r-- 1 82287638 Sep 19 19:28 CHELSA_bio01_zlib > -rw-r--r-- 1 77139587 Sep 19 19:28 CHELSA_bio02_zlib > -rw-r--r-- 1 74791532 Sep 19 19:28 CHELSA_bio03_zlib > -rw-r--r-- 1 79030011 Sep 19 19:28 CHELSA_bio04_zlib > > - > r.in.gdal and GRASS_COMPRESSOR=BZIP2 and GRASS_INT_ZLIB=9 Note that GRASS_INT_ZLIB affects only ZLIB compression. > > ls -l > total 311983 > -rw-r--r-- 1 84163200 Sep 19 19:21 CHELSA_bio01 > -rw-r--r-- 1 78882189 Sep 19 19:22 CHELSA_bio02 > -rw-r--r-- 1 74892325 Sep 19 19:22 CHELSA_bio03 > -rw-r--r-- 1 81530621 Sep 19 19:22 CHELSA_bio04 > > --- > > at least in this case of data, r.external to '-co COMPRESS=LZW -co > PREDICTOR=2' geotiffs saves more disk space than import (regardless of the > GRASS_COMPRESSOR). If you want to save a lot of disk space, you can convert FCELL maps to CELL maps, e.g. for temperature values rounding to Celsius * 10, then check again which compressor best fits your needs. In previous tests I found that BZIP2 only gives me a disk space advantage for large maps with >1 columns. Also, it seems that BZIP2 might compress integer maps better than fp maps. Markus M ___ grass-dev mailing list grass-dev@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/grass-dev
Re: [GRASS-dev] GRASS_COMPRESSOR=BZIP2 in winGRASS
Helmut Kudrnovsky wrote > Hi, > >>2016-09-18 20:04 GMT+02:00 Markus Neteler < > neteler@ > >: "GRASS needs to be compiled with BZIP2 for BZIP2 compression" ? >>> >>> I checked >>> https://wingrass.fsv.cvut.cz/grass73/x86_64/logs/log-r69510-8/ >>> BZIP2 support: no >>> >>> That's why it is at time not included in winGRASS... >> >>bzlib2 support activated in trunk (r69517). Let's check the next >>WinGRASS build. Martin > > tested with today's winGRASS daily: > --- > echo %GRASS_COMPRESSOR% > BZIP2 > > r.mapcalc expression=checkcompression = elevation@PERMANENT / 2 > > r.compress -p map=checkcompression@checkbzip2 > > > is compressed (method 4: BZIP2). Data type: FCELL > --- > > thanks for activating BZIP2 compression. some tests with different compressors: r.info map=CHELSA_bio01@chelsa_bioclim ++ | Map: CHELSA_bio01@chelsa_bioclimDate: Mon Sep 19 21:21:59 2016 | | Mapset: chelsa_bioclim Login of Creator: hkmyr | | Location: loc_epsg4326 | | DataBase: D:\grassdata | | Title:CHELSA_bio01 | | Timestamp: none | || | | | Type of Map: raster Number of Categories: 0 | | Data Type:FCELL | | Rows: 4920 | | Columns: 8160 | | Total Cells: 40147200 | |Projection: Längen- und Breitengrad | |N:73NS:32N Res: 0:00:30 | |E:54EW:14W Res: 0:00:30 | | Range of data:min = -16.2343 max = 26.04194 | | | | Data Description: | |generated by r.in.gdal | | | | Comments: | |r.in.gdal -k input="D:\gis_data_climate\chelsa\CHELSA_bio01_1979-201\ | |3_V1_1_eur.tif" output="CHELSA_bio01" memory=300 offset=0 num_digits=0 | | | ++ r.info map=CHELSA_bio02@chelsa_bioclim ++ | Map: CHELSA_bio02@chelsa_bioclimDate: Mon Sep 19 21:22:17 2016 | | Mapset: chelsa_bioclim Login of Creator: hkmyr | | Location: loc_epsg4326 | | DataBase: D:\grassdata | | Title:CHELSA_bio02 | | Timestamp: none | || | | | Type of Map: raster Number of Categories: 0 | | Data Type:FCELL | | Rows: 4920 | | Columns: 8160 | | Total Cells: 40147200 | |Projection: Längen- und Breitengrad | |N:73NS:32N Res: 0:00:30 | |E:54EW:14W Res: 0:00:30 | | Range of data:min = 6.353987 max = 27.25062 | | | | Data Description: | |generated by r.in.gdal | | | | Comments: | |r.in.
Re: [GRASS-dev] GRASS_COMPRESSOR=BZIP2 in winGRASS
Hi, >2016-09-18 20:04 GMT+02:00 Markus Neteler : >>> "GRASS needs to be compiled with BZIP2 for BZIP2 compression" >>> ? >> >> I checked >> https://wingrass.fsv.cvut.cz/grass73/x86_64/logs/log-r69510-8/ >> BZIP2 support: no >> >> That's why it is at time not included in winGRASS... > >bzlib2 support activated in trunk (r69517). Let's check the next >WinGRASS build. Martin tested with today's winGRASS daily: --- echo %GRASS_COMPRESSOR% BZIP2 r.mapcalc expression=checkcompression = elevation@PERMANENT / 2 r.compress -p map=checkcompression@checkbzip2 is compressed (method 4: BZIP2). Data type: FCELL --- thanks for activating BZIP2 compression. best Helmut ___ grass-dev mailing list grass-dev@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/grass-dev
Re: [GRASS-dev] GRASS_COMPRESSOR=BZIP2 in winGRASS
Hi, 2016-09-19 16:14 GMT+02:00 Helmut Kudrnovsky : > r.compress -p map=checkcompression@checkbzip2 > is compressed (method 4: BZIP2). Data type: FCELL > --- > > thanks for activating BZIP2 compression. OK, I activated BZIP2 compression also in relbr72 (r69534). Could you please test it also with the next build of GRASS 7.2? Thanks, Martin -- Martin Landa http://geo.fsv.cvut.cz/gwiki/Landa http://gismentors.cz/mentors/landa ___ grass-dev mailing list grass-dev@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/grass-dev
Re: [GRASS-dev] GRASS_COMPRESSOR=BZIP2 in winGRASS
Hi, 2016-09-18 20:04 GMT+02:00 Markus Neteler : >> "GRASS needs to be compiled with BZIP2 for BZIP2 compression" >> ? > > I checked > https://wingrass.fsv.cvut.cz/grass73/x86_64/logs/log-r69510-8/ > BZIP2 support: no > > That's why it is at time not included in winGRASS... bzlib2 support activated in trunk (r69517). Let's check the next WinGRASS build. Martin -- Martin Landa http://geo.fsv.cvut.cz/gwiki/Landa http://gismentors.cz/mentors/landa ___ grass-dev mailing list grass-dev@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/grass-dev
Re: [GRASS-dev] GRASS_COMPRESSOR=BZIP2 in winGRASS
On Sun, Sep 18, 2016 at 7:53 PM, Markus Neteler wrote: > On Sun, Sep 18, 2016 at 7:41 PM, Helmut Kudrnovsky wrote: >> Hi, >> >> experimentally I've tried set GRASS_COMPRESSOR=BZIP2 in today's >> OSGeo4W-wingrass7.3 (trunk). >> >> By writing a raster map, I got the message, that BZIP2 grass compresser >> isn't implemented in this grass version. > > What is the exact error message? This one: > > "GRASS needs to be compiled with BZIP2 for BZIP2 compression" > ? I checked https://wingrass.fsv.cvut.cz/grass73/x86_64/logs/log-r69510-8/ BZIP2 support: no That's why it is at time not included in winGRASS... Markus ___ grass-dev mailing list grass-dev@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/grass-dev
Re: [GRASS-dev] GRASS_COMPRESSOR=BZIP2 in winGRASS
On Sun, Sep 18, 2016 at 7:41 PM, Helmut Kudrnovsky wrote: > Hi, > > experimentally I've tried set GRASS_COMPRESSOR=BZIP2 in today's > OSGeo4W-wingrass7.3 (trunk). > > By writing a raster map, I got the message, that BZIP2 grass compresser > isn't implemented in this grass version. What is the exact error message? This one: "GRASS needs to be compiled with BZIP2 for BZIP2 compression" ? Markus ___ grass-dev mailing list grass-dev@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/grass-dev
