Re: [gdal-dev] Metadata keys in upper or lower case ?

2023-01-30 Thread Even Rouault
Louis-Philippe, there's no recommendation. Each format or community within a format may have different practices. Some formats may accept some odd characters (but definitely not '=', as key/value pairs are stored as "key=value" strings internally), but keeping to alphanumeric + underscore

Re: [gdal-dev] Motion: adopt RFC 91: GDALDataset::Close() method

2023-01-30 Thread Even Rouault
Hi, I declare this motion passed with +1 from PSC members KurtS, MateuszL and me, and +0 from JukkaR Even Le 25/01/2023 à 12:56, Even Rouault a écrit : Hi, Motion: adopt RFC 91: GDALDataset::Close() method https://github.com/OSGeo/gdal/pull/7108 Starting with my +1, Even -- http

Re: [gdal-dev] Bad GDB performance

2023-01-27 Thread Even Rouault
No, a third party tool created the layer. If necessary I can contact the developer. That could indeed be interesting to know how they set the CRS to the layer. From different bug reports, I've the feeling that there are different aliases in the ESRI CRS world that aren't fully captured in

Re: [gdal-dev] Bad GDB performance

2023-01-27 Thread Even Rouault
quot;,1.0],PARAMETER["Latitude_Of_Origin",0.0],UNIT["Meter",1.0]] Which version of ArcMap / ArcGIS was used to produce this GDB ? Even Le 27/01/2023 à 14:34, Simon Gröchenig a écrit : Hi Even, great, thank you! Is the GDB itself fine? Or is there something I can do to fix the database?

Re: [gdal-dev] Bad GDB performance

2023-01-27 Thread Even Rouault
Hi Simon, fix queued in https://github.com/OSGeo/gdal/pull/7131 Even Le 27/01/2023 à 06:49, Simon Gröchenig a écrit : Hi all, I am struggling with a bad performance at reading FileGeodatabases in QGIS. I hope, this is the place where I can find someone to help me find the bottleneck. I

Re: [gdal-dev] Announcing SOZip: Seek-Optimized profile for the .zip format

2023-01-26 Thread Even Rouault
GeoPackage file (filenames to adapt of course): sozip -j output.gpkg.zip /path/to/input.gpkg qgis output.gpkg.zip Even Le 09/01/2023 à 15:19, Even Rouault a écrit : Hi, It is my pleasure to announce ( https://github.com/sozip/sozip-spec/blob/master/blog/01-announcement.md ) the initial release

Re: [gdal-dev] GDAL Overestimating Physical Memory

2023-01-26 Thread Even Rouault
r but they are still beholden to the host rules. I am not sure how free & /proc/memory are getting the correct available memory but maybe I will ask the proxmox or LXD people. Thanks again, Angus On Wed, Jan 25, 2023 at 4:49 AM Even Rouault wrote: Angus, I'm

[gdal-dev] Motion: adopt RFC 91: GDALDataset::Close() method

2023-01-25 Thread Even Rouault
Hi, Motion: adopt RFC 91: GDALDataset::Close() method https://github.com/OSGeo/gdal/pull/7108 Starting with my +1, Even -- http://www.spatialys.com My software is free, but my time generally not. ___ gdal-dev mailing list gdal-dev@lists.osgeo.org

Re: [gdal-dev] GDAL Overestimating Physical Memory

2023-01-25 Thread Even Rouault
ision like proxmox (what I am using) and call CPLGetUsablePhysicalRAM(). If there is any other info that might be helpful let me know. I might try a Docker container (it also uses cgroups) and is more popular than LXC, although it fulfills a different function. thanks, Angus On Tue, Jan 24

Re: [gdal-dev] GDAL Overestimating Physical Memory

2023-01-24 Thread Even Rouault
Angus, there has been a recent extra fix that landed in GDAL 3.6.2 that might possibly help: https://github.com/OSGeo/gdal/pull/6926 Even Le 25/01/2023 à 01:36, Angus Dickey a écrit : Hi all, I am running into an issue where GDAL is overestimating the amount of physical memory it has

Re: [gdal-dev] Build difficulties (Ubuntu 20.04)

2023-01-23 Thread Even Rouault
Anja, the minimum will be to install PROJ with: apt-get install libproj-dev For a build with nearly all open source dependencies, you can find the list to install in https://github.com/OSGeo/gdal/blob/5db56957dd9b5d00098f5ac8abb75a3c756cc0aa/.github/workflows/cmake_builds.yml#L57 You can

Re: [gdal-dev] near identical files being treated differently

2023-01-23 Thread Even Rouault
Ken, if you do "gdalinfo --debug on GLMELT_4X5.OCN.nc", you'll see GDAL_netCDF: Latitude/Y is not equally spaced (with a 0.05% tolerance). You may set the GDAL_NETCDF_IGNORE_EQUALLY_SPACED_XY_CHECK configuration option to YES to ignore this check and indeed $ ncdump -v lat

[gdal-dev] Call for review on RFC 91: GDALDataset::Close() method

2023-01-20 Thread Even Rouault
Hi, Just to notify you that "RFC 91: GDALDataset::Close() method" is available for review in https://github.com/OSGeo/gdal/pull/7108 Admittedly, nothing particularly exciting, but this should provide GDAL users with better error detection. Even -- http://www.spatialys.com My software is

Re: [gdal-dev] Any trick to run SELECT gdal_get_pixel_value for lots of points?

2023-01-19 Thread Even Rouault
Hi Jukka, Recursive Common Table Expressions (CTE) (cf "3.1. Recursive Query Examples" of https://www.sqlite.org/lang_with.html) can help if you want to sample along one or two axis Below an example for x in [1,3] and y in [1,4] $ ogr2ogr -of CSV /vsistdout/ :memory: -sql "WITH RECURSIVE

Re: [gdal-dev] Motion: Approve RFC90: Direct access to compressed raster data

2023-01-19 Thread Even Rouault
Hi, I declare this motion passed with +1 from PSC members JukkaR, FrankW, SeanG, MateuzL and me. Even Le 16/01/2023 à 18:02, Even Rouault a écrit : Hi, Motion: Approve RFC90: Direct access to compressed raster data: https://github.com/OSGeo/gdal/pull/7020 Starting with my +1 Even

Re: [gdal-dev] Parsing s57 chart with GDAL.

2023-01-19 Thread Even Rouault
Aryan, You likely need to register the drivers with GDALAllRegister(): https://gdal.org/tutorials/vector_api_tut.html#reading-from-ogr Even Le 19/01/2023 à 13:23, Aryan Landi a écrit : Hi all, I am unable to use the GDAL/OGR S57 driver to parse s57 charts. According to the official

Re: [gdal-dev] How to extract field domains from a gdb

2023-01-17 Thread Even Rouault
Hi, I don't think we have a ready-made utility for that, so you'll have to write code using the field domain API: https://gdal.org/doxygen/classOGRCodedFieldDomain.html and https://gdal.org/doxygen/classGDALDataset.html#a64d001fa0fe53c6aa51e983ca14bad39 With GDAL master, it might also be

Re: [gdal-dev] Interaction between no data and resampling

2023-01-16 Thread Even Rouault
hopefully https://github.com/OSGeo/gdal/pull/7077 should answer your question. You'll note subtle differences of behavior between gdalwarp on one side and gdaladdo/gdal_translate on the other side Even Le 16/01/2023 à 13:32, Laurențiu Nicola via gdal-dev a écrit : PPS: Looks like some

Re: [gdal-dev] Motion: Approve RFC90: Direct access to compressed raster data

2023-01-16 Thread Even Rouault
H Sean, If we don't want to think about official media types at all, which might be a good idea, couldn't we use driver names instead? "JPEG; foo=bar" instead of "image/jpeg; foo=bar" for example. Initially I had used driver names + a char** papszOptions for ReadCompressedData(), but I

[gdal-dev] Motion: Approve RFC90: Direct access to compressed raster data

2023-01-16 Thread Even Rouault
Hi, Motion: Approve RFC90: Direct access to compressed raster data: https://github.com/OSGeo/gdal/pull/7020 Starting with my +1 Even -- http://www.spatialys.com My software is free, but my time generally not. ___ gdal-dev mailing list

Re: [gdal-dev] gdal git - Test 28 test-virtual-memory (SEGFAULT)

2023-01-12 Thread Even Rouault
fixed per https://github.com/OSGeo/gdal/pull/7058 Even Le 12/01/2023 à 23:23, Andrew C Aitchison a écrit : On Thu, 12 Jan 2023, Even Rouault wrote: Andrew, how did you get clang 15.0.2 on Ubuntu 21:10 ? Not through the apt package manager with the default apt repositories, right ? Because

Re: [gdal-dev] gdal git - Test 28 test-virtual-memory (SEGFAULT)

2023-01-12 Thread Even Rouault
Andrew, how did you get clang 15.0.2 on Ubuntu 21:10 ? Not through the apt package manager with the default apt repositories, right ? Because I've just tried with ubuntu 22.04 and this is only clang 14.0.0 that gets distributed, and the test runs fine. That said, I'm moderately surprised

Re: [gdal-dev] feet converting to meters unexpectedly

2023-01-09 Thread Even Rouault
Survey Foot) Even -Jukka Rahkonen- *Lähettäjä:*gdal-dev *Puolesta *Even Rouault *Lähetetty:* maanantai 9. tammikuuta 2023 21.10 *Vastaanottaja:* Kirk Waters - NOAA Federal ; gdal-dev@lists.osgeo.org *Aihe:* Re: [gdal-dev] feet converting to meters unexpectedly Hi, This is indeed https

Re: [gdal-dev] feet converting to meters unexpectedly

2023-01-09 Thread Even Rouault
I should also mention that you can probably workaround the issue by adding the -novshift switch to your gdalwarp command line: https://gdal.org/programs/gdalwarp.html#cmdoption-gdalwarp-novshift Le 09/01/2023 à 20:10, Even Rouault a écrit : Hi, This is indeed https://github.com/OSGeo/gdal

Re: [gdal-dev] feet converting to meters unexpectedly

2023-01-09 Thread Even Rouault
Hi, This is indeed https://github.com/OSGeo/gdal/issues/6839 which has been fixed in GDAL 3.6.1. Even Le 09/01/2023 à 19:48, Kirk Waters - NOAA Federal via gdal-dev a écrit : I think I've gotten this solved for my purposes now, but I'm reporting it here in case anyone else might run across

Re: [gdal-dev] Announcing SOZip: Seek-Optimized profile for the .zip format

2023-01-09 Thread Even Rouault
Le 09/01/2023 à 15:29, Alessandro Pasotti a écrit : Thank you! This is amazing. Will it be enabled by default? Yes, the current strategy implemented in the PR is to enable it by default when adding files larger than 1 MB through the new CPLAddFileInZip() function, which is used when using

[gdal-dev] Announcing SOZip: Seek-Optimized profile for the .zip format

2023-01-09 Thread Even Rouault
Hi, It is my pleasure to announce ( https://github.com/sozip/sozip-spec/blob/master/blog/01-announcement.md ) the initial release of the specification ( https://github.com/sozip/sozip-spec/blob/master/sozip_specification.md ) for the SOZip (Seek-Optimized Zip) profile to the ZIP file format,

Re: [gdal-dev] GML driver - gfs geometry type values and supported GML geometry types

2023-01-05 Thread Even Rouault
The possible reason, that this may be due to a lack of mapping between OGR and QGIS geometry types, is quite intriguing. I tried to find out more on the web, and came across https://github.com/qgis/QGIS/blob/master/src/core/providers/ogr/qgsogrprovider.cpp (if that is the right place to look

Re: [gdal-dev] vsicurl and HDF5

2023-01-05 Thread Even Rouault
Paolo, Le 05/01/2023 à 17:56, Paolo Corti a écrit : Hi all Do you know if I can read HDF5 files with vsicurl? I made a few tests, but I am getting this error, so I was wondering it it is even possible: yes this is possible. If you get the error message you mention, it means that the HDF5

[gdal-dev] Call for review and comments on RFC90: Direct access to compressed raster data

2023-01-05 Thread Even Rouault
Hi, I've submitted RFC90: Direct access to compressed raster data for review and comments:         https://github.com/OSGeo/gdal/pull/7020 Summary: """ The document proposes 2 new methods to directly obtain the content of a window of interest of a raster dataset in its native compressed

Re: [gdal-dev] GML driver - gfs geometry type values and supported GML geometry types

2023-01-05 Thread Even Rouault
Johannes, this is more an issue on QGIS side, in its OGR provider where there's likely a lack of mapping between the OGR geometry types and QGIS geometry types for Curve and Surface (just guessing, didn't check). The root cause is that Curve and Surface in OGC/ISO specs are abstract types

[gdal-dev] GDAL 3.6.2 is released

2023-01-04 Thread Even Rouault
Hi, On behalf of the GDAL/OGR development team, I am pleased to announce the release of the GDAL/OGR 3.6.2 bug fix version (promoting rc1 to final) Consult the release notes for the list of issues addressed:   https://github.com/OSGeo/gdal/blob/v3.6.2/NEWS.md The sources are available at:   

Re: [gdal-dev] GDAL bindings support for Java 17

2023-01-03 Thread Even Rouault
Adam, I cannot help with Mac specificities, but on Ubuntu 20.04, after "sudo apt install openjdk-17-jdk openjdk-17-jre", the GDAL Java bindings build work just fine and the Java tests run with "ctest -R java" as well. Even Le 03/01/2023 à 18:33, adamgutonski via gdal-dev a écrit : Hello,

Re: [gdal-dev] GetAreaOfUse() and EPSG:29902

2023-01-03 Thread Even Rouault
Simon, epsg.io is not a reference site. You should rather consult epsg.org For CRS EPSG:29902, it refers to extent https://epsg.org/extent_3767/Ireland-onshore.html which has -5.93° as east longitude https://epsg.org/extent_1305/Europe-Ireland-Republic-and-Ulster-onshore.html has -5.34° as

[gdal-dev] GDAL 3.6.2 rc1 available

2023-01-02 Thread Even Rouault
Hi, To celebrate the New Year, another ahead of planned schedule release candidate, mostly to address another issue (https://github.com/OSGeo/gdal/pull/6959) when generating multi-layer GeoPackage files, related to multi-threaded RTree building added in 3.6.0. Pick up an archive among the

Re: [gdal-dev] VSIFGetc and VSIFReadL

2022-12-31 Thread Even Rouault
Andrew, Le 31/12/2022 à 12:39, Andrew C Aitchison a écrit : My plugin driver uses both VSIFGetc and VSIFReadL/VSIFWriteL on the same stream*. Aouch ! Surprising you didn't get crashes ! A VSILFILE* is a very different object from a FILE*, and invoking VSIFGetc() on a VSILFILE* cannot work.

Re: [gdal-dev] Error using gdalinfo v 3.5.0 for jp2 (Sentinel-2) data on LINUX

2022-12-25 Thread Even Rouault
Hi, Is not  gdal v 3.5.0 supposed to read SENTINEL-2 data (jp2)  ok? ""Driver built-in by default according to https://gdal.org/drivers/raster/sentinel2.html#raster-sentinel2 The Sentinel2 driver is indeed built-in, but it requires one of the JPEG2000 capable drivers to be also available at

Re: [gdal-dev] ogr gml Box handling

2022-12-22 Thread Even Rouault
Andrew, the GMLAS driver will fetch it as a string: $ ogrinfo GMLAS:input.gml -oo remove_unused_layers=yes -al -q Warning 1: Unhandled type: gMonthDay Warning 1: Unhandled type: gMonthDay Layer name: departedfeature OGRFeature(departedfeature):1   ogr_pkid (String) =

Re: [gdal-dev] Motion: adopt RFC89: SQL query logging callback

2022-12-21 Thread Even Rouault
This motion is passed with +1 from PSC members MateuszL, JukkaR, TamasS and me. Even Le 12/12/2022 à 15:10, ElPaso a écrit : Hi, Motion: Adopt  RFC89: SQL query logging callback [1] A draft implementation is available at [2]. An example of how client code could make use of this new

Re: [gdal-dev] Advanced 3.6.1 release and retraction of 3.6.0 ?

2022-12-21 Thread Even Rouault
at the beginning of next year when everyone is back from their break. Even Le 13/12/2022 à 16:18, Even Rouault via gdal-dev a écrit : Hi, https://github.com/qgis/QGIS/issues/51188 has been brought to my attention. The issue is that the new background building of the RTree of GeoPackage files

Re: [gdal-dev] Motion: adopt RFC89: SQL query logging callback

2022-12-19 Thread Even Rouault
It would be great if a few other PSC members could cast their vote. Even Le 15/12/2022 à 23:38, Even Rouault a écrit : +1 Even Le 12/12/2022 à 15:10, ElPaso a écrit : Hi, Motion: Adopt  RFC89: SQL query logging callback [1] A draft implementation is available at [2]. An example of how

Re: [gdal-dev] Tolerance Condition Error ogr2ogr Albers to EPSG:4326

2022-12-19 Thread Even Rouault
Le 19/12/2022 à 20:48, Peter Townsend a écrit : Thanks! One more question. For the time being, is it generally ok to ignore "tolerance condition error" and "Point outside of projection domain"? I can make our program not care about those if it's usually harmless. They could still be

Re: [gdal-dev] Tolerance Condition Error ogr2ogr Albers to EPSG:4326

2022-12-19 Thread Even Rouault
is actually the "trees" shapefile from the QGIS sample dataset. Throws the same messaging out. https://download.qgis.org/downloads/data/ qgis_sample_data\shapefiles\trees.* Good luck! On Mon, Dec 19, 2022 at 12:46 PM Even Rouault wrote: Peter, I suspect the reprojection of you

Re: [gdal-dev] Tolerance Condition Error ogr2ogr Albers to EPSG:4326

2022-12-19 Thread Even Rouault
Peter, I suspect the reprojection of your features went fine, otherwise you would have got an error message like "Failed to reproject feature (geometry probably out of source or destination SRS)". This error message must come from some code that tries heuristics related to polar or

Re: [gdal-dev] std::numeric_limits::min() vs LLONG_MIN

2022-12-18 Thread Even Rouault
Paul, I've queued your proposed fix in pull request https://github.com/OSGeo/gdal/pull/6943 Even Le 18/12/2022 à 22:18, Paul Meems a écrit : I made the brackets bold. That seems to result in the * Only ( and ) are needed, no *. Regards, Paul Op zo 18 dec. 2022 18:39 schreef Andrew C

[gdal-dev] Code reformatting applied

2022-12-17 Thread Even Rouault
Hi, The code reformatting has now landed into master and release/3.6 branches per pull requests https://github.com/OSGeo/gdal/pull/6937 and https://github.com/OSGeo/gdal/pull/6939. I've applied it now since the number of opened pull requests is low. I've split the reformatting in one commit

Re: [gdal-dev] Motion: adopt RFC89: SQL query logging callback

2022-12-15 Thread Even Rouault
+1 Even Le 12/12/2022 à 15:10, ElPaso a écrit : Hi, Motion: Adopt  RFC89: SQL query logging callback [1] A draft implementation is available at [2]. An example of how client code could make use of this new functionality is avaiable for QGIS at [3]. Kind regards. [1]

Re: [gdal-dev] Advanced 3.6.1 release and retraction of 3.6.0 ?

2022-12-15 Thread Even Rouault
Le 15/12/2022 à 21:48, Daniel Evans a écrit : Similar thoughts here, too. Thinking particularly of the Docker image, the main use case for them is ensuring a reproducible build on the user's side. Those using the `latest` tag (indicating they're not so bothered about versions) will start

Re: [gdal-dev] Advanced 3.6.1 release and retraction of 3.6.0 ?

2022-12-15 Thread Even Rouault
into history, we retracted 1.7.0 in https://trac.osgeo.org/gdal/wiki/DownloadSource#a1.7.0retracted-January2010 and as far as I can see in http://download.osgeo.org/gdal/old_releases/ , the 1.7.0 tarballs were also removed from download. Even Le 13/12/2022 à 16:18, Even Rouault via gdal-dev

[gdal-dev] GDAL 3.6.1 is released

2022-12-15 Thread Even Rouault
Hi, On behalf of the GDAL/OGR development team, I am pleased to announce the release of the GDAL/OGR 3.6.1 bug fix version. Important: GDAL 3.6.1 officially retracts GDAL 3.6.0 which could cause corruption of the spatial index of GeoPackage files it created (in tables with 100 000 features

[gdal-dev] libtiff 4.5.0 is released

2022-12-15 Thread Even Rouault
Hi, I've promoted rc3 as the final 4.5.0 release. Read about this release at https://libtiff.gitlab.io/libtiff/releases/v4.5.0.html Note in particular the ABI change due to symbol versioning (SONAME bumped to 6), and API and behavior changes related to the following items: - Related to

[gdal-dev] GDAL 3.6.1 rc1 available

2022-12-13 Thread Even Rouault
Hi, As mentioned in earlier email, this release is done ahead of the planned schedule to fix a corruption when generating spatial index of GeoPackage file with large number of features with GDAL 3.6.0, which will be officially retracted once 3.6.1 is promoted. Pick up an archive among the

[gdal-dev] rc3 is available (was Re: libtiff v4.5.0 rc2 available)

2022-12-13 Thread Even Rouault
://download.osgeo.org/libtiff/tiff-4.5.0rc3.tar.xz.sig - https://download.osgeo.org/libtiff/tiff-4.5.0rc3.zip - https://download.osgeo.org/libtiff/tiff-4.5.0rc3.zip.sig Le 13/12/2022 à 21:39, Even Rouault a écrit : Hi, The changes in IFD loop detection are non-trivial enough to justify a rc2, so here

Re: [gdal-dev] [Tiff] libtiff v4.5.0 rc2 available

2022-12-13 Thread Even Rouault
164:27: error: format specifies type 'unsigned short' but the argument has type 'tdir_t' (aka 'unsigned int') [-Werror,-Wformat]                           dirn);                           ^~~~ On Tue, Dec 13, 2022 at 12:39 PM Even Rouault wrote: Hi, The changes in IFD loop detection a

[gdal-dev] libtiff v4.5.0 rc2 available

2022-12-13 Thread Even Rouault
Hi, The changes in IFD loop detection are non-trivial enough to justify a rc2, so here it is: - https://download.osgeo.org/libtiff/tiff-4.5.0rc2.tar.gz - https://download.osgeo.org/libtiff/tiff-4.5.0rc2.tar.gz.sig - https://download.osgeo.org/libtiff/tiff-4.5.0rc2.tar.xz -

[gdal-dev] Advanced 3.6.1 release and retraction of 3.6.0 ?

2022-12-13 Thread Even Rouault via gdal-dev
Hi, https://github.com/qgis/QGIS/issues/51188 has been brought to my attention. The issue is that the new background building of the RTree of GeoPackage files introduced in 3.6.0 didn't work well with committing transactions in between, which is easily triggered by ogr2ogr. All features were

Re: [gdal-dev] Ogr2ogr: when both -update and -append is needed?

2022-12-12 Thread Even Rouault
Lng time ago you need to add both, but nowadays -append automatically enables -update. Just clarified it in https://github.com/OSGeo/gdal/commit/480456769abc11daae065bd112cb7361aa618636 Le 12/12/2022 à 21:25, Rahkonen Jukka a écrit : Hi, I saw this question

Re: [gdal-dev] [EXTERNAL] Re: SQL query to set column to GPKG raster pixel value of point intersection result

2022-12-12 Thread Even Rouault
gdal-dev" *Reply-To: *"Meyer, Jesse R. (GSFC-618.0)[SCIENCE SYSTEMS AND APPLICATIONS INC]" *Date: *Monday, December 12, 2022 at 9:44 AM *To: *Even Rouault , Rahkonen Jukka , "gdal-dev@lists.osgeo.org" *Subject: *Re: [gdal-dev] [EXTERNAL] Re: SQL query to set colu

Re: [gdal-dev] Trouble using TEMPORARY=ON with ogr2ogr

2022-12-11 Thread Even Rouault
FYI Jeremy Palmer has just submitted a fix for that: https://github.com/OSGeo/gdal/pull/6896 Le 30/11/2022 à 16:12, Daniel Mannarino a écrit : Hello! I'm having trouble using the temporary table option of ogr2ogr:https://gdal.org/drivers/vector/pg.html#layer-creation-options Ultimately I

Re: [gdal-dev] GDAL python API - Data axis to CRS axis mapping

2022-12-10 Thread Even Rouault
Hi Chris, ==> https://gdal.org/api/python/osgeo.osr.html#osgeo.osr.SpatialReference.GetDataAxisToSRSAxisMapping Doc: https://gdal.org/api/ogrspatialref.html#_CPPv4NK19OGRSpatialReference27GetDataAxisToSRSAxisMappingEv Example at

Re: [gdal-dev] libtiff v4.5.0 release candidate available

2022-12-10 Thread Even Rouault
  CMakeLists.txt:141 (include) which probably comes from some if(${TIFF_VERSION} VERSION_LESS "4.0") I would suggest to restore a formatting which doesn't break existing CMake code. Regards, Kai Am 09.12.22 um 16:48 schrieb Even Rouault: Hi, I've prepared a release candidat

[gdal-dev] libtiff v4.5.0 release candidate available

2022-12-09 Thread Even Rouault
Hi, I've prepared a release candidate for libtiff v4.5.0: - https://download.osgeo.org/libtiff/tiff-4.5.0rc1.tar.gz - https://download.osgeo.org/libtiff/tiff-4.5.0rc1.tar.gz.sig - https://download.osgeo.org/libtiff/tiff-4.5.0rc1.tar.xz -

Re: [gdal-dev] [EXTERNAL] Re: SQL query to set column to GPKG raster pixel value of point intersection result

2022-12-08 Thread Even Rouault
Hi, That sounds like a cool idea. I've had a crack at it in https://github.com/OSGeo/gdal/pull/6877 Even Le 08/12/2022 à 22:10, Meyer, Jesse R. (GSFC-618.0)[SCIENCE SYSTEMS AND APPLICATIONS INC] via gdal-dev a écrit : Hi, I want to perform this on tens of thousands of GPKG databases,

Re: [gdal-dev] gdal_merge

2022-12-05 Thread Even Rouault
You may need to specify the pixel size with the -ps argument to be the one with the less resolution. Or try using gdalwarp instead (you may also need to use the -tr argument to specify the resolution). gdal_merge cannot deal with rasters larger than memory. Le 05/12/2022 à 12:46, Clive Swan

Re: [gdal-dev] Python API ReadAsArray axis order

2022-12-04 Thread Even Rouault
Chris, ReadAsArray() returns a NumPy array, and the first dimension in NumPy is the slowest varying one, that is y. GDAL's geotransform is Xgeoref = gt[0] + column * gt[1] + line * gt[2] Ygeoref = gt[3] + column * gt[4] + line * gt[5] and GDAL's Raster API have their arguments with column

Re: [gdal-dev] Motion: adopt RFC69 C/C++ Code Formatting

2022-12-02 Thread Even Rouault
Hi, I declare this motion passed with +1 from PSC members KurtS and me. Even Le 24/11/2022 à 09:39, ElPaso a écrit : Hi, Motion: Adopt RFC88: RFC69 C/C++ Code Formatting [1] I have updated the RFC [1] to use pre-commit and I have created a draft implementation of the pre-commit hook and

Re: [gdal-dev] Relationship between GTiff multi-threaded read and vsicurl multirange requests

2022-12-01 Thread Even Rouault
Hi Pete, Those are good questions I am confused by the large number of curl range requests when using the new multithreaded reading.  Some questions: - with GDAL_NUM_THREADS_1 and GDAL_HTTP_MULTIRANGE=YES, "each range will be requested in parallel, using several HTTP connections"... are

Re: [gdal-dev] PostGIS and ogrinfo: not able to view all the tables of a PostGIS schema

2022-11-30 Thread Even Rouault
try adding -oo LIST_ALL_TABLES=YES cf https://gdal.org/drivers/vector/pg.html#dataset-open-options Le 30/11/2022 à 13:00, andy a écrit : Hi, if I run ogrinfo -ro -so PG:"dbname='arpa_db' host='192.168.xxx.xxx' port='5432' user='postgres' password='' schemas=public" I see 3 tables in

Re: [gdal-dev] gdal_merge

2022-11-29 Thread Even Rouault
Clive, CPL_VSIL_USE_TEMP_FILE_FOR_RANDOM_WRITE is a configuration option / environment variable, so you have to pass it with --config CPL_VSIL_USE_TEMP_FILE_FOR_RANDOM_WRITE YES Even Le 29/11/2022 à 20:12, Clive Swan a écrit : Greetings, I am trying to select band 1 and then use

Re: [gdal-dev] GDAL compilation with driver OGR_PG

2022-11-28 Thread Even Rouault
https://github.com/OSGeo/gdal/pull/6816 should make it much more obvious with an explicit fatal error when explicitly enabling a driver whose requirements are not met. Le 28/11/2022 à 17:47, Johannes Paul a écrit : Perfect ! Thank you very much. Johannes On Mon, 28 Nov 2022 at 16:16, Even

Re: [gdal-dev] Motion: adopt RFC69 C/C++ Code Formatting

2022-11-28 Thread Even Rouault
Le 28/11/2022 à 18:17, Javier Jimenez Shaw a écrit : Which version of clang-format are we using? 15.0.4 currently, pinned in the pre-commit configuration file. cf https://github.com/OSGeo/gdal/pull/6787#issuecomment-1327416250 . It is installed automatically when running pre-commit. Works

Re: [gdal-dev] Motion: adopt RFC69 C/C++ Code Formatting

2022-11-28 Thread Even Rouault
Hi, +1 and I'm very much for the "Big reformat", otherwise as discussed with Alessandro, I'm afraid occasional contributors will mix substantial and formatting changes in the same commit. The Big reformat commit itself should be done with a dedicated github account, like we did with the "git

[gdal-dev] Proposal of a -json output for ogrinfo

2022-11-28 Thread Even Rouault
Hi, I've implemented a -json switch for ogrinfo Cf https://github.com/OSGeo/gdal/pull/6812 This should be useful to those using currently grep, sed, awk, and the like to extract metadata information on a OGR dataset. Even -- http://www.spatialys.com My software is free, but my time

Re: [gdal-dev] GDAL compilation with driver OGR_PG

2022-11-28 Thread Even Rouault
Johannes, minimum or near-minimum builds are tricky because of inter-driver dependencies. You also need to add -DOGR_ENABLE_DRIVER_PGDUMP=ON Cf https://github.com/OSGeo/gdal/blob/b2c689436208e72518f4cd60fb5e27d6d985a621/ogr/ogrsf_frmts/CMakeLists.txt#L87: {{{ ogr_dependent_driver(pg

Re: [gdal-dev] Is there a way to create a spatial index in FGB if created without?

2022-11-24 Thread Even Rouault
Le 24/11/2022 à 19:18, michael.smith.e...@gmail.com a écrit : I don’t believe these are huge features, its OSM building for the world. Must be the memory constraint since it is a lot of features. This doesn’t happen (i think, am retesting now) if created from the osm pbf file directly but

Re: [gdal-dev] Is there a way to create a spatial index in FGB if created without?

2022-11-24 Thread Even Rouault
Mike, Le 24/11/2022 à 18:56, michael.smith.e...@gmail.com a écrit : Basically, can one create a spatial index in a flatgeobuf file if the source does not have one? yes, through ogr2ogr by creating a new file, as you did Also, when trying to just create a new flatgeobuf with a spatial

Re: [gdal-dev] Compilation error with JP2KAK driver

2022-11-24 Thread Even Rouault
ated at kakadu compilation. I only get libkdu_v82R.so and libkdu.a Rgds, Johannes Le jeu. 24 nov. 2022 à 14:14, Even Rouault a écrit : The value of KDU_AUX_LIBRARY is wrong. See https://gdal.org/development/building_from_source.html#cmdoption-arg-KDU_AUX_LIBRARY It should be -DK

Re: [gdal-dev] Compilation error with JP2KAK driver

2022-11-24 Thread Even Rouault
The value of KDU_AUX_LIBRARY is wrong. See https://gdal.org/development/building_from_source.html#cmdoption-arg-KDU_AUX_LIBRARY It should be -DKDU_AUX_LIBRARY="${INSTALLDIR}"/lib/libkdu_a82R.so" Even Le 24/11/2022 à 10:35, Johannes Paul a écrit : Hello, I'm having trouble compiling GDAL

Re: [gdal-dev] SortIncludes was Re: Motion: adopt RFC69 C/C++ Code Formatting

2022-11-24 Thread Even Rouault
I'm pretty sure that in the past I've fought against issues related to include orders, at least on some platforms, and some things were beyond our control (system headers or dependency headers), so I think it is best to exclude it for now as Alessandro just did for something that is intended

Re: [gdal-dev] Motion: adopt RFC88: Use GoogleTest framework for C/C++ unit tests

2022-11-23 Thread Even Rouault
Hi, I declare this motion passed with +1 from PSC members MateuszL, HowardB, JukkaR, KurtS , FrankW, DanielM and me. Even Le 21/11/2022 à 12:40, Even Rouault a écrit : Hi, Motion: Adopt RFC88: Use GoogleTest framework for C/C++ unit tests(https://github.com/OSGeo/gdal/pull/6720

Re: [gdal-dev] GDAL Seg Fault - for info

2022-11-21 Thread Even Rouault
dev GDAL build with drivers using proprietary SDKs, it does find real symbol clashes that I was aware of, due to those SDKs embedding symbol libraries (like libxml2 in FileGDB SDK, lcms in ECW SDK, ...) Le 21/11/2022 à 13:37, Even Rouault a écrit : Paul, Looking at https://stackoverflow

Re: [gdal-dev] GDAL Seg Fault - for info

2022-11-21 Thread Even Rouault
Paul, Looking at https://stackoverflow.com/questions/63161532/python-segmentation-fault-when-using-zipfile-while-gdal-package-loaded shows an interesting thing in a gdb backtrace |#0 0x77e3aa50 in free () from /usr/lib/libc.so.6 #1 0x7485ae0f in inflateReset2 () from

Re: [gdal-dev] Latest GDAL version not transforming lat/lng into geom column

2022-11-21 Thread Even Rouault
Should be fixed per https://github.com/OSGeo/gdal/pull/6756 Le 21/11/2022 à 12:16, Rahkonen Jukka a écrit : Hi, Did you ever notice that the result from GDAL 3.5.1 is wrong as well? You csv file has coordinates with a comma as a decimal separator and enclosed between double quotes

[gdal-dev] Motion: adopt RFC88: Use GoogleTest framework for C/C++ unit tests

2022-11-21 Thread Even Rouault
Hi, Motion: Adopt RFC88: Use GoogleTest framework for C/C++ unit tests(https://github.com/OSGeo/gdal/pull/6720) Starting with my +1, Even -- http://www.spatialys.com My software is free, but my time generally not. ___ gdal-dev mailing list

Re: [gdal-dev] Call for discussion: RFC88: Use GoogleTest framework for C/C++ unit tests

2022-11-20 Thread Even Rouault
Hi Frank, I'm not a huge GoogleTest fan but then I'm also not saying it *worse* than any alternative, but the reasons are reasonably convincing, and I'm happy if those running and contributing tests are happy! Just curious what you don't like with GoogleTest ? Should I understand from the

Re: [gdal-dev] errors using IAM instance profile auth in s3

2022-11-20 Thread Even Rouault
al.GA_ReadOnly) In [6]: hDataset Out[6]: 'GDALDatasetShadow *' at 0x7f827217c450> > In [7]: hDataset.GetGeoTransform() Out[7]: (365000.0, 5.0, 0.0, 6635000.0, 0.0, -5.0) Mike *From: *Even Rouault *Date: *Saturday, November 19, 2022 at 10:08 AM *To: * *Cc: *gdal-dev *Subject: *Re: [gdal-dev] errors u

Re: [gdal-dev] errors using IAM instance profile auth in s3

2022-11-19 Thread Even Rouault
v 19, 2022, at 9:26 AM, Even Rouault wrote: Hi Mike, could you send the output of curl http://169.254.169.254/latest/meta-data/iam/security-credentials/iam-grid-s3 Slightly redacted of course, but with the exact formatting. This part of thee code currently uses a "simple JSON

Re: [gdal-dev] errors using IAM instance profile auth in s3

2022-11-19 Thread Even Rouault
until 2022-11-19T20:42:58Z S3: Downloading 0-16383 (https://grid-dev-publiclidar.s3.amazonaws.com/estonia/dtm/estonia_dtm_5m.tif)... S3: Got response_code=206 gdalinfo failed - unable to open '/vsis3/grid-dev-publiclidar/estonia/dtm/estonia_dtm_5m.tif'. Mike On Nov 19, 2022, at 9:26 AM, Ev

Re: [gdal-dev] errors using IAM instance profile auth in s3

2022-11-19 Thread Even Rouault
Hi Mike, could you send the output of curl http://169.254.169.254/latest/meta-data/iam/security-credentials/iam-grid-s3 Slightly redacted of course, but with the exact formatting. This part of thee code currently uses a "simple JSON parser"

Re: [gdal-dev] A CSW query that seems to me works badly

2022-11-18 Thread Even Rouault
This is mostly an implementation detail that should have no consequences. If you really want to change that, I'd suggest you to submit a pull request with the change directly. Hint:  go to https://github.com/OSGeo/gdal/edit/master/ogr/ogrsf_frmts/wfs/ogrwfsfilter.cpp , do the change and use

Re: [gdal-dev] Call for discussion: RFC88: Use GoogleTest framework for C/C++ unit tests

2022-11-17 Thread Even Rouault
Hi Mateusz, TUT was a very sensible choice at the time you implemented it, and it has been very useful up to now ! Even Le 17/11/2022 à 18:02, Mateusz Loskot a écrit : On Wed, 16 Nov 2022 at 19:42, Even Rouault wrote: Text at https://github.com/OSGeo/gdal/pull/6720 The document proposes

Re: [gdal-dev] Specify Grid Rotation for gdal.Warp() with Geolocation Arrays

2022-11-17 Thread Even Rouault
aset.cpp#L1536 Anyway I can calculate these parameters myself, so it is not a big issue. Your suggestion worked for me. Cheers! Brendan *From:* Even Rouault *Sent:* Saturday, November 5, 2022 4:36 AM *To:* Michae

Re: [gdal-dev] A CSW query that seems to me works badly

2022-11-17 Thread Even Rouault
Le 17/11/2022 à 11:50, andy a écrit : Hi Even, another question. On Wed, 16 Nov 2022 at 14:17, Even Rouault wrote: No, title is not in the lists of hardcoded fields by the OGR CSW driver. Probably a fix/improvement to do in the driver. What's the list  of the hardcoded fields

Re: [gdal-dev] Motion: adopt RFC 87: Signed int8 data type for raster

2022-11-16 Thread Even Rouault
Hermann, I dare to say that, if we are following this path, maybe GDAL should start marketing itself as a set of command line tools and not as a library, given that breaking compatibility just because we can is not something a library developer should do, IMHO. I believe your words aren't

Re: [gdal-dev] Motion: adopt RFC 87: Signed int8 data type for raster

2022-11-16 Thread Even Rouault
I think long term compatibility is a very desirable feature, and several applications just use GDAL as part of their code base without even being aware of what is happening in the GDAL development front. The same is true for several other libraries, given the fact the use of package

[gdal-dev] Call for discussion: RFC88: Use GoogleTest framework for C/C++ unit tests

2022-11-16 Thread Even Rouault
Hi, As this is RFC season. I've prepared RFC88: Use GoogleTest framework for C/C++ unit tests Text at https://github.com/OSGeo/gdal/pull/6720 Summary: The document proposes and describes conversion of the existing C/C++ autotest suite to use the `GoogleTest framework

Re: [gdal-dev] Motion: adopt RFC 87: Signed int8 data type for raster

2022-11-16 Thread Even Rouault
So based on that RFC it is a breaking change when reading signed images. I confess that this type of silent behavor change scares me. It is documented in https://github.com/OSGeo/gdal/blob/master/MIGRATION_GUIDE.TXT which is always referenced in the release notes. Why dont make this an

Re: [gdal-dev] Motion: adopt RFC 87: Signed int8 data type for raster

2022-11-16 Thread Even Rouault
-- Hermann Rodrigues hermann.rodrig...@gmail.com herm...@csr.ufmg.br Twitter: @horodrigues | @dinamica_ego Centro de Sensoriamento Remoto / UFMG https://csr.ufmg.br | https://dinamicaego.com On Wed, Nov 16, 2022 at 8:04 AM Even Rouault wrote: I declare this motion passed with +1 from PSC

Re: [gdal-dev] A CSW query that seems to me works badly

2022-11-16 Thread Even Rouault
Le 16/11/2022 à 14:07, andy a écrit : Hi Even, On Wed, 16 Nov 2022 at 14:00, Even Rouault wrote: No, that's not currently implemented in the driver. It hardcodes "subject" to "dc:subject" and "title" to "dc:title", and doesn't use Sup

Re: [gdal-dev] Motion: adopt RFC 87: Signed int8 data type for raster

2022-11-16 Thread Even Rouault
I declare this motion passed with +1 from PSC members KurtS, JukkaR, MateuszL and me. Even Le 14/11/2022 à 13:22, Even Rouault a écrit : Hi, I feel the discussion phase has finished. There were a few questions about the existing GDT_Byte unsigned 8-bit integer type, if it should be renamed

<    2   3   4   5   6   7   8   9   10   11   >