Re: [gdal-dev] Prevent GDAL reads for .aux or any other s3 objects that do not exist

2021-03-03 Thread Vincent Sarago
Hi Darren You can do this by setting `GDAL_DISABLE_READDIR_ON_OPEN=EMPTY_DIR` or by narrowing the allowed extension with "CPL_VSIL_CURL_ALLOWED_EXTENSIONS=.tif" Kyle is working on some docs that explains those env in TiTiler: -

Re: [gdal-dev] Motion: remove and deprecate a few drivers

2021-03-03 Thread Frank Warmerdam
On Wed, Mar 3, 2021 at 6:55 PM Even Rouault wrote: > Frank, > > Even, > > I'm -1 on this motion as it stands. There are a quite a few formats that > I think we ought to continue to support for archival purposes > indefinitely including FIT, JDEM, GMT, DOQ1/2, LAN, MFF, NDF, SDTS, SGI, > XPM,

[gdal-dev] Prevent GDAL reads for .aux or any other s3 objects that do not exist

2021-03-03 Thread Darren Weber
In https://github.com/mapbox/rasterio/issues/2119#issuecomment-790024225 I've noted how s3-COG reads can use retries to handle s3 rate throttling (503) by enabling the `GDAL_HTTP_MAX_RETRY`. Our dataset on s3 only contains *.tif files and we need to prevent GDAL from issuing any GET/HEAD requests

Re: [gdal-dev] Motion: remove and deprecate a few drivers

2021-03-03 Thread Even Rouault
Frank, Even, I'm -1 on this motion as it stands.  There are a quite a few formats that I think we ought to continue to support for archival purposes indefinitely including FIT, JDEM, GMT, DOQ1/2, LAN, MFF, NDF, SDTS, SGI, XPM, and TIGER.  I am prepared to be listed as supporting maintainer

Re: [gdal-dev] Motion: remove and deprecate a few drivers

2021-03-03 Thread Frank Warmerdam
Even, I'm -1 on this motion as it stands. There are a quite a few formats that I think we ought to continue to support for archival purposes indefinitely including FIT, JDEM, GMT, DOQ1/2, LAN, MFF, NDF, SDTS, SGI, XPM, and TIGER. I am prepared to be listed as supporting maintainer for these

Re: [gdal-dev] New JPEG 2000 Driver

2021-03-03 Thread Greg Troxel
Even Rouault writes: >> But, I'm worried about something different. As a packager, I'd like to >> know that unless I take the affirmative step of passing --enable-foo, >> for any GPLish or proprietary foo, I won't end up with a gdal build >> linked with foo just because it happened to be

Re: [gdal-dev] Motion: remove and deprecate a few drivers

2021-03-03 Thread Paul Harwood
I have to agree with the comments about Surfer and GS7. I was given a file in that format only last week. On Wed, 3 Mar 2021 at 20:40, Even Rouault wrote: > > Deprecate JPEG2000 > > > > Is there something the openjpeg2 driver can't do that Jasper can? Can > > it be removed? > > I'm not aware

Re: [gdal-dev] problem: gdal_grid, output ers raster file

2021-03-03 Thread Ron Palmer
Thanks Even for the follow up and description of the work-around, will try it right now. Ron On 4/03/2021 8:11 am, Even Rouault wrote: Hi, This is a "well known" behaviour of gdal_grid in which it writes raster with a bottom-left corner origin, whereas most other GDAL utilities use a

Re: [gdal-dev] problem: gdal_grid, output ers raster file

2021-03-03 Thread Even Rouault
Hi, This is a "well known" behaviour of gdal_grid in which it writes raster with a bottom-left corner origin, whereas most other GDAL utilities use a top-left corner origin. The ERS driver doesn't support such convention. The workaround you can use is to output gdal_grid as a TIFF (tmp.tif),

Re: [gdal-dev] problem: gdal_grid, output ers raster file

2021-03-03 Thread Ron Palmer
Looks to me like the ERMapper ERS driver has a bug, using the bottom left corner to georef the raster, instead of top left. I can only use it if I use local coordinates, any negative northings are plotted towards the north. ERS is the main raster format I use. I am happy to assist in sorting

Re: [gdal-dev] New JPEG 2000 Driver

2021-03-03 Thread Frank Warmerdam
Folks, When Andrew first mentioned RFC 34 I skimmed it and was a bit surprised it existed though perhaps it seemed a wee bit familiar. Now that Even mentions it was not ever implemented I see that *I* proposed it and presumably did not actually follow up on implementing it or getting it adopted.

Re: [gdal-dev] Motion: remove and deprecate a few drivers

2021-03-03 Thread Even Rouault
> Deprecate JPEG2000 Is there something the openjpeg2 driver can't do that Jasper can?  Can it be removed? I'm not aware of things that Jasper/JPEG2000 can do that JP2OpenJPEG can't. But there are definitely binary distributions still using it, and not yet JP2OpenJPEG. The deprecation hint

Re: [gdal-dev] Motion: remove and deprecate a few drivers

2021-03-03 Thread Kurt Schwehr
Thanks Even! Hurray for cleanup! Some thoughts looking at the list: > SEGY Makes me sad, but I've never seen anyone use it. I've done seismic work but never needed it. +1 to nuke it. > E00GRID I keep running into E00 data from the USGS, but it's mostly been vector data. I'm +0 on removing

Re: [gdal-dev] New JPEG 2000 Driver

2021-03-03 Thread Even Rouault
Hi, https://gdal.org/development/rfc/rfc34_license_policy.html As indicated in the top of the RFC, its status is "development" (draft), which here means stalled/non-adopted given that it was proposed long time ago. So there's no runtime mechanism to control license compatibility. But,

Re: [gdal-dev] Motion: remove and deprecate a few drivers

2021-03-03 Thread Norman Barker
I wrote the Cloudant driver (though it extends the CouchDB driver), it was very useful! However afaik it is no longer being used. Though I no longer work with CouchDB I see very little mention of geospatial and CouchDB nowadays on their mailing lists. I agree with the list of drivers proposed for

Re: [gdal-dev] Motion: remove and deprecate a few drivers

2021-03-03 Thread Even Rouault
Le 03/03/2021 à 21:20, Ivan Lucena a écrit : Even, Is the INGR driver for Integraph raster install needed? It was developed when the format was already deprecated. It was supposed to read old files and there was some old hardware, scanner, spitting out in that file format. I'll add it to

Re: [gdal-dev] Motion: remove and deprecate a few drivers

2021-03-03 Thread Ivan Lucena
still (not install) From: gdal-dev on behalf of Ivan Lucena Sent: Wednesday, March 3, 2021 3:20 PM To: Even Rouault ; Joaquim Manuel Freire Luís ; gdal-dev@lists.osgeo.org Subject: Re: [gdal-dev] Motion: remove and deprecate a few drivers Even, Is the INGR

Re: [gdal-dev] Motion: remove and deprecate a few drivers

2021-03-03 Thread Ivan Lucena
Even, Is the INGR driver for Integraph raster install needed? It was developed when the format was already deprecated. It was supposed to read old files and there was some old hardware, scanner, spitting out in that file format. Regards, Ivan From: gdal-dev

Re: [gdal-dev] New JPEG 2000 Driver

2021-03-03 Thread Greg Troxel
Andrew C Aitchison writes: > On Mon, 1 Mar 2021, Greg Troxel wrote: > >> I also was unclear on the optional driver situation. Certainly if >> drivers can link with proprietary libraries, there is absolutely no >> reason to object to a driver because it links so an AGPL3 library. >> >> I

Re: [gdal-dev] Motion: remove and deprecate a few drivers

2021-03-03 Thread Even Rouault
OK, I amend my motion to keep GS7BG as non-deprecated for now. Let's mark GSAG and GSBG as deprecated and see if that triggers reactions once this is in the wild. Le 03/03/2021 à 20:55, Joaquim Manuel Freire Luís a écrit : Is the GSAG format really used ? What can I say. Because it's a

Re: [gdal-dev] Motion: remove and deprecate a few drivers

2021-03-03 Thread Joaquim Manuel Freire Luís
> Is the GSAG format really used ? What can I say. Because it's a simple format I used to have colleagues that used it for I/O of their codes and not rarely it ended up in my hands. But can't honestly say it's much used. > Which one(s) are proposed by default as output of current Surfer

Re: [gdal-dev] Motion: remove and deprecate a few drivers

2021-03-03 Thread Even Rouault
Is the GSAG format really used ? Which one(s) are proposed by default as output of current Surfer versions ? Can't Surfer export to other formats already handled by GDAL ? Le 03/03/2021 à 20:02, Joaquim Manuel Freire Luís a écrit : Even, May you reconsider the Golden Software drivers ---

Re: [gdal-dev] Motion: remove and deprecate a few drivers

2021-03-03 Thread Joaquim Manuel Freire Luís
Even, May you reconsider the Golden Software drivers --- GS7BG, GSAG, GSBG --- ? GMT can read/write GSBG, but specially GS7BG, besides Surfer, GDAL is the only one that I know that is able to read this format. Maybe not in this list but there are still many people who use Golden software grid

[gdal-dev] Motion: remove and deprecate a few drivers

2021-03-03 Thread Even Rouault
Hi, Following the discussions of past weeks, I motion to: - remove the vector drivers BNA, AeronavFAA, HTF, OpenAir, SEGUKOOA, SEGY, SUA, XPlane and raster drivers BPG, E00GRID, EPSILON, IGNFHeightASCIIGrid, NTv1. They have all been authored by myself and I'm not aware of them having been