Re: [gdal-dev] how to use tiledb datasets on gcs?

2021-04-23 Thread Norman Barker
Yes, internally the GDAL TileDB driver remaps vsis3 requests to s3 requests within the TileDB library. To a user the vsi notation still works the same. I will look over the PR, thanks Vincent! Norman On Fri, Apr 23, 2021 at 9:30 AM Vincent Schut wrote: > Even's understanding is correct. I've

Re: [gdal-dev] how to use tiledb datasets on gcs?

2021-04-23 Thread Vincent Schut
Even's understanding is correct. I've made a small PR to add this functionality: https://github.com/OSGeo/gdal/pull/3728. I'm not an experienced c++ programmer, so I hope I've done things the right way. At least it works here. Let's move the rest of the discussion - if any - to the PR.

Re: [gdal-dev] how to use tiledb datasets on gcs?

2021-04-23 Thread Even Rouault
Sean, my understanding of the commit is that internally the tiledb SDK handles cloud storage by itself (ie not relying on GDAL virtual file systems) and using s3:// / gcs:// naming conventions, and the purpose of the below referenced commit is, for the GDALOpen() code path, to remap /vsis3/

Re: [gdal-dev] how to use tiledb datasets on gcs?

2021-04-23 Thread Sean Gillies via gdal-dev
Hi Vincent, Even. Why would we do this when /vsigcs/... should work? Letting individual drivers set their own conventions for dataset names seems, to me, to hurt long-term maintenance and interoperability. On Fri, Apr 23, 2021 at 7:34 AM Vincent Schut wrote: > Thanks for confirming, Even. That

Re: [gdal-dev] how to use tiledb datasets on gcs?

2021-04-23 Thread Vincent Schut
Thanks for confirming, Even. That doesn't look too difficult. I'll give it a try. On 4/23/21 3:09 PM, Even Rouault wrote: I guess you should add something similar to https://github.com/OSGeo/gdal/commit/3623f9c91a2c513af204d30fe25314dbe5c7b9be for /vsigs Le 23/04/2021 à 14:59, Vincent

Re: [gdal-dev] how to use tiledb datasets on gcs?

2021-04-23 Thread Even Rouault
I guess you should add something similar to https://github.com/OSGeo/gdal/commit/3623f9c91a2c513af204d30fe25314dbe5c7b9be for /vsigs Le 23/04/2021 à 14:59, Vincent Schut a écrit : On 4/23/21 2:17 PM, Vincent Schut wrote: Hi, how should I specify a tiledb dataset's url that resides on gcs

Re: [gdal-dev] how to use tiledb datasets on gcs?

2021-04-23 Thread Vincent Schut
On 4/23/21 2:17 PM, Vincent Schut wrote: Hi, how should I specify a tiledb dataset's url that resides on gcs (google cloud storage) to gdal? I've tried several combinations of gcs://, /vsigs/, prefixed with TILEDB:// or not, but no luck. I've looked in the driver source, and apparently there

[gdal-dev] how to use tiledb datasets on gcs?

2021-04-23 Thread Vincent Schut
Hi, how should I specify a tiledb dataset's url that resides on gcs (google cloud storage) to gdal? I've tried several combinations of gcs://, /vsigs/, prefixed with TILEDB:// or not, but no luck. I've looked in the driver source, and apparently there is only a /vsis3/ -> tiledb uri