I've now found this useful Mapserver wiki page https://github.com/mapserver/mapserver/wiki/Render-images-straight-out-of-S3-with-the-vsicurl-driver. It seems to imply that it's better to merge a collection of dataset tiles into a single big Geotiff rather than create a VRT due to the repeated HTTP calls. I'm still interested in people's experiences using imagery direct from S3 and it's performance.
Note some of my largest datasets have a total size of 1.5TBs uncompressed Geotiff with about 8000 tiles @ 175mb per tile. I'll likely compress the uncompressed Geotiffs and use JPEG compression, which I estimate can bring the size down to about 200GB total. Cheers Jeremy On Sat, Mar 2, 2019 at 9:15 AM Jeremy Palmer <[email protected]> wrote: > Hi All, > > Does anyone have any tips or experience in trying to serve RGB large > imagery multi file datasets hosted on S3 to application servers/containers > for bulk tile rendering? Is this possible using VRTs and is the performance > manageable when compared to other mounted storage options? > > Thanks, > Jeremy >
_______________________________________________ gdal-dev mailing list [email protected] https://lists.osgeo.org/mailman/listinfo/gdal-dev
