Hi Pete, could you explain what you mean by "cloud-optimized geotiffs?
Regards,
Jan
On 8/29/2019 5:42 PM, Peter Schmitt wrote:
> If anyone is interested by our docker image, you can find it here:
https://github.com/camptocamp/docker-mapserver
Thanks for sharing this, Yves!
Regarding /vsicurl/ performance you mentioned:
> We saw some drawback when displaying maps on low scale as too much
files should be read. Visicurl seems copy the files in the container.
We need to check this to confirm, but probably someone have a better
understanding of how visicurl and visis3 work.
There might be two things at play: First, using cloud-optimized
geotiffs greatly reduces the number of curl requests required.
Secondly, a few GDAL config options dramatically improved performance
for me. Here's what I've had the best luck with (although your
specific use case probably requires different settings)
CONFIG "CPL_VSIL_CURL_ALLOWED_EXTENSIONS" "vrt tif geojson zip gpkg"
CONFIG "GDAL_DISABLE_READDIR_ON_OPEN" "YES"
CONFIG "GDAL_INGESTED_BYTES_AT_OPEN" "262144" # Bytes. This is
the value required to have 1 CURL request when opening one of our COGs
that has many levels deep of overviews
CONFIG "VSI_CACHE" "FALSE"
CONFIG "GDAL_CACHEMAX" "80" # MB
CONFIG "OGR_SQLITE_CACHE" "10" # MB
I'm curious about this comment in your config: "mapserver has memory
leaks, this limit should improve long term memory usage"
https://github.com/camptocamp/docker-mapserver/blob/ba86f87b0ec1357ad5a8ae6159a005e24db64e3f/server/runtime/etc/apache2/conf-enabled/mapserver.conf#L1-L2
I've got a MapServer instance configured with > 100 million
requests/year. I also see some behavior suggesting a memory leak
somewhere, but I have not tracked it down. Here's my Dockerized
MapServer, which uses NGINX to proxy to MapServer via FCGI:
https://github.com/pedros007/debian-mapserver
Here's my memory use for a Docker container running 8 mapserv
processes. 300% in the scale corresponds to 3 GB of memory usage.
https://i.imgur.com/CXBDsuw.png
Cheers,
Pete
_______________________________________________
mapserver-users mailing list
mapserver-users@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/mapserver-users
