Re: [mapserver-users] Gallery: running mapserver in docker on kubernetes

2019-08-30 Thread Michael Smith
You can also use something like goofys which is a fuse provider for s3 which provides s3 access while using normal file path access. It’s useful when you have to deploy to cloud and non cloud. Michael Smith RSGIS Center > On Aug 30, 2019, at 7:31 PM, Jan Hartmann wrote: > > Impressive, look

Re: [mapserver-users] Gallery: running mapserver in docker on kubernetes

2019-08-30 Thread Jan Hartmann
Impressive, looks like viscurl is a real alternative to local files. Thanks for the information, I'm certainly going to look further on this. Jan On 8/30/2019 6:15 PM, Peter Schmitt wrote: On Fri, Aug 30, 2019 at 9:48 AM Jan Hartmann > wrote: Thanks Peter, th

Re: [mapserver-users] Gallery: running mapserver in docker on kubernetes

2019-08-30 Thread Peter Schmitt
On Fri, Aug 30, 2019 at 9:48 AM Jan Hartmann wrote: > Thanks Peter, this is really useful. Do you have any real-world benchmarks > for MapServer that compare regular file access with vsicurl access, using > optimized Geotifs? I've seen the tests for GDAL at > https://trac.osgeo.org/gdal/wiki/Clou

Re: [mapserver-users] Gallery: running mapserver in docker on kubernetes

2019-08-30 Thread Jan Hartmann
Thanks Peter, this is really useful. Do you have any real-world benchmarks for MapServer that compare regular file access with vsicurl access, using optimized Geotifs? I've seen the tests for GDAL at https://trac.osgeo.org/gdal/wiki/CloudOptimizedGeoTIFF, but what about servering  large map-set

Re: [mapserver-users] Gallery: running mapserver in docker on kubernetes

2019-08-30 Thread Peter Schmitt
Hi Jan, On Fri, Aug 30, 2019 at 6:20 AM Jan Hartmann wrote: > Hi Pete, could you explain what you mean by "cloud-optimized geotiffs? > A Cloud Optimized GeoTIFF (COG) is a regular GeoTIFF file in which the data is structured for fast random access. Some properties of a COG have always been use

Re: [mapserver-users] Gallery: running mapserver in docker on kubernetes

2019-08-30 Thread Jan Hartmann
Hi Pete, could you explain what you mean by "cloud-optimized geotiffs? Regards, Jan On 8/29/2019 5:42 PM, Peter Schmitt wrote: > If anyone is interested by our docker image, you can find it here: https://github.com/camptocamp/docker-mapserver Thanks for sharing this, Yves! Regarding /vsicurl

Re: [mapserver-users] Gallery: running mapserver in docker on kubernetes

2019-08-29 Thread Peter Schmitt
> If anyone is interested by our docker image, you can find it here: https://github.com/camptocamp/docker-mapserver Thanks for sharing this, Yves! Regarding /vsicurl/ performance you mentioned: > We saw some drawback when displaying maps on low scale as too much files should be read. Visicurl se

Re: [mapserver-users] Gallery: running mapserver in docker on kubernetes

2019-08-29 Thread Jan Hartmann
Thanks, this is a nice example to build a MapServer Docker container with. I need PHP-MapScript and an Apache and a PostgreSQL server with PostGIS and PLR, so there still are a few things to figure out. But this is a very handy starting point. Jan On 8/29/2019 1:38 PM, Wouter Visscher wrote:

Re: [mapserver-users] Gallery: running mapserver in docker on kubernetes

2019-08-29 Thread Yves Jacolin
Hello, We are using PostGIS and GDAL a lot so I think this build support it. But indeed we are not using PHP-mapScript so we did not enable it. About the question why we don't use binary from ubuntugis, I need to ask before to answer as I didn't know. I guess this is to be sure to build whatever

Re: [mapserver-users] Gallery: running mapserver in docker on kubernetes

2019-08-29 Thread Wouter Visscher
On our github.com/PDOK is information/README.md on the Dockerfiles we run (also on docker hub https://hub.docker.com/u/pdok) we run a mapserver setup with lighttpd, we made this setup with deployment to kubernetes in mind. So we can interact with configmaps, secrets, env variables and so on.. On T

Re: [mapserver-users] Gallery: running mapserver in docker on kubernetes

2019-08-29 Thread Jan Hartmann
Thanks, Yves. I see that you compiled mapserver yourself, and used standard distributions for all other packages (geos, gdal etc). Why did you not use the UbuntuGis binary for MapServer too? You compiled with the following options: cmake /src \ -GNinja \ -DCMAKE_BUILD_TYPE=Re

Re: [mapserver-users] Gallery: running mapserver in docker on kubernetes

2019-08-29 Thread Yves Jacolin
Hello, If anyone is interested by our docker image, you can find it here: https://github.com/camptocamp/docker-mapserver Y. Le jeu. 29 août 2019 à 13:14, Jan Hartmann a écrit : > Hi Wouter, I am definitely interested in your setups, especially the > docker containers with mapserver. I've also

Re: [mapserver-users] Gallery: running mapserver in docker on kubernetes

2019-08-29 Thread Wouter Visscher
For us it was/still is a learning curve regarding the vsicurl settings for both vector and raster datasources. To improve on this we needed to learn how to manipulatie the data and see how it interacts with gdal and mapserver on level of the code. Regarding the performance we 'solved' it (for our s

Re: [mapserver-users] Gallery: running mapserver in docker on kubernetes

2019-08-29 Thread Jan Hartmann
Hi Wouter, I am definitely interested in your setups, especially the docker containers with mapserver. I've also a lot of separate mapserver applications that I would like to manage more as a whole. Although not with 12 billion requests a year . An example is the complete population administrat

Re: [mapserver-users] Gallery: running mapserver in docker on kubernetes

2019-08-29 Thread Wouter Visscher
Thanks for the suggestion. I will get on to that and put something on github. On Thu, 29 Aug 2019, 12:24 Jeff McKenna, wrote: > Thanks for wanting to share this; the best way is to create a new wiki > page on the MapServer wiki (https://github.com/mapserver/mapserver/wiki) > and there you can ou

Re: [mapserver-users] Gallery: running mapserver in docker on kubernetes

2019-08-29 Thread Yves Jacolin
Hello, We are also using Kubernetes/Openshift to deploy our application (MapServer based or not). For MapServer, we are also using visicurl for S3-hosted files. We saw some drawback when displaying maps on low scale as too much files should be read. Visicurl seems copy the files in the container.

Re: [mapserver-users] Gallery: running mapserver in docker on kubernetes

2019-08-29 Thread Jeff McKenna
Thanks for wanting to share this; the best way is to create a new wiki page on the MapServer wiki (https://github.com/mapserver/mapserver/wiki) and there you can outline all of your infrastructure tricks, then you can come back here and paste your link to your MapServer magic :) Thanks again,

[mapserver-users] Gallery: running mapserver in docker on kubernetes

2019-08-29 Thread Wouter Visscher
Hi all, I'm working for the Dutch NSDI www.pdok.nl, where we have around 200 datasets ranging from the larger ones like address, buildings, cadastral parcels and smaller ones like hikingtrails, natura2000, and so on. Our platform is used a lot in the Netherlands, both by the public and private sec