Re: [MapServer-users] Ask for advice on Caching large layers on high zoom level
I've found the other limiting factors are disk speed (SSD vs HDD) and cache type. SQLite can be easy to manage but the write locking during inserts can really slow things down (adding more cores won't help in this case) when compared to writing a simple disk cache. I agree with Scott in that if you are using COGs you shouldn't really need MapCache as you could look at alternatives to serve this data out as is. On Fri, 2 Sept 2022 at 10:14, Scott wrote: > COG files imply that they are already tiled. I'd be curious as to the > performance of map rendering using just the COG files without creating > tiles. > > Being the 'size of Poland' doesn't really matter. It's the pixel > resolution that is important. If the pixel resolution is 100 meters vs 3 > meters you will have different performance results. > > Seeding will always be bound by CPU, memory, etc. Creating an image > (ami) of your system in AWS, then running multiple EC2's instance can be > insanely fast. > > > > On 9/2/22 06:41, Marcin Niemyjski via MapServer-users wrote: > > Hello, > > > > My job is to cache 365 layers. These layers consist of up to 30 .tif > > (COG) files stored in a mapfile. These layers are roughly the size of > > Poland and I would like to acquire their tiles for level 14 zoom. One > > layer for these settings: > > sudo mapcache_seed -c /DiscPlanetiler/2022/03/02/2022-03-02.xml -t > > 20220302 -g PUWG1992 -z 10,10 -n 32 > > caches 83h (32 cores is my max). I am looking for advice on how I could > > speed up the generation of these tiles. > > > > Thanks, > > Marcin > > > > ___ > > MapServer-users mailing list > > MapServer-users@lists.osgeo.org > > https://lists.osgeo.org/mailman/listinfo/mapserver-users > ___ > MapServer-users mailing list > MapServer-users@lists.osgeo.org > https://lists.osgeo.org/mailman/listinfo/mapserver-users > ___ MapServer-users mailing list MapServer-users@lists.osgeo.org https://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [MapServer-users] Ask for advice on Caching large layers on high zoom level
COG files imply that they are already tiled. I'd be curious as to the performance of map rendering using just the COG files without creating tiles. Being the 'size of Poland' doesn't really matter. It's the pixel resolution that is important. If the pixel resolution is 100 meters vs 3 meters you will have different performance results. Seeding will always be bound by CPU, memory, etc. Creating an image (ami) of your system in AWS, then running multiple EC2's instance can be insanely fast. On 9/2/22 06:41, Marcin Niemyjski via MapServer-users wrote: Hello, My job is to cache 365 layers. These layers consist of up to 30 .tif (COG) files stored in a mapfile. These layers are roughly the size of Poland and I would like to acquire their tiles for level 14 zoom. One layer for these settings: sudo mapcache_seed -c /DiscPlanetiler/2022/03/02/2022-03-02.xml -t 20220302 -g PUWG1992 -z 10,10 -n 32 caches 83h (32 cores is my max). I am looking for advice on how I could speed up the generation of these tiles. Thanks, Marcin ___ MapServer-users mailing list MapServer-users@lists.osgeo.org https://lists.osgeo.org/mailman/listinfo/mapserver-users ___ MapServer-users mailing list MapServer-users@lists.osgeo.org https://lists.osgeo.org/mailman/listinfo/mapserver-users
[MapServer-users] Ask for advice on Caching large layers on high zoom level
Hello, My job is to cache 365 layers. These layers consist of up to 30 .tif (COG) files stored in a mapfile. These layers are roughly the size of Poland and I would like to acquire their tiles for level 14 zoom. One layer for these settings: sudo mapcache_seed -c /DiscPlanetiler/2022/03/02/2022-03-02.xml -t 20220302 -g PUWG1992 -z 10,10 -n 32 caches 83h (32 cores is my max). I am looking for advice on how I could speed up the generation of these tiles. Thanks, Marcin ___ MapServer-users mailing list MapServer-users@lists.osgeo.org https://lists.osgeo.org/mailman/listinfo/mapserver-users
