Re: [MapServer-users] MB Tiles vs. UTF grids

[Thomas Gratier]

Hello,

You have the answer at https://github.com/mapbox/mbtiles-spec#utfgrid Two
specs. In old days, utfgrid was part of the mbtiles spec directly
- mbtiles = contains raster or vector tiles
- utfgrid = store in the same scheme (xyz) json blob to be able to make
interactive map

Most of the time, when using mbtiles = you create a sqlite file
pregenerated and you serve raster/vector tiles and optionally utfgrid using
a small server without any mapping logic. The advantage = any hosting can
do it. Drawback = Can't refresh on the fly.

The alternative approach is to use a web map server that's able to read a
geospatial datasource and output from it an image/vector/utfgrid like if it
was serve from a mbtiles with yoururl///.png (for raster) or
yoururl///.pbf (for vector) or yoururl///.json (for
utfgrid) but the data behind behind the scene is not stored in a mbtiles.
Advantage = clients libraries (OpenLayers, Leaflet,...) are able to consume
raster/vector tiles or utfgrid like if served from static mbtiles. Drawback
= special hosting to deploy and use your web map server.

Not sure it's enough clear.

Regards,


Thomas Gratier



Le sam. 3 sept. 2022 à 01:05, Scott  a écrit :

> I'm ill equipped to answer your question directly.
>
> However, as you delve into the world of vector tiles I'd strongly
> suggest taking a look a FlatGeoBuf (.fgb). It's an index format
> supported by GDAL and MapServer. It's very fast and painless.
>
> The home page has demo's for openlayers, leaflet and mapbox, using a
> single 12GB census data file. Leaflet seems to be the most responsive.
>
> http://flatgeobuf.org/
>
>
>
>
> On 9/2/22 15:22, karsten wrote:
> > Hi All,
> > For the first time, I am diving into actually using vector tiles and or
> > UTF grids on an OpenLayers map. I am confused  about UTF grids,
> > especially I could not find clear answers whether UTFGrids have been
> > completely replaced by MB Tiles or if UTF Grids are now a subset of MB
> > Tiles. Posts on the web seem to suggest that UTF grids can be stored
> > inside MB Tiles
> > <
> https://medium.com/@pyin001/utfgrid-and-mbtiles-map-file-decoding-on-android-864487697752>.
>
> > Note that I am trying to stay outside the Mapbox empire (as much as
> > possible) and trying to use GDAL, MapServeretc.
> > GDAL can produce MB tiles (but not sure if that includes UTF grid info
> > as well) and MapServer can deliver UTF grid via WMS on the fly, but not
> > sure how performance is so far ...
> > Would anyone have some insights ?
> > Thanks
> > Karsten Vennemann
> > www.terragis.net 
> >
> > ___
> > MapServer-users mailing list
> > MapServer-users@lists.osgeo.org
> > https://lists.osgeo.org/mailman/listinfo/mapserver-users
> ___
> MapServer-users mailing list
> MapServer-users@lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/mapserver-users
>
___
MapServer-users mailing list
MapServer-users@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/mapserver-users

Re: [MapServer-users] MB Tiles vs. UTF grids

[Scott]

I'm ill equipped to answer your question directly.

However, as you delve into the world of vector tiles I'd strongly 
suggest taking a look a FlatGeoBuf (.fgb). It's an index format 
supported by GDAL and MapServer. It's very fast and painless.


The home page has demo's for openlayers, leaflet and mapbox, using a 
single 12GB census data file. Leaflet seems to be the most responsive.


http://flatgeobuf.org/




On 9/2/22 15:22, karsten wrote:

Hi All,
For the first time, I am diving into actually using vector tiles and or 
UTF grids on an OpenLayers map. I am confused  about UTF grids, 
especially I could not find clear answers whether UTFGrids have been 
completely replaced by MB Tiles or if UTF Grids are now a subset of MB 
Tiles. Posts on the web seem to suggest that UTF grids can be stored 
inside MB Tiles 
. 
Note that I am trying to stay outside the Mapbox empire (as much as 
possible) and trying to use GDAL, MapServeretc.
GDAL can produce MB tiles (but not sure if that includes UTF grid info 
as well) and MapServer can deliver UTF grid via WMS on the fly, but not 
sure how performance is so far ...

Would anyone have some insights ?
Thanks
Karsten Vennemann
www.terragis.net 

___
MapServer-users mailing list
MapServer-users@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/mapserver-users

___
MapServer-users mailing list
MapServer-users@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/mapserver-users

[MapServer-users] MB Tiles vs. UTF grids

[karsten]

Hi All,
 
For the first time, I am diving into actually using vector tiles and or UTF
grids on an OpenLayers map. I am confused  about UTF grids, especially I
could not find clear answers whether UTF Grids have been completely replaced
by MB Tiles or if UTF Grids are now a subset of MB Tiles. Posts on the web
seem to suggest that
 UTF grids can be stored inside MB Tiles . Note that I am
trying to stay outside the Mapbox empire (as much as possible) and trying to
use GDAL, MapServer etc.
GDAL can produce MB tiles (but not sure if that includes UTF grid info as
well) and MapServer can deliver UTF grid via WMS on the fly, but not sure
how performance is so far ...
Would anyone have some insights ?
 
Thanks
 
Karsten Vennemann
  www.terragis.net
 
___
MapServer-users mailing list
MapServer-users@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/mapserver-users

Re: [MapServer-users] Ask for advice on Caching large layers on high zoom level

[Travis Kirstine]

I've found the other limiting factors are disk speed (SSD vs HDD) and cache
type.  SQLite can be easy to manage but the write locking during inserts
can really slow things down (adding more cores won't help in this case)
when compared to writing a simple disk cache.

I agree with Scott in that if you are using COGs you shouldn't really need
MapCache as you could look at alternatives to serve this data out as is.

On Fri, 2 Sept 2022 at 10:14, Scott  wrote:

> COG files imply that they are already tiled. I'd be curious as to the
> performance of map rendering using just the COG files without creating
> tiles.
>
> Being the 'size of Poland' doesn't really matter. It's the pixel
> resolution that is important. If the pixel resolution is 100 meters vs 3
> meters you will have different performance results.
>
> Seeding will always be bound by CPU, memory, etc. Creating an image
> (ami) of your system in AWS, then running multiple EC2's instance can be
> insanely fast.
>
>
>
> On 9/2/22 06:41, Marcin Niemyjski via MapServer-users wrote:
> > Hello,
> >
> > My job is to cache 365 layers. These layers consist of up to 30 .tif
> > (COG) files stored in a mapfile. These layers are roughly the size of
> > Poland and I would like to acquire their tiles for level 14 zoom. One
> > layer for these settings:
> > sudo mapcache_seed -c /DiscPlanetiler/2022/03/02/2022-03-02.xml -t
> > 20220302 -g PUWG1992 -z 10,10 -n 32
> > caches 83h (32 cores is my max). I am looking for advice on how I could
> > speed up the generation of these tiles.
> >
> > Thanks,
> > Marcin
> >
> > ___
> > MapServer-users mailing list
> > MapServer-users@lists.osgeo.org
> > https://lists.osgeo.org/mailman/listinfo/mapserver-users
> ___
> MapServer-users mailing list
> MapServer-users@lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/mapserver-users
>
___
MapServer-users mailing list
MapServer-users@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/mapserver-users

Re: [MapServer-users] Ask for advice on Caching large layers on high zoom level

[Scott]

COG files imply that they are already tiled. I'd be curious as to the 
performance of map rendering using just the COG files without creating 
tiles.


Being the 'size of Poland' doesn't really matter. It's the pixel 
resolution that is important. If the pixel resolution is 100 meters vs 3 
meters you will have different performance results.


Seeding will always be bound by CPU, memory, etc. Creating an image 
(ami) of your system in AWS, then running multiple EC2's instance can be 
insanely fast.




On 9/2/22 06:41, Marcin Niemyjski via MapServer-users wrote:

Hello,

My job is to cache 365 layers. These layers consist of up to 30 .tif 
(COG) files stored in a mapfile. These layers are roughly the size of 
Poland and I would like to acquire their tiles for level 14 zoom. One 
layer for these settings:
sudo mapcache_seed -c /DiscPlanetiler/2022/03/02/2022-03-02.xml -t 
20220302 -g PUWG1992 -z 10,10 -n 32
caches 83h (32 cores is my max). I am looking for advice on how I could 
speed up the generation of these tiles.


Thanks,
Marcin

___
MapServer-users mailing list
MapServer-users@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/mapserver-users

___
MapServer-users mailing list
MapServer-users@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/mapserver-users

[MapServer-users] Ask for advice on Caching large layers on high zoom level

[Marcin Niemyjski via MapServer-users]

Hello,

My job is to cache 365 layers. These layers consist of up to 30 .tif (COG) 
files stored in a mapfile. These layers are roughly the size of Poland and I 
would like to acquire their tiles for level 14 zoom. One layer for these 
settings:
sudo mapcache_seed -c /DiscPlanetiler/2022/03/02/2022-03-02.xml -t 20220302 -g 
PUWG1992 -z 10,10 -n 32
caches 83h (32 cores is my max). I am looking for advice on how I could speed 
up the generation of these tiles.

Thanks,
Marcin
___
MapServer-users mailing list
MapServer-users@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/mapserver-users