Il giorno mer 3 ott 2018 alle ore 23:19 Guillaume Lederrey <[email protected]> ha scritto: > > Hello ! > > I'm working on the maps infrastructure for Wikimedia Maps. As guessed > by Eugene, we don't pregenerate tiles. You can find some info on our > infrastructure on wikitech [1] (as always, documentation should be > better than it is).
Hi. Sorry for the late reply and sorry to reach you in private, but I have some questions that I prefere to not make public. > We generate vector tiles that we store in Cassandra, regenerating > those vector tiles when we import changes from OSM. Raster tiles > (.png) are generated on the fly from the vector tiles and cached by > Varnish. That rasterization process is cheap, so some level of cache > miss are not an issue. That being said, please don't try to download > all our tiles by iterating over them! Ok. > We don't provide dumps of our vector tiles either, as this is not that > helpful, since you would still have to build the rendering > infrastructure. At that point, you're probably better off building the > full stack. What do you use to build the vector tiles ? Do you directly start for OSM dumps ? What we are looking for is something pre-generated so that we don't have to extract the whole OSM dump (we don't have enough computing power to parse that huge file). It would be ok, for us, to have an updated mbtiles that will be rendered and cached on-the-fly (we already have tried that with success, but we are unable to find an updated mbtiles dump and, as wrote above, we are unable to generate that dumps on own own) > Options that might work for you: > > * Have a proxy on your side that would cache our tiles. Depending on > your access patterns and the cache duration, this might be enough. We also tried that by using cloudflare (keep the following private): $ curl -I https://thumbnails.take2me.it/w_256/h_256/url/https://maps.wikimedia.org/osm-intl/12/2191/1490.png HTTP/2 200 date: Sun, 11 Nov 2018 08:32:10 GMT content-type: image/jpeg content-length: 15128 set-cookie: __cfduid=d44f565b88a285b2334ea1699eddca8461541925130; expires=Mon, 11-Nov-19 08:32:10 GMT; path=/; domain=.take2me.it; HttpOnly cache-control: max-age=31536000, public expires: Mon, 11 Nov 2019 08:31:49 GMT last-modified: Sun, 11 Nov 2018 08:31:49 GMT cf-cache-status: HIT expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"; server: cloudflare cf-ray: 477f68222d554334-MXP as you can see, it's a cache hit (1 year) from cloudflare, so that tile would be fetched from cloudflare and not from your server. Probably, by respecting your actual cache expire (1day) we can have an always updated map. How much time do you need to update your maps with updated data from OSM ? 1 day ? 1 Month? Just to know... By caching your tiles has some advantages (almost-zero infrastructure on our side) but also some disadvantage: we can't change the style. Any suggestion on how to generate raster tiles (are much faster to elaborate than vectors, on some smartphones) without having to generate the mbtiles from raw OSM data ? Are wrote above, we can't handle that huge file and the only MBTiles I have found is 1 year old, in example: https://openmaptiles.com/downloads/tileset/osm/europe/albania/?usage=education So, to recap: we are able to cache your tiles on our side, but we would like to generate our own raster tiles. We are able to generate raster tiles on our own, starting from a pre-computed mbtiles, but that file is outdated. How can we generate (or download) an updated mbtiles without using the whole OSM dump? Another thing to keep private: we are using your maps on our procution site. If I tell you the referral, could you please set that as whitelist (or at least, warn me before any suspensions ? We don't want to see our website down because you dropped our access to your maps) Thank you in advance Alessandro. _______________________________________________ Maps-l mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/maps-l
