Re: [OSM-dev] planet.osm.org is verry slow

2020-01-25 Thread Yuri Astrakhan
OpenMapTiles has a tool to download the planet from all mirrors in parallel. Usually takes a few minutes, and it automatically verifies md5 checksum. The tool will not use the primary planet source by default. Lastly, the tool can also download validated extracts from geofabrik, bbbike, and

Re: [OSM-dev] planet.osm.org is verry slow

2020-01-25 Thread Simon Poole
Am 25.01.2020 um 22:19 schrieb marc marc: > Le 25.01.20 à 21:43, Simon Poole a écrit : >> Am 25.01.2020 um 21:12 schrieb marc marc: >>> is there a convenient way to update a pbf to exactly the same diff as >>> osm.org? and/or add the state.txt of the pbf produced on osm.org? >>> this would allow

Re: [OSM-dev] planet.osm.org is verry slow

2020-01-25 Thread marc marc
Le 25.01.20 à 21:43, Simon Poole a écrit : > > Am 25.01.2020 um 21:12 schrieb marc marc: >> is there a convenient way to update a pbf to exactly the same diff as >> osm.org? and/or add the state.txt of the pbf produced on osm.org? >> this would allow to have the same pbf mirrored on other sites

Re: [OSM-dev] planet.osm.org is verry slow

2020-01-25 Thread Simon Poole
Am 25.01.2020 um 21:12 schrieb marc marc: > is there a convenient way to update a pbf to exactly the same diff as > osm.org? and/or add the state.txt of the pbf produced on osm.org? > this would allow to have the same pbf mirrored on other sites without > having to download and/or encode the same

Re: [OSM-dev] planet.osm.org is verry slow

2020-01-25 Thread marc marc
is there a convenient way to update a pbf to exactly the same diff as osm.org? and/or add the state.txt of the pbf produced on osm.org? this would allow to have the same pbf mirrored on other sites without having to download and/or encode the same thing several times Le 25.01.20 à 18:34, marc

Re: [OSM-dev] planet.osm.org is verry slow

2020-01-25 Thread marc tobias
Wolfram, who asked about the bandwidth, is already running a mirror https://download.bbbike.org/osm/planet/ (listed on https://wiki.openstreetmap.org/wiki/Planet.osm#Downloading) so downloading it every week is likely trying to update his mirror. marc tobias > Message: 2 > Date: Sat, 25 Jan 2020

Re: [OSM-dev] planet.osm.org is verry slow

2020-01-25 Thread Tom Hughes
On 25/01/2020 15:45, Grant Slater wrote: The minutely, hourly and daily diff files will only take a second or 2 extra to download with the current late limits. The minutely files won't normally be affected at all as the limit only kicks in for files over 512Kb. Tom -- Tom Hughes

Re: [OSM-dev] planet.osm.org is verry slow

2020-01-25 Thread Grant Slater
Hi Wolfram and others, On Sat, 25 Jan 2020 at 10:32, Wolfram Schneider wrote: > > I wanted to download the latest planet from planet.osm.org and the > download rate is less than 450KByte/s. In the past I got > 30-60Mbyte/s. It takes now more than 36 hours to download the planet > (was 15min).

Re: [OSM-dev] planet.osm.org is verry slow

2020-01-25 Thread Ian Dees
As Simon mentioned, the planet server itself is bandwidth limited now. Can you use a planet mirror? It should redirect you to a mirror when requesting a download. If it isn't, maybe there's a bug to resolve. On Sat, Jan 25, 2020, 04:33 Wolfram Schneider wrote: > I wanted to download the latest

Re: [OSM-dev] planet.osm.org is verry slow

2020-01-25 Thread Simon Poole
Yes, there are now bandwidth restrictions on connections to planet.openstreetmap.org because the usage had skyrocketed and outgoing bandwidth was completely saturated. But the obvious question is: why are you even trying to download the full planet twice within a fortnight? Particularly given the

[OSM-dev] planet.osm.org is verry slow

2020-01-25 Thread Wolfram Schneider
I wanted to download the latest planet from planet.osm.org and the download rate is less than 450KByte/s. In the past I got 30-60Mbyte/s. It takes now more than 36 hours to download the planet (was 15min). All mirrors are outdated, you have to wait until Sat morning to see a new planet.osm.pbf