Re: [OSM-dev] 120111 Planet Node Order?

2012-01-15 Thread Simon Poole
Lynn, current versions of osm2pgsql can import .pbf, so you are on the right track there. Richards text is good, but it was written when planet files were a third of the current size and is just a bit dated. If osm2pgsql can't hold the nodes in it's cache it will have to retrieve them from

Re: [OSM-dev] 120111 Planet Node Order?

2012-01-15 Thread Lynn W. Deffenbaugh (Mr)
On 1/15/2012 5:09 AM, Simon Poole wrote: current versions of osm2pgsql can import .pbf, so you are on the right track there. Richards text is good, but it was written when planet files were a third of the current size and is just a bit dated. If osm2pgsql can't hold the nodes in it's cache

Re: [OSM-dev] 120111 Planet Node Order?

2012-01-15 Thread Stephan Knauss
Hi Simon, On 15.01.2012 11:09, Simon Poole wrote: To give you current numbers, I just did (10 days ago) an import on a i7 2600, 16GB box that took 30 hours with the initial import phase running at Can you add your specs to the benchmarks page?

Re: [OSM-dev] 120111 Planet Node Order?

2012-01-15 Thread Simon Poole
The machine -is- a Hetzner EX-4. The one in use for cleanmap has some additional HW, but the planet import can be done on a stock machine in 33 hours. Simon PS: there is no big secret, the large gain is from -C 12000 Stephan Knauss o...@stephans-server.de schrieb: Hi Simon, On 15.01.2012

Re: [OSM-dev] 120111 Planet Node Order?

2012-01-15 Thread andrzej zaborowski
On 15 January 2012 11:26, Lynn W. Deffenbaugh (Mr) ldeff...@homeside.to wrote: On 1/15/2012 5:09 AM, Simon Poole wrote: To give you current numbers, I just did (10 days ago) an import on a i7 2600, 16GB box that took 30 hours with the initial import phase running at Processing: Node(1322468k

Re: [OSM-dev] 120111 Planet Node Order?

2012-01-15 Thread Lynn W. Deffenbaugh (Mr)
On 1/15/2012 5:09 AM, Simon Poole wrote: Lynn, current versions of osm2pgsql can import .pbf, so you are on the right track there. Richards text is good, but it was written when planet files were a third of the current size and is just a bit dated. If osm2pgsql can't hold the nodes in it's

Re: [OSM-dev] 120111 Planet Node Order?

2012-01-15 Thread Ian Dees
On Sun, Jan 15, 2012 at 4:24 PM, Lynn W. Deffenbaugh (Mr) ldeff...@homeside.to wrote: On 1/15/2012 5:09 AM, Simon Poole wrote: Lynn, current versions of osm2pgsql can import .pbf, so you are on the right track there. Richards text is good, but it was written when planet files were a

Re: [OSM-dev] 120111 Planet Node Order?

2012-01-15 Thread Simon Poole
http://planet.openstreetmap.org/pbf/ Simon PS: could you fix the wiki, as it really doesn't seem to point out where the planet pbf files are. Am 15.01.2012 23:24, schrieb Lynn W. Deffenbaugh (Mr): On 1/15/2012 5:09 AM, Simon Poole wrote: Lynn, current versions of osm2pgsql can import

[OSM-dev] 120111 Planet Node Order?

2012-01-14 Thread Lynn W. Deffenbaugh (Mr)
Greetings, I've been lurking in the group for a long time now and finally got motivated to try putting together my own Tile server. I got everything working, the whole way through mod-tile using a Florida extract as my data to keep things moving along. It was good. Then I downloaded

Re: [OSM-dev] 120111 Planet Node Order?

2012-01-14 Thread Simon Poole
You do have -C 12000 set? Haven't seen the error message before, but if you set the node cache smaller than necessary to store -all- nodes importing will be very slow (naturally if you don't have enough memory the machine will swap, but it sill still be faster). Simon Am 14.01.2012 23:16,

Re: [OSM-dev] 120111 Planet Node Order?

2012-01-14 Thread Lynn W. Deffenbaugh (Mr)
Actually, the instructions I was following called for -C 2048 (http://weait.com/content/build-your-own-openstreetmap-server), but when I did that I got the following error (running in a 4GB Ubuntu 10.04 VM): Out of memory for dense node cache, reduce --cache size I had to reduce to -C 1800

Re: [OSM-dev] 120111 Planet Node Order?

2012-01-14 Thread Simon Poole
Believe me, if you can't allocate enough memory (you should be running a 64bit OS and have at least enough swap allocated if you don't have sufficient memory) for the cache for the import in question, it is going to be very very very very slow. Don't be confused by the Florida or whatever

Re: [OSM-dev] 120111 Planet Node Order?

2012-01-14 Thread Simon Poole
Further tip: use the .pbf Files. It won't help a lot with your current issue, but is quite a bit faster. Simon -- Sent from my Galaxy Tab with Kaiten Mail.___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev

Re: [OSM-dev] 120111 Planet Node Order?

2012-01-14 Thread Lynn W. Deffenbaugh (Mr)
I'm a rank amateur at this, can you provide a link on how to use (or what to use instead of) osm2pgsql to import from a pbf instead of planet-120111.osm.bz2? .pbfs are not mentioned at http://weait.com/content/build-your-own-openstreetmap-server which is the best reference I've found on

Re: [OSM-dev] 120111 Planet Node Order?

2012-01-14 Thread Lynn W. Deffenbaugh (Mr)
On 1/14/2012 7:56 PM, Simon Poole wrote: Believe me, if you can't allocate enough memory (you should be running a 64bit OS and have at least enough swap allocated if you don't have sufficient memory) for the cache for the import in question, it is going to be very very very very slow. With